-- Logs begin at Tue 2022-08-30 23:30:56 UTC, end at Wed 2022-08-31 00:37:39 UTC. -- Aug 31 00:06:37.778196 dv-cinder-852210-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 00:06:37.788422 dv-cinder-852210-5-smb devstack@keystone.service[81477]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 00:06:37.791277 dv-cinder-852210-5-smb devstack@keystone.service[81477]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 00:06:37 2022] *** Aug 31 00:06:37.791410 dv-cinder-852210-5-smb devstack@keystone.service[81477]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 00:06:37.791517 dv-cinder-852210-5-smb devstack@keystone.service[81477]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 00:06:37.791622 dv-cinder-852210-5-smb devstack@keystone.service[81477]: nodename: dv-cinder-852210-5-smb Aug 31 00:06:37.791735 dv-cinder-852210-5-smb devstack@keystone.service[81477]: machine: x86_64 Aug 31 00:06:37.791846 dv-cinder-852210-5-smb devstack@keystone.service[81477]: clock source: unix Aug 31 00:06:37.791939 dv-cinder-852210-5-smb devstack@keystone.service[81477]: pcre jit disabled Aug 31 00:06:37.792038 dv-cinder-852210-5-smb devstack@keystone.service[81477]: detected number of CPU cores: 4 Aug 31 00:06:37.792142 dv-cinder-852210-5-smb devstack@keystone.service[81477]: current working directory: / Aug 31 00:06:37.792236 dv-cinder-852210-5-smb devstack@keystone.service[81477]: detected binary path: /usr/bin/uwsgi-core Aug 31 00:06:37.792343 dv-cinder-852210-5-smb devstack@keystone.service[81477]: your processes number limit is 47680 Aug 31 00:06:37.792444 dv-cinder-852210-5-smb devstack@keystone.service[81477]: your memory page size is 4096 bytes Aug 31 00:06:37.792545 dv-cinder-852210-5-smb devstack@keystone.service[81477]: detected max file descriptor number: 2048 Aug 31 00:06:37.792653 dv-cinder-852210-5-smb devstack@keystone.service[81477]: lock engine: pthread robust mutexes Aug 31 00:06:37.792903 dv-cinder-852210-5-smb devstack@keystone.service[81477]: thunder lock: enabled Aug 31 00:06:37.793200 dv-cinder-852210-5-smb devstack@keystone.service[81477]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 00:06:37.793381 dv-cinder-852210-5-smb devstack@keystone.service[81477]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 00:06:37.832593 dv-cinder-852210-5-smb devstack@keystone.service[81477]: Python main interpreter initialized at 0x558d74cb69c0 Aug 31 00:06:37.832593 dv-cinder-852210-5-smb devstack@keystone.service[81477]: python threads support enabled Aug 31 00:06:37.832593 dv-cinder-852210-5-smb devstack@keystone.service[81477]: your server socket listen backlog is limited to 100 connections Aug 31 00:06:37.832593 dv-cinder-852210-5-smb devstack@keystone.service[81477]: your mercy for graceful operations on workers is 90 seconds Aug 31 00:06:37.833038 dv-cinder-852210-5-smb devstack@keystone.service[81477]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 00:06:37.833038 dv-cinder-852210-5-smb devstack@keystone.service[81477]: *** Operational MODE: preforking *** Aug 31 00:06:37.833290 dv-cinder-852210-5-smb devstack@keystone.service[81477]: *** uWSGI is running in multiple interpreter mode *** Aug 31 00:06:37.833290 dv-cinder-852210-5-smb devstack@keystone.service[81477]: spawned uWSGI master process (pid: 81477) Aug 31 00:06:37.833515 dv-cinder-852210-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 00:06:37.835480 dv-cinder-852210-5-smb devstack@keystone.service[81477]: spawned uWSGI worker 1 (pid: 81491, cores: 1) Aug 31 00:06:37.835480 dv-cinder-852210-5-smb devstack@keystone.service[81477]: spawned uWSGI worker 2 (pid: 81492, cores: 1) Aug 31 00:06:37.835480 dv-cinder-852210-5-smb devstack@keystone.service[81477]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 00:06:42.108083 dv-cinder-852210-5-smb devstack@keystone.service[81491]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:06:42.108083 dv-cinder-852210-5-smb devstack@keystone.service[81491]: from cryptography.utils import int_from_bytes Aug 31 00:06:42.108932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:06:42.108932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: from cryptography.utils import int_from_bytes Aug 31 00:06:42.109069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:06:42.109069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: from cryptography.utils import int_from_bytes Aug 31 00:06:42.109533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:06:42.109533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: from cryptography.utils import int_from_bytes Aug 31 00:06:42.158286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:06:42.158493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:06:42.158588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:06:42.158679 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:06:42.158759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] command line args: [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:06:42.158837 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] command line args: [] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:06:42.158912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:06:42.159063 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ================================================================================ {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:06:42.159198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:06:42.159198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ================================================================================ {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:06:42.159322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] admin_token = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.159529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] admin_token = **** {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.159673 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] config_dir = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.159673 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.159847 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] config_dir = [] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.159915 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.159974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] config_source = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.160163 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] config_source = [] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.160257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] debug = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.160358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] debug = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.160422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.160737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.160839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.160914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.160974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.161032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.161094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.161154 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.161369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.161452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.161519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] list_limit = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.161580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] list_limit = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.161787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] log_config_append = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.161865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] log_config_append = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.162052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.162124 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.162191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] log_dir = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.162256 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] log_dir = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.162321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] log_file = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.162380 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] log_file = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.162448 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.162515 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.162580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.162640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.163963 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.164125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.164267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.164412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.164553 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.164691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.164821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.164963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.165094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.165231 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.165372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.165508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.165647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.165795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.165960 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.166093 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.166223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.166355 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.166489 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.166624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.166760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.166895 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.167577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.167738 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.167834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.167907 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.168023 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.168102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.168227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] publish_errors = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.168311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] publish_errors = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.168433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.168515 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.168638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.168714 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.168834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.168911 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.169029 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.169127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.169208 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.169281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.169353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] standard_threads = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.169430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] standard_threads = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.169510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.169589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.169661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.169733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.169804 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.169882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.170006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] use_journal = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.170080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] use_journal = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.170180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] use_json = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.170254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] use_json = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.170324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] use_stderr = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.170443 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] use_stderr = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.170527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] use_syslog = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.170606 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] use_syslog = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.170738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.170814 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:06:42.170891 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.170970 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.171052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.171126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.171196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.171266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.171342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.171422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.171505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.171578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.171653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.171760 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.171845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.171918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.171997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.172069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.172139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.172214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.172292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.172374 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.172454 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.172526 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.172596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.172665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.172735 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.172805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.172886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.172960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.173030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.173101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.173177 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.173249 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.173328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.173407 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.173491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.173570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.173648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.173727 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.173878 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.173953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.174023 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.174093 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.174163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.174233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.174314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.174432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.174511 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.174583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.174653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.174790 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.174877 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.175030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.175154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.175234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.175306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.175478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.175602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.175681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.175818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.175974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.176098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.176196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.176280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.176403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.176498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.176657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.176789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.176886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.176961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.177111 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.177245 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.177327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.177400 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.177565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.177698 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.177784 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.177857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.178026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.178150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.178242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.178318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.178468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.178591 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.178670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.178753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.178911 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.178987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.179097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.179185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.179356 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.179488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.179580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.179654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.179850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.179974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.180070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.180147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.180300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.180423 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.180502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.180591 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.180737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.180821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.180962 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.181045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.181190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.181276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.181416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.181506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.181642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.181732 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.181870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.181988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.182117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.182600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.182700 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.182811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.182908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.183006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.183108 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.183224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.183323 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.183433 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.183558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.183645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.183806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.183912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.184009 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.184092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.184249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.184341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.184492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.184575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.184697 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.184783 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.184967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.185051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.185197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.185280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.185448 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.185542 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.185677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.185799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.185876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.185989 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.186123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.186220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.186351 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.186435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.186583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.186666 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.186808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.186899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.187035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.187119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.187271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.187354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.187470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.187555 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.187733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.187865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.187951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.188043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.188209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.188321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.188444 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.188537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.188678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.188767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.188913 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.189003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.189152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.189247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.189410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.189492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.189650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.189740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.189889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.189968 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.190120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.190201 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.190351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.190516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.190595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.190669 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.190805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.190888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.191023 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.191114 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.191248 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.191330 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.191473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.191554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.191715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.191799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.191943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.192033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.192168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.192252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.192398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.192478 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.192682 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.192824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.192952 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.193075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.193075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.193309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.193309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.193563 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.193688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.193849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.193849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.194106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.194259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] auth.external = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.194391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.194524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.194661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] auth.external = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.194661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.194903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.194903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.195172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.195317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] auth.password = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.195442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.195575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] auth.token = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.195745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] auth.password = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.195841 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.195917 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] auth.token = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.195999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.196074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.196146 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.196228 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.196308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.196447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.196541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.196617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.196689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.196761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.196840 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.196911 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.196991 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] credential.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.197089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.197222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.197333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] credential.caching = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.197467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.197581 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.197712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.197835 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.197949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.198187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.198368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.198447 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.198626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.198707 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.198871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.198952 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.199100 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.199179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.199347 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.199428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.199602 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.199681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.199866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.199949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.200124 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.200205 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.200361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.200441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.200612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.200691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.200844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.200984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.201062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.201135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.201304 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.201384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.201548 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.201629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] federation.caching = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.201774 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.201854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.202016 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.202096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.202248 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.202330 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.202494 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.202573 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.202722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.202808 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.202970 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.203050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.203202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.203280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.203440 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.203529 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.203668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.203765 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.203958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.204038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.204205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.204367 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.204445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity.caching = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.204518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.204683 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.204763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.204931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.205020 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.205155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.205234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.205389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.205468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.205633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.205721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.205862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.205942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.206090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.206181 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.206318 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.206410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.206544 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.206623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.206781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.206860 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.207012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.207099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.207248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.207329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.207492 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.207571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.207750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.207851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.207996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.208080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.208241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.208328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.208480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.208568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.208715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.208836 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.208944 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.209028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.209177 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.209270 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.209407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.209488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.209639 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.209719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.209873 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.209962 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.210108 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.210189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.210334 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.210413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.210589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.210677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.210853 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.210934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.211085 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.211172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.211327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.211417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.211570 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.211651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.211819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.211905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.212059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.212153 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.212289 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.212373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.212519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.212600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.212750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.212833 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.212982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.213062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.213210 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.213290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.213439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.213534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.213682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.213762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.213916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.213999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.214138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.214219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.214363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.214444 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.214604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.214685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.214838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.214919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.215064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.215143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.215293 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.215379 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.215533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.215621 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.215785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.215877 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.216022 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.216103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.216260 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.216347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.216491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.216572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.216728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.216808 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.216970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.217052 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.217206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.217286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.217430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.217509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.217654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.217735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.217881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.217961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.218108 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.218189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.218335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.218417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.218558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.218639 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.218789 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.218868 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.219023 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.219105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.219253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.219334 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.219500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.219581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.219769 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.219854 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.220016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.220097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.220262 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.220342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.220505 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.220588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.220731 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.220811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.220962 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.221042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.221191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.221273 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.221422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.221502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.221658 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.221738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.221884 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.221965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.222125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.222205 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.222348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.222429 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.222587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.222668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.222825 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.222905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.223052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.223132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.223282 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.223363 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.223512 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.223634 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.223800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.223895 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.224007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.224115 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.224346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.224426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.224583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.224663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.224819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.224900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.225057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.225137 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.225286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.225366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] resource.caching = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.225532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.225614 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.225784 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.225865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.226014 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.226095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.226309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.226391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.226565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.226644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.226804 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.226874 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.227059 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.227143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] role.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.227301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.227382 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] role.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.227540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.227629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.227799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] role.caching = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.227951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.228036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] role.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.228208 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.228289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.228453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.228535 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.228698 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.228779 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.228944 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.229025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.229186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.229268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.229426 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.229508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.229669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.229749 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.229900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.229982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.230143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.230223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.230373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.230453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.230614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.230695 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.230854 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.230934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.231098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.231243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.231340 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.231479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.231746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.231843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.231986 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.232067 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.232232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.232321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.232483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.232564 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.232708 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.232789 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.232955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.233037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.233186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.233266 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.233422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.233510 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.233649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.233729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.233876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.233956 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.234102 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.234191 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.234332 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.234413 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.234568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.234648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.234817 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.234906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.235050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.235131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.235281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.235362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.235510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.235599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.235760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.235845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.235996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.236076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.236232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] token.caching = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.236325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.236461 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.236590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.236709 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.236790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.236945 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.237034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.237173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.237252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.237415 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.237496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.237652 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.237741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.237893 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.237972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.238122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.238201 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.238356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.238445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.238584 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.238665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.238820 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.238901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.239054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.239144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.239300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.239395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.239536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.239619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.239816 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.239914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.240059 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.240142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.connection = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.240301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.240382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.240547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.240628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.connection = **** {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.240780 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.240860 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.241016 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.241099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.241247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.241334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.241480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.241561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.241709 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.241792 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.241971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.242052 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.242205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.242285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.242433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.242515 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.242672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.242753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.242903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.242983 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.243143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.243224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.243372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.243453 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.243610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.243690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.243864 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.243948 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.244099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.244180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.244328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.244408 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.244492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:06:42.244569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.244831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:06:42.244938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:06:42.274075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.274266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.274362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.274441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.274518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.274595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.282892 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.283022 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.311491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.311690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.312011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.312249 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.364566 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.364727 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.412478 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.412690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.413128 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.413364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.574596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.574805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.574891 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.574957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.575058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.575139 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.575215 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.575278 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.575359 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.575518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.575674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.575842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.598768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.598905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.599059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.599249 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.599344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.599486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.599614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.599801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.599901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.600028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.600151 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.600313 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.600438 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.600573 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.611119 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.611326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.624067 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.624199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.624351 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.624515 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.624603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.624727 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.624811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.624933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.625115 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.625206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.625348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.625431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.625551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.625646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:06:42.642212 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.642346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.642499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:06:42.642629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:06:42.642755 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.642936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.643026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:06:42.643164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:06:42.643248 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.643377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.643470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.643594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.643741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.643906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.644034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.644161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.653419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.653645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.653778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.653896 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.653989 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.654194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.654325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.654477 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.661201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.661428 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.664084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.664363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.664489 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.664657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.664790 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.664971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.665074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.665201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.665364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.665495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.665576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.665711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.665795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.665872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.665947 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.666146 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.666288 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.666376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.666454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.666662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.666791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.666967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.689685 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.690018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.691126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.691404 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.691530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.691778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.695934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.696213 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.696340 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.696488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.696634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.696835 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.702853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.703132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.703569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.703883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.707142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.707429 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.707724 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.707848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.707981 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.708089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.708256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.708351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.708654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.708929 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.710175 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.710456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.710787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.710916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.711225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.711514 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.726224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.726498 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.726978 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.727257 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.730343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.731144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.733434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.733725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.734258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.734557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.738135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.738857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.741253 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.742045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.744548 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.744832 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.745121 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.745214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.745407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.745499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.745682 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.745772 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.746003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.746091 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.746396 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.746681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.761827 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.762112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.762377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.762467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.762629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.762732 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.762986 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.763243 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.769459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.770011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.771104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.771671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.772642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.772913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.773500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.773780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.775574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.775876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.776165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.776447 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.776572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.776701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.776793 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.777017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.777302 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.777596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.787971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.788249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.788525 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.788864 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.788988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.789092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.789173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.789400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.789527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.789671 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.789796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.789925 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.790216 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.790506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.805312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.806175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.808665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.809542 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.811510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.812453 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.812962 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.813885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.814529 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.814807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.815092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.815344 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.815626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.815937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.821691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.822825 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.823144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.824328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.826008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.826305 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.826588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.826858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.827193 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.827487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.827788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.828068 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.834888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.835176 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.835456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.836035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.836331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.836617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.842360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.842639 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.842915 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.843185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.843453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.843578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:06:42.843815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.843917 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.844045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.844167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.844296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.844469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.844605 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.844762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.844852 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.845033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.845173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.845301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.845428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.845555 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.845684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.845822 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.845959 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.846086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.846213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.846373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.846656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.846927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:06:42.879349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558d74cb69c0 pid: 81491 (default app) Aug 31 00:06:42.882974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc34628-4b62-435e-8b58-66d34a1dce9d None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:42.883259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc34628-4b62-435e-8b58-66d34a1dce9d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:42.883505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc34628-4b62-435e-8b58-66d34a1dce9d None None] PATH_INFO: `/v3` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:42.887682 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Wed Aug 31 00:06:42 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:42.888959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558d74cb69c0 pid: 81492 (default app) Aug 31 00:06:49.531183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55ae34-73b2-453b-ab65-b69c07ad19c2 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.531715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55ae34-73b2-453b-ab65-b69c07ad19c2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.531715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55ae34-73b2-453b-ab65-b69c07ad19c2 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.533041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:49.546212 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70967661-d00d-446e-838f-d8af0c1d6e46 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.546962 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70967661-d00d-446e-838f-d8af0c1d6e46 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.547247 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70967661-d00d-446e-838f-d8af0c1d6e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.620245 dv-cinder-852210-5-smb devstack@keystone.service[81492]: INFO dbcounter [None req-70967661-d00d-446e-838f-d8af0c1d6e46 None None] Registered counter for database keystone Aug 31 00:06:49.641626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG oslo_db.sqlalchemy.engines [None req-70967661-d00d-446e-838f-d8af0c1d6e46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81492) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:06:49.649890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writer thread running {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:06:49.829407 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG passlib.handlers.bcrypt [None req-70967661-d00d-446e-838f-d8af0c1d6e46 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81492) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 00:06:49.829705 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG passlib.handlers.bcrypt [None req-70967661-d00d-446e-838f-d8af0c1d6e46 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81492) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 00:06:49.888071 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-70967661-d00d-446e-838f-d8af0c1d6e46 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:49.889686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-70967661-d00d-446e-838f-d8af0c1d6e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:50.032647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1/3] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 00:06:50.562817 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55ae34-73b2-453b-ab65-b69c07ad19c2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:50.636528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: INFO dbcounter [None req-6b55ae34-73b2-453b-ab65-b69c07ad19c2 None None] Registered counter for database keystone Aug 31 00:06:50.661190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG oslo_db.sqlalchemy.engines [None req-6b55ae34-73b2-453b-ab65-b69c07ad19c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81491) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:06:50.672475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writer thread running {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:06:50.799989 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55ae34-73b2-453b-ab65-b69c07ad19c2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:50.805466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96500566-3c57-483b-95c4-bbc5264f7fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:50.806109 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96500566-3c57-483b-95c4-bbc5264f7fdd admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:50.806439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96500566-3c57-483b-95c4-bbc5264f7fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:50.806705 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96500566-3c57-483b-95c4-bbc5264f7fdd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:50.816221 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96500566-3c57-483b-95c4-bbc5264f7fdd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:50.867323 dv-cinder-852210-5-smb devstack@keystone.service[81491]: WARNING keystone.common.rbac_enforcer.enforcer [None req-96500566-3c57-483b-95c4-bbc5264f7fdd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 00:06:50.867670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96500566-3c57-483b-95c4-bbc5264f7fdd admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:50.877858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 3/4] 10.222.0.50 () {58 vars in 1324 bytes} [Wed Aug 31 00:06:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:06:50.885289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70967661-d00d-446e-838f-d8af0c1d6e46 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:50.906169 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70967661-d00d-446e-838f-d8af0c1d6e46 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:50.912801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2f4b7-ca7b-43ca-a0ae-fb9a3aa447c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:50.913930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2f4b7-ca7b-43ca-a0ae-fb9a3aa447c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:50.914206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2f4b7-ca7b-43ca-a0ae-fb9a3aa447c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:50.914482 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2f4b7-ca7b-43ca-a0ae-fb9a3aa447c6 admin admin] PATH_INFO: `/v3/projects/8ead22b3b4a34507bccadbdf3ec17342` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:50.916351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2f4b7-ca7b-43ca-a0ae-fb9a3aa447c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ead22b3b4a34507bccadbdf3ec17342)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:50.969551 dv-cinder-852210-5-smb devstack@keystone.service[81492]: WARNING keystone.common.rbac_enforcer.enforcer [None req-85e2f4b7-ca7b-43ca-a0ae-fb9a3aa447c6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 00:06:50.969918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2f4b7-ca7b-43ca-a0ae-fb9a3aa447c6 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:50.974511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 2/5] 10.222.0.50 () {56 vars in 1207 bytes} [Wed Aug 31 00:06:50 2022] GET /identity/v3/projects/8ead22b3b4a34507bccadbdf3ec17342 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:52.865012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d456ba-6832-4ee3-9b7c-05709514e665 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.865619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d456ba-6832-4ee3-9b7c-05709514e665 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.865619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d456ba-6832-4ee3-9b7c-05709514e665 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.872301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 4/6] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:06:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:52.878059 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dedd36-c192-44b0-b54f-704994d01ce3 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.878497 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dedd36-c192-44b0-b54f-704994d01ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.878592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dedd36-c192-44b0-b54f-704994d01ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.899811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-87dedd36-c192-44b0-b54f-704994d01ce3 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:52.901344 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-87dedd36-c192-44b0-b54f-704994d01ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:52.910994 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 3/7] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 00:06:53.175307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d456ba-6832-4ee3-9b7c-05709514e665 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.189888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d456ba-6832-4ee3-9b7c-05709514e665 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.194587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae7d75-6118-4939-8550-c927df06c0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.195196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae7d75-6118-4939-8550-c927df06c0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.195471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae7d75-6118-4939-8550-c927df06c0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.195743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae7d75-6118-4939-8550-c927df06c0a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.204236 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae7d75-6118-4939-8550-c927df06c0a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.206029 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae7d75-6118-4939-8550-c927df06c0a3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.215338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 5/8] 10.222.0.50 () {58 vars in 1324 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:06:53.221148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dedd36-c192-44b0-b54f-704994d01ce3 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.230439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dedd36-c192-44b0-b54f-704994d01ce3 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.236648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b4755-05c8-49e3-b958-92abc82588fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.237276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b4755-05c8-49e3-b958-92abc82588fd admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.237552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b4755-05c8-49e3-b958-92abc82588fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.237819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b4755-05c8-49e3-b958-92abc82588fd admin admin] PATH_INFO: `/v3/users/e54946c04b664d3c9e1fcc1a14c448bd` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.239363 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b4755-05c8-49e3-b958-92abc82588fd admin admin] RBAC: Authorizing `identity:get_user(user_id=e54946c04b664d3c9e1fcc1a14c448bd)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.241255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b4755-05c8-49e3-b958-92abc82588fd admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.242796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 4/9] 10.222.0.50 () {56 vars in 1198 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/users/e54946c04b664d3c9e1fcc1a14c448bd => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:55.200755 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b363a65-872b-47fb-993d-b36c284b496d None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.201273 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b363a65-872b-47fb-993d-b36c284b496d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.201273 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b363a65-872b-47fb-993d-b36c284b496d None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.202645 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:55.207984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9ac84-c948-488c-9125-84e7ce2551f9 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.208752 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9ac84-c948-488c-9125-84e7ce2551f9 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.209019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9ac84-c948-488c-9125-84e7ce2551f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.228289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-f6a9ac84-c948-488c-9125-84e7ce2551f9 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:55.229499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f6a9ac84-c948-488c-9125-84e7ce2551f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:55.260200 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba55a-7996-46fb-835f-7267366df79f None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.260439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba55a-7996-46fb-835f-7267366df79f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.260741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba55a-7996-46fb-835f-7267366df79f None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.262049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 7/11] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:55.267353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59165f-cc8f-4828-b46a-da0e80118ab2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.267643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59165f-cc8f-4828-b46a-da0e80118ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.267946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59165f-cc8f-4828-b46a-da0e80118ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.310278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG passlib.handlers.bcrypt [None req-4f59165f-cc8f-4828-b46a-da0e80118ab2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81491) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 00:06:55.310681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG passlib.handlers.bcrypt [None req-4f59165f-cc8f-4828-b46a-da0e80118ab2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81491) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 00:06:55.313364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 5/12] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:55.359630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4f59165f-cc8f-4828-b46a-da0e80118ab2 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:55.361269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4f59165f-cc8f-4828-b46a-da0e80118ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:55.464977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 8/13] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:55.586754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9ac84-c948-488c-9125-84e7ce2551f9 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.612858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:55.693641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9ac84-c948-488c-9125-84e7ce2551f9 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.724640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59165f-cc8f-4828-b46a-da0e80118ab2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.729947 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cfe98-9c47-4906-b4ff-88bffae192f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.730615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cfe98-9c47-4906-b4ff-88bffae192f6 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.730901 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cfe98-9c47-4906-b4ff-88bffae192f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.731174 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cfe98-9c47-4906-b4ff-88bffae192f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.742978 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cfe98-9c47-4906-b4ff-88bffae192f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-316cfe98-9c47-4906-b4ff-88bffae192f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:55.751987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:55.753030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:55.753889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:55.753889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:55.753889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:55.753889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:55.753889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:55.753889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:55.753889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:55.753889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:55.753889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:55.753889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:55.753889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:55.753889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:06:55.753889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 6/14] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:55.758979 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cfe98-9c47-4906-b4ff-88bffae192f6 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.830923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59165f-cc8f-4828-b46a-da0e80118ab2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.833304 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:55.841870 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:55.861521 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cfe98-9c47-4906-b4ff-88bffae192f6 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.870818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796d0e7-5a04-4cae-99fa-de3b26f4fd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.871744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796d0e7-5a04-4cae-99fa-de3b26f4fd01 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.872032 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796d0e7-5a04-4cae-99fa-de3b26f4fd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.872312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796d0e7-5a04-4cae-99fa-de3b26f4fd01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.894988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73cafb-4896-4720-9c55-136537a5e4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.895631 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73cafb-4896-4720-9c55-136537a5e4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.895941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73cafb-4896-4720-9c55-136537a5e4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.896215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73cafb-4896-4720-9c55-136537a5e4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.896907 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73cafb-4896-4720-9c55-136537a5e4c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:55.897208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73cafb-4896-4720-9c55-136537a5e4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:55.898733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73cafb-4896-4720-9c55-136537a5e4c7 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:55.910398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 7/15] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:55.916486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73cafb-4896-4720-9c55-136537a5e4c7 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.941137 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796d0e7-5a04-4cae-99fa-de3b26f4fd01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:55.942716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796d0e7-5a04-4cae-99fa-de3b26f4fd01 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:56.018990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73cafb-4896-4720-9c55-136537a5e4c7 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.038828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 9/16] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:06:56.044646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796d0e7-5a04-4cae-99fa-de3b26f4fd01 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.047481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:56.054632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1623df6-607f-46be-8598-af63e1eecf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:56.055279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1623df6-607f-46be-8598-af63e1eecf5b None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.055558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1623df6-607f-46be-8598-af63e1eecf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.055865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1623df6-607f-46be-8598-af63e1eecf5b None admin] PATH_INFO: `/v3/users/e54946c04b664d3c9e1fcc1a14c448bd` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.057136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1623df6-607f-46be-8598-af63e1eecf5b None admin] RBAC: Authorizing `identity:get_user(user_id=e54946c04b664d3c9e1fcc1a14c448bd)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:56.058971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1623df6-607f-46be-8598-af63e1eecf5b None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:56.060605 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 8/17] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:55 2022] GET /identity/v3/users/e54946c04b664d3c9e1fcc1a14c448bd => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:56.066370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1623df6-607f-46be-8598-af63e1eecf5b None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.081613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:56.147165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796d0e7-5a04-4cae-99fa-de3b26f4fd01 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.176285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1623df6-607f-46be-8598-af63e1eecf5b None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.181834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdf3b7-d8aa-4b03-beac-7f35c70314c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:56.183076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdf3b7-d8aa-4b03-beac-7f35c70314c6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.183354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdf3b7-d8aa-4b03-beac-7f35c70314c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.183618 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdf3b7-d8aa-4b03-beac-7f35c70314c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.202986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdf3b7-d8aa-4b03-beac-7f35c70314c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:56.204858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdf3b7-d8aa-4b03-beac-7f35c70314c6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:56.210487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bc733-198a-401e-88da-08ce87e71a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:56.211130 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bc733-198a-401e-88da-08ce87e71a72 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.211732 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bc733-198a-401e-88da-08ce87e71a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.211732 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bc733-198a-401e-88da-08ce87e71a72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.213020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bc733-198a-401e-88da-08ce87e71a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:56.214490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bc733-198a-401e-88da-08ce87e71a72 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:56.216106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 9/18] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:56.222098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bc733-198a-401e-88da-08ce87e71a72 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-09fdf3b7-d8aa-4b03-beac-7f35c70314c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:56.223344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:56.224430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:56.225266 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:56.225266 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:56.225266 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:06:56.225266 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 10/19] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:56.230279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdf3b7-d8aa-4b03-beac-7f35c70314c6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.285355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:56.301853 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:56.321529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bc733-198a-401e-88da-08ce87e71a72 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.331226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdf3b7-d8aa-4b03-beac-7f35c70314c6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.356628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27464206-95d4-473b-9e73-dc7df3c45822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:56.357252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27464206-95d4-473b-9e73-dc7df3c45822 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.357531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27464206-95d4-473b-9e73-dc7df3c45822 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.357803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27464206-95d4-473b-9e73-dc7df3c45822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.358528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27464206-95d4-473b-9e73-dc7df3c45822 None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.domain.id=default, user.id=e54946c04b664d3c9e1fcc1a14c448bd) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:56.358833 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27464206-95d4-473b-9e73-dc7df3c45822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:56.360355 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27464206-95d4-473b-9e73-dc7df3c45822 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:56.365036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7659f-2224-4962-acb8-71baa51c2d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:56.365656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7659f-2224-4962-acb8-71baa51c2d05 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.365933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7659f-2224-4962-acb8-71baa51c2d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.366204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7659f-2224-4962-acb8-71baa51c2d05 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.366849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7659f-2224-4962-acb8-71baa51c2d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:56.367074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 10/20] 10.222.0.50 () {56 vars in 1322 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/role_assignments?user.id=e54946c04b664d3c9e1fcc1a14c448bd&scope.domain.id=default&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:56.367174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7659f-2224-4962-acb8-71baa51c2d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:56.368562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7659f-2224-4962-acb8-71baa51c2d05 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:56.389378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 11/21] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:58.375959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678686-1878-44d9-8ec2-886ecae71c41 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.377002 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678686-1878-44d9-8ec2-886ecae71c41 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.377467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678686-1878-44d9-8ec2-886ecae71c41 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.379344 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 11/22] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:58.385027 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef1153-d851-40af-863e-8b9c0f13f2e0 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef1153-d851-40af-863e-8b9c0f13f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.385626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef1153-d851-40af-863e-8b9c0f13f2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.413382 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-10ef1153-d851-40af-863e-8b9c0f13f2e0 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:58.414666 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-10ef1153-d851-40af-863e-8b9c0f13f2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:58.510300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 12/23] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:58.599597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c49563-bb7e-4670-914b-d982de2e3093 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.600348 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c49563-bb7e-4670-914b-d982de2e3093 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.600826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c49563-bb7e-4670-914b-d982de2e3093 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.602348 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 12/24] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:58.612196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5ee5-f1eb-4746-a9bd-580ee1bb855d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.612480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5ee5-f1eb-4746-a9bd-580ee1bb855d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.612757 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5ee5-f1eb-4746-a9bd-580ee1bb855d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.640736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d06b5ee5-f1eb-4746-a9bd-580ee1bb855d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:58.641939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d06b5ee5-f1eb-4746-a9bd-580ee1bb855d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:58.691748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:58.726180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 13/25] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:58.967307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e495779-8599-4898-921c-1ccd72b9e559 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.967494 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e495779-8599-4898-921c-1ccd72b9e559 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.967785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e495779-8599-4898-921c-1ccd72b9e559 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.969350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 13/26] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:58.974323 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4653c-bd3d-4961-8dc1-75c621f8dbd2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.974611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4653c-bd3d-4961-8dc1-75c621f8dbd2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.974890 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4653c-bd3d-4961-8dc1-75c621f8dbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.990654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e495779-8599-4898-921c-1ccd72b9e559 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.016972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-85c4653c-bd3d-4961-8dc1-75c621f8dbd2 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:59.018227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-85c4653c-bd3d-4961-8dc1-75c621f8dbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:59.157058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e495779-8599-4898-921c-1ccd72b9e559 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.174233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 14/27] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:59.204317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4653c-bd3d-4961-8dc1-75c621f8dbd2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.224347 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f4061-8c5f-445d-ba43-f1fad16e7935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.226219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4061-8c5f-445d-ba43-f1fad16e7935 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.229876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4061-8c5f-445d-ba43-f1fad16e7935 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.230331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4061-8c5f-445d-ba43-f1fad16e7935 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.252354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f4061-8c5f-445d-ba43-f1fad16e7935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-831f4061-8c5f-445d-ba43-f1fad16e7935 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:59.257768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:59.258809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:59.259862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:59.259862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:59.259862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:59.259862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:59.259862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:59.259862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:59.259862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:59.259862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:59.259862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:59.259862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:59.259862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:59.259862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:06:59.270851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 14/28] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:59.285037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f4061-8c5f-445d-ba43-f1fad16e7935 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.296040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:59.425162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4653c-bd3d-4961-8dc1-75c621f8dbd2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.444883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:59.515716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f51b7-f789-4f41-aadc-ad53caab2c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.516903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f51b7-f789-4f41-aadc-ad53caab2c90 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.518009 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f51b7-f789-4f41-aadc-ad53caab2c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.518623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f51b7-f789-4f41-aadc-ad53caab2c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.531399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f4061-8c5f-445d-ba43-f1fad16e7935 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.553886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f51b7-f789-4f41-aadc-ad53caab2c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.555883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f51b7-f789-4f41-aadc-ad53caab2c90 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9e0f51b7-f789-4f41-aadc-ad53caab2c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:06:59.573316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:59.574428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:06:59.575440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:06:59.575440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:06:59.575440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:06:59.577301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 15/29] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:59.578479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f51b7-f789-4f41-aadc-ad53caab2c90 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.580970 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b10543-a23a-4d8f-8609-d15d8f318aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.581690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b10543-a23a-4d8f-8609-d15d8f318aab None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.582066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b10543-a23a-4d8f-8609-d15d8f318aab None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.582538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b10543-a23a-4d8f-8609-d15d8f318aab None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.583680 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b10543-a23a-4d8f-8609-d15d8f318aab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:59.584103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b10543-a23a-4d8f-8609-d15d8f318aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.585703 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b10543-a23a-4d8f-8609-d15d8f318aab None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.601602 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 15/30] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:59.603457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be14b8-6dc0-46b5-aa1b-0f52769a477b None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.603869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be14b8-6dc0-46b5-aa1b-0f52769a477b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.604245 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be14b8-6dc0-46b5-aa1b-0f52769a477b None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.605917 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 16/31] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:59.610686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be14b8-6dc0-46b5-aa1b-0f52769a477b None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.692009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:59.694582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f51b7-f789-4f41-aadc-ad53caab2c90 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.733805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed31d0-6520-4d29-9f82-6941af0078e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.734802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed31d0-6520-4d29-9f82-6941af0078e2 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.735297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed31d0-6520-4d29-9f82-6941af0078e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.735663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed31d0-6520-4d29-9f82-6941af0078e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.736469 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed31d0-6520-4d29-9f82-6941af0078e2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.737983 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed31d0-6520-4d29-9f82-6941af0078e2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.738744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be14b8-6dc0-46b5-aa1b-0f52769a477b None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.790154 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70940c5-f55d-4d1c-9c2e-5e38958ff0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.790986 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70940c5-f55d-4d1c-9c2e-5e38958ff0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.791386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70940c5-f55d-4d1c-9c2e-5e38958ff0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.791779 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70940c5-f55d-4d1c-9c2e-5e38958ff0a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.792562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70940c5-f55d-4d1c-9c2e-5e38958ff0a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:59.792961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70940c5-f55d-4d1c-9c2e-5e38958ff0a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.794449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70940c5-f55d-4d1c-9c2e-5e38958ff0a0 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.813952 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 17/32] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:59.814752 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70940c5-f55d-4d1c-9c2e-5e38958ff0a0 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.890665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 16/33] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Aug 31 00:06:59 2022] POST /identity/v3/roles => generated 219 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:59.892478 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d96b95-7116-4da1-8d85-215024fdf17f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.893279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d96b95-7116-4da1-8d85-215024fdf17f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.893910 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d96b95-7116-4da1-8d85-215024fdf17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.916061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-13d96b95-7116-4da1-8d85-215024fdf17f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:59.917885 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-13d96b95-7116-4da1-8d85-215024fdf17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:59.935305 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:59.945098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70940c5-f55d-4d1c-9c2e-5e38958ff0a0 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.995608 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:00.000935 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 17/34] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:00.002657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d96b95-7116-4da1-8d85-215024fdf17f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:00.013316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c8954-0eef-481a-b095-91771a9f4dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.013994 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c8954-0eef-481a-b095-91771a9f4dae None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.014265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c8954-0eef-481a-b095-91771a9f4dae None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.014541 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c8954-0eef-481a-b095-91771a9f4dae None admin] PATH_INFO: `/v3/users/e54946c04b664d3c9e1fcc1a14c448bd` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.020659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c8954-0eef-481a-b095-91771a9f4dae None admin] RBAC: Authorizing `identity:get_user(user_id=e54946c04b664d3c9e1fcc1a14c448bd)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.022175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c8954-0eef-481a-b095-91771a9f4dae None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.023930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 18/35] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:59 2022] GET /identity/v3/users/e54946c04b664d3c9e1fcc1a14c448bd => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:00.029633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c8954-0eef-481a-b095-91771a9f4dae None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:00.120957 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d96b95-7116-4da1-8d85-215024fdf17f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:00.165681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2127d-d672-4b26-9795-e9f8d7505660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.167392 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2127d-d672-4b26-9795-e9f8d7505660 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.167874 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2127d-d672-4b26-9795-e9f8d7505660 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.168300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2127d-d672-4b26-9795-e9f8d7505660 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.169402 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2127d-d672-4b26-9795-e9f8d7505660 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.171270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2127d-d672-4b26-9795-e9f8d7505660 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.183861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c8954-0eef-481a-b095-91771a9f4dae None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:00.208100 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:00.213450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 18/36] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 31 00:07:00 2022] POST /identity/v3/projects => generated 301 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:00.216301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0156fe-c09a-4246-bd77-c161934cc073 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.216603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0156fe-c09a-4246-bd77-c161934cc073 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.216896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0156fe-c09a-4246-bd77-c161934cc073 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.218704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 19/37] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:00.224583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a6909-ff35-45a1-8336-afb57ba87fed None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.224878 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a6909-ff35-45a1-8336-afb57ba87fed None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.225167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a6909-ff35-45a1-8336-afb57ba87fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.240629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfaef0-79e1-4d4f-af47-ad657983c392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.241342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfaef0-79e1-4d4f-af47-ad657983c392 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.241567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfaef0-79e1-4d4f-af47-ad657983c392 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.241831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfaef0-79e1-4d4f-af47-ad657983c392 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.243015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfaef0-79e1-4d4f-af47-ad657983c392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.244568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfaef0-79e1-4d4f-af47-ad657983c392 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.247488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 19/38] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:00.247600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-929a6909-ff35-45a1-8336-afb57ba87fed None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:00.249133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-929a6909-ff35-45a1-8336-afb57ba87fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:00.252296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfaef0-79e1-4d4f-af47-ad657983c392 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:00.332303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 20/39] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:00.343143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d610cf-d28a-4075-8674-005d655a29e1 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.343463 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d610cf-d28a-4075-8674-005d655a29e1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.343727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d610cf-d28a-4075-8674-005d655a29e1 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.345647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 21/40] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:00.351763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5578e-1c65-4486-b50a-e2d7cf976b84 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.352223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5578e-1c65-4486-b50a-e2d7cf976b84 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.352610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5578e-1c65-4486-b50a-e2d7cf976b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.358823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:00.388499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-0aa5578e-1c65-4486-b50a-e2d7cf976b84 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:00.389904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0aa5578e-1c65-4486-b50a-e2d7cf976b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:00.420975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfaef0-79e1-4d4f-af47-ad657983c392 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:00.469524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ef806-2cc7-42d7-82aa-e3634c9716f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.470294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ef806-2cc7-42d7-82aa-e3634c9716f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.470574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ef806-2cc7-42d7-82aa-e3634c9716f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.470850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ef806-2cc7-42d7-82aa-e3634c9716f2 None admin] PATH_INFO: `/v3/domains/default/users/e54946c04b664d3c9e1fcc1a14c448bd/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.472863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ef806-2cc7-42d7-82aa-e3634c9716f2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e54946c04b664d3c9e1fcc1a14c448bd, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.474315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ef806-2cc7-42d7-82aa-e3634c9716f2 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.485548 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 22/41] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:00.487042 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5578e-1c65-4486-b50a-e2d7cf976b84 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:00.556586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:00.608390 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5578e-1c65-4486-b50a-e2d7cf976b84 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:00.649117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea9e64-7e07-49c3-8fbe-b14c8c75553f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.649742 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea9e64-7e07-49c3-8fbe-b14c8c75553f None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.650079 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea9e64-7e07-49c3-8fbe-b14c8c75553f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.650361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea9e64-7e07-49c3-8fbe-b14c8c75553f None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.651060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea9e64-7e07-49c3-8fbe-b14c8c75553f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.652704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea9e64-7e07-49c3-8fbe-b14c8c75553f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.669911 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 23/42] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Aug 31 00:07:00 2022] POST /identity/v3/roles => generated 225 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:00.670932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea9e64-7e07-49c3-8fbe-b14c8c75553f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:00.750564 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 20/43] 10.222.0.50 () {58 vars in 1361 bytes} [Wed Aug 31 00:07:00 2022] PUT /identity/v3/domains/default/users/e54946c04b664d3c9e1fcc1a14c448bd/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:07:00.777284 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ef806-2cc7-42d7-82aa-e3634c9716f2 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:00.816451 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea9e64-7e07-49c3-8fbe-b14c8c75553f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:00.848236 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:00.865815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bed2d-5b11-4e80-8ac2-cab5bc34812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.866694 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bed2d-5b11-4e80-8ac2-cab5bc34812a None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.867110 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bed2d-5b11-4e80-8ac2-cab5bc34812a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.867551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bed2d-5b11-4e80-8ac2-cab5bc34812a None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.868580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bed2d-5b11-4e80-8ac2-cab5bc34812a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.870815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bed2d-5b11-4e80-8ac2-cab5bc34812a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.891688 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 24/44] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Aug 31 00:07:00 2022] POST /identity/v3/roles => generated 223 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:00.927101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ef806-2cc7-42d7-82aa-e3634c9716f2 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:00.954454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:00.968824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4d505-1191-4941-b78d-0e7c875c6957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.969487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4d505-1191-4941-b78d-0e7c875c6957 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.969768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4d505-1191-4941-b78d-0e7c875c6957 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.970037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4d505-1191-4941-b78d-0e7c875c6957 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.971327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4d505-1191-4941-b78d-0e7c875c6957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.973026 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4d505-1191-4941-b78d-0e7c875c6957 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.979738 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 21/45] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:00.983756 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bed2d-5b11-4e80-8ac2-cab5bc34812a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:01.096597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bed2d-5b11-4e80-8ac2-cab5bc34812a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:01.132255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97377ad-f6c2-41ef-8dba-222045b0650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:01.132881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97377ad-f6c2-41ef-8dba-222045b0650d None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:01.133162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97377ad-f6c2-41ef-8dba-222045b0650d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:01.133432 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97377ad-f6c2-41ef-8dba-222045b0650d None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:01.134090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97377ad-f6c2-41ef-8dba-222045b0650d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:01.135594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97377ad-f6c2-41ef-8dba-222045b0650d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:01.168175 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 25/46] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 31 00:07:00 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:02.688537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548d071-35b3-4ee8-9647-37a126750a4b None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:02.689107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548d071-35b3-4ee8-9647-37a126750a4b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:02.689107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548d071-35b3-4ee8-9647-37a126750a4b None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:02.690480 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 22/47] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:02.695997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d015f12-71bd-420b-9008-02130a3ca994 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:02.696439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d015f12-71bd-420b-9008-02130a3ca994 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:02.696526 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d015f12-71bd-420b-9008-02130a3ca994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:02.716353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7d015f12-71bd-420b-9008-02130a3ca994 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:02.717581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7d015f12-71bd-420b-9008-02130a3ca994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:02.751581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:02.796768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 26/48] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:03.064681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548d071-35b3-4ee8-9647-37a126750a4b None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:03.084285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91a93a-bca2-4b42-9d4b-cea5b4667939 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.084584 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91a93a-bca2-4b42-9d4b-cea5b4667939 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.084871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91a93a-bca2-4b42-9d4b-cea5b4667939 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.086245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 27/49] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:03.091368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c3bd-5e35-4be6-bc43-e42c004f1730 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.091657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c3bd-5e35-4be6-bc43-e42c004f1730 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.092000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c3bd-5e35-4be6-bc43-e42c004f1730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.184932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548d071-35b3-4ee8-9647-37a126750a4b None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:03.222420 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499526b-ce6f-47ef-9450-e3ad005d2eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:03.222654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4bd7c3bd-5e35-4be6-bc43-e42c004f1730 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:03.223063 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499526b-ce6f-47ef-9450-e3ad005d2eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.223349 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499526b-ce6f-47ef-9450-e3ad005d2eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.223626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499526b-ce6f-47ef-9450-e3ad005d2eb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.223907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4bd7c3bd-5e35-4be6-bc43-e42c004f1730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:03.234147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499526b-ce6f-47ef-9450-e3ad005d2eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-6499526b-ce6f-47ef-9450-e3ad005d2eb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:03.239003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:03.239884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:03.240663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:03.240663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:03.240663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:03.240663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:03.240663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:03.240663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:03.240663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:03.240663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:03.240663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:03.240663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:03.240663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:03.240663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:03.240663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 23/50] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:03.247316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499526b-ce6f-47ef-9450-e3ad005d2eb6 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:03.293249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 28/51] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:03.298057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:03.351264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499526b-ce6f-47ef-9450-e3ad005d2eb6 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:03.385937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51680c1e-848a-4c37-b72d-1a6657f58e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:03.386546 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680c1e-848a-4c37-b72d-1a6657f58e4c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.386827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680c1e-848a-4c37-b72d-1a6657f58e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.387098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680c1e-848a-4c37-b72d-1a6657f58e4c None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.387786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51680c1e-848a-4c37-b72d-1a6657f58e4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:03.388090 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51680c1e-848a-4c37-b72d-1a6657f58e4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:03.389487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51680c1e-848a-4c37-b72d-1a6657f58e4c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:03.397754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 24/52] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:03.403397 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7c3bd-5e35-4be6-bc43-e42c004f1730 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:03.493366 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:03.503029 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7c3bd-5e35-4be6-bc43-e42c004f1730 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:03.537419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50368ffc-14f8-46f8-9de4-dd8c88dbd9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:03.538056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50368ffc-14f8-46f8-9de4-dd8c88dbd9fd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.538302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50368ffc-14f8-46f8-9de4-dd8c88dbd9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.538613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50368ffc-14f8-46f8-9de4-dd8c88dbd9fd None admin] PATH_INFO: `/v3/users/e54946c04b664d3c9e1fcc1a14c448bd` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.540041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50368ffc-14f8-46f8-9de4-dd8c88dbd9fd None admin] RBAC: Authorizing `identity:get_user(user_id=e54946c04b664d3c9e1fcc1a14c448bd)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:03.541559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50368ffc-14f8-46f8-9de4-dd8c88dbd9fd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:03.543146 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 29/53] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:03 2022] GET /identity/v3/users/e54946c04b664d3c9e1fcc1a14c448bd => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:03.549056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51680c1e-848a-4c37-b72d-1a6657f58e4c None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:03.566068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50368ffc-14f8-46f8-9de4-dd8c88dbd9fd None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:03.647479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51680c1e-848a-4c37-b72d-1a6657f58e4c None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:03.661134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:03.667437 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50368ffc-14f8-46f8-9de4-dd8c88dbd9fd None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:03.686207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9ea2c-0b5a-41f5-a45e-f788bb94dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:03.686844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9ea2c-0b5a-41f5-a45e-f788bb94dd3f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.687125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9ea2c-0b5a-41f5-a45e-f788bb94dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.687398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9ea2c-0b5a-41f5-a45e-f788bb94dd3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.688561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9ea2c-0b5a-41f5-a45e-f788bb94dd3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:03.690069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9ea2c-0b5a-41f5-a45e-f788bb94dd3f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:03.691677 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 25/54] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:03.697863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9ea2c-0b5a-41f5-a45e-f788bb94dd3f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:03.702651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39262d72-dfc1-45fb-a804-38ef8f022389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:03.703272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39262d72-dfc1-45fb-a804-38ef8f022389 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.703552 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39262d72-dfc1-45fb-a804-38ef8f022389 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.703859 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39262d72-dfc1-45fb-a804-38ef8f022389 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.705016 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39262d72-dfc1-45fb-a804-38ef8f022389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:03.706785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39262d72-dfc1-45fb-a804-38ef8f022389 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:03.708063 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 30/55] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:03.713648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39262d72-dfc1-45fb-a804-38ef8f022389 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:03.741291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:03.801534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9ea2c-0b5a-41f5-a45e-f788bb94dd3f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:03.817680 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39262d72-dfc1-45fb-a804-38ef8f022389 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:03.835274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5c75-4cc5-4d2d-b027-eec3a8cc9e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:03.835926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5c75-4cc5-4d2d-b027-eec3a8cc9e7f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.836206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5c75-4cc5-4d2d-b027-eec3a8cc9e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.836478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5c75-4cc5-4d2d-b027-eec3a8cc9e7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.837211 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b5c75-4cc5-4d2d-b027-eec3a8cc9e7f None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.domain.id=default, user.id=e54946c04b664d3c9e1fcc1a14c448bd) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:03.837522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b5c75-4cc5-4d2d-b027-eec3a8cc9e7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:03.838995 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b5c75-4cc5-4d2d-b027-eec3a8cc9e7f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:03.845248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 26/56] 10.222.0.50 () {56 vars in 1322 bytes} [Wed Aug 31 00:07:03 2022] GET /identity/v3/role_assignments?user.id=e54946c04b664d3c9e1fcc1a14c448bd&scope.domain.id=default&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:03.854488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf4957-00bb-4003-9e27-af9a45213b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:03.855262 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4957-00bb-4003-9e27-af9a45213b82 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.855551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4957-00bb-4003-9e27-af9a45213b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.855864 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4957-00bb-4003-9e27-af9a45213b82 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.856576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf4957-00bb-4003-9e27-af9a45213b82 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:03.858279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf4957-00bb-4003-9e27-af9a45213b82 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:03.888512 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 31/57] 10.222.0.50 () {60 vars in 1140 bytes} [Wed Aug 31 00:07:03 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:05.791517 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba1399-4bb0-4931-b41b-1729c3d78cd9 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.792455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba1399-4bb0-4931-b41b-1729c3d78cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.792455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba1399-4bb0-4931-b41b-1729c3d78cd9 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.794672 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 27/58] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:05.801140 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d6614-5cd0-4f5c-89c7-532a747f5b89 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.801560 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d6614-5cd0-4f5c-89c7-532a747f5b89 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.801728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d6614-5cd0-4f5c-89c7-532a747f5b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.829030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-947d6614-5cd0-4f5c-89c7-532a747f5b89 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:05.830289 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-947d6614-5cd0-4f5c-89c7-532a747f5b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:05.902514 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 32/59] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:06.168530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba1399-4bb0-4931-b41b-1729c3d78cd9 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:06.221467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:06.282088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba1399-4bb0-4931-b41b-1729c3d78cd9 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:06.317283 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e911943-9a31-45f9-a4ff-446a11a13084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:06.317916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e911943-9a31-45f9-a4ff-446a11a13084 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:06.318196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e911943-9a31-45f9-a4ff-446a11a13084 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:06.318465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e911943-9a31-45f9-a4ff-446a11a13084 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:06.319689 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e911943-9a31-45f9-a4ff-446a11a13084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:06.321261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e911943-9a31-45f9-a4ff-446a11a13084 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:06.322907 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 28/60] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:06.329340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d6614-5cd0-4f5c-89c7-532a747f5b89 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:06.345265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:06.439088 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d6614-5cd0-4f5c-89c7-532a747f5b89 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:06.473844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060ed53-3921-4a6e-a7ed-54606d806dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:06.474450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060ed53-3921-4a6e-a7ed-54606d806dbe None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:06.474730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060ed53-3921-4a6e-a7ed-54606d806dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:06.475003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060ed53-3921-4a6e-a7ed-54606d806dbe None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:06.475651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060ed53-3921-4a6e-a7ed-54606d806dbe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:06.477151 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060ed53-3921-4a6e-a7ed-54606d806dbe None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:06.509668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 33/61] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:06 2022] POST /identity/v3/users => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:09.736170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec910-32ff-41b5-98ce-1e8966d9fe13 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.737211 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec910-32ff-41b5-98ce-1e8966d9fe13 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.737702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec910-32ff-41b5-98ce-1e8966d9fe13 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.739289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 29/62] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:09.745029 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d84b03-7430-421d-b546-1a731234819d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.745899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d84b03-7430-421d-b546-1a731234819d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.746381 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d84b03-7430-421d-b546-1a731234819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.771347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-71d84b03-7430-421d-b546-1a731234819d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:09.772972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-71d84b03-7430-421d-b546-1a731234819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:09.789943 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705818f-fd9b-4af9-8979-4a1d9a80aaa5 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.789943 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705818f-fd9b-4af9-8979-4a1d9a80aaa5 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.789943 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705818f-fd9b-4af9-8979-4a1d9a80aaa5 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.789943 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 30/63] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:09.797289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8354be-6f3a-46be-b7e0-46e2f465c3f7 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.797814 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8354be-6f3a-46be-b7e0-46e2f465c3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.798275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8354be-6f3a-46be-b7e0-46e2f465c3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.835558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-df8354be-6f3a-46be-b7e0-46e2f465c3f7 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:09.835558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-df8354be-6f3a-46be-b7e0-46e2f465c3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:09.853123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:09.862536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 34/64] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:09.864192 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550de83-50b6-4732-bd2c-ca9d1bd35bb2 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.864622 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550de83-50b6-4732-bd2c-ca9d1bd35bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.865036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550de83-50b6-4732-bd2c-ca9d1bd35bb2 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.866676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 35/65] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:09.877116 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d20ff9-44ad-42ac-b759-cef258dd49c7 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.877690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d20ff9-44ad-42ac-b759-cef258dd49c7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.878158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d20ff9-44ad-42ac-b759-cef258dd49c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.899435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a5d20ff9-44ad-42ac-b759-cef258dd49c7 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:09.901160 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a5d20ff9-44ad-42ac-b759-cef258dd49c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:09.965778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 31/66] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:10.017144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 36/67] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:10.148781 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f3c8c-172e-4182-a653-b1ed9db361cb None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.149416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f3c8c-172e-4182-a653-b1ed9db361cb None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.149895 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f3c8c-172e-4182-a653-b1ed9db361cb None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.151555 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 32/68] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:10.163195 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7446dc-1756-4943-b5f8-d12de98ea788 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.163798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7446dc-1756-4943-b5f8-d12de98ea788 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.164839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f3c8c-172e-4182-a653-b1ed9db361cb None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.175219 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7446dc-1756-4943-b5f8-d12de98ea788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.212983 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-fa7446dc-1756-4943-b5f8-d12de98ea788 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:10.215348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fa7446dc-1756-4943-b5f8-d12de98ea788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:10.247451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.316949 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f3c8c-172e-4182-a653-b1ed9db361cb None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.324003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 37/69] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:10.325491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda4299-c044-477e-b624-c3b90a2906c7 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.326249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda4299-c044-477e-b624-c3b90a2906c7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.326535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda4299-c044-477e-b624-c3b90a2906c7 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.331791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 38/70] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:10.332497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda4299-c044-477e-b624-c3b90a2906c7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.352871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900579c3-128d-4c85-bc42-59f3af67c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.353582 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900579c3-128d-4c85-bc42-59f3af67c6ce None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.353896 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900579c3-128d-4c85-bc42-59f3af67c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.354169 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900579c3-128d-4c85-bc42-59f3af67c6ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.365697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900579c3-128d-4c85-bc42-59f3af67c6ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-900579c3-128d-4c85-bc42-59f3af67c6ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:10.370596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:10.371456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:10.376673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:10.376673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:10.376673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:10.376673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:10.376673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:10.376673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:10.376673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:10.376673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:10.376673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:10.376673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:10.376673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:10.376673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:10.376673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 33/71] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:10.376673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900579c3-128d-4c85-bc42-59f3af67c6ce None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.392715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.438850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda4299-c044-477e-b624-c3b90a2906c7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.475550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec87727-63b6-4dbf-b038-b690c6533a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.476243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec87727-63b6-4dbf-b038-b690c6533a02 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.476735 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec87727-63b6-4dbf-b038-b690c6533a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.476840 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec87727-63b6-4dbf-b038-b690c6533a02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.482761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900579c3-128d-4c85-bc42-59f3af67c6ce None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.484319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.490223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec87727-63b6-4dbf-b038-b690c6533a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-eec87727-63b6-4dbf-b038-b690c6533a02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:10.499269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:10.500409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:10.501203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:10.501203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:10.501203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:10.501203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:10.501203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:10.501203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:10.501203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:10.501203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:10.501203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:10.501203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:10.501203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:10.501203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:10.501203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 39/72] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:10.502595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede27ca3-aed9-4a90-b2ac-98ab00d7baf4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.502595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede27ca3-aed9-4a90-b2ac-98ab00d7baf4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.502823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede27ca3-aed9-4a90-b2ac-98ab00d7baf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.521615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11f9fb-f8eb-4a52-ba53-c1f9a29515ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.522276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11f9fb-f8eb-4a52-ba53-c1f9a29515ee None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.522557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11f9fb-f8eb-4a52-ba53-c1f9a29515ee None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.522832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11f9fb-f8eb-4a52-ba53-c1f9a29515ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.527283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ede27ca3-aed9-4a90-b2ac-98ab00d7baf4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:10.528529 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ede27ca3-aed9-4a90-b2ac-98ab00d7baf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:10.533665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11f9fb-f8eb-4a52-ba53-c1f9a29515ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-3d11f9fb-f8eb-4a52-ba53-c1f9a29515ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:10.538580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:10.539462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:10.540269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:10.540269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:10.540269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:10.540269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:10.540269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:10.540269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:10.540269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:10.540269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:10.540269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:10.540269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:10.540269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:10.540269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:10.540269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 34/73] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:10.540990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11f9fb-f8eb-4a52-ba53-c1f9a29515ee None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.607773 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 40/74] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:10.607773 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede27ca3-aed9-4a90-b2ac-98ab00d7baf4 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.650601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11f9fb-f8eb-4a52-ba53-c1f9a29515ee None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.652371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.689311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64b163-d809-43fe-85d7-10f0ff9dda26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.690027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64b163-d809-43fe-85d7-10f0ff9dda26 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.690314 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64b163-d809-43fe-85d7-10f0ff9dda26 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.690590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64b163-d809-43fe-85d7-10f0ff9dda26 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.691292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64b163-d809-43fe-85d7-10f0ff9dda26 None admin] RBAC: Adding query filter params (name=member) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:10.691596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64b163-d809-43fe-85d7-10f0ff9dda26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.693076 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64b163-d809-43fe-85d7-10f0ff9dda26 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.701537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 35/75] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:10.702422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64b163-d809-43fe-85d7-10f0ff9dda26 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.714151 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede27ca3-aed9-4a90-b2ac-98ab00d7baf4 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.728890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.751775 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb8562-167f-4a0c-adb5-2c10ec8e5371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.752434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb8562-167f-4a0c-adb5-2c10ec8e5371 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.752702 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb8562-167f-4a0c-adb5-2c10ec8e5371 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.752981 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb8562-167f-4a0c-adb5-2c10ec8e5371 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.753674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb8562-167f-4a0c-adb5-2c10ec8e5371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:10.753993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb8562-167f-4a0c-adb5-2c10ec8e5371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.755424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb8562-167f-4a0c-adb5-2c10ec8e5371 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.767942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 41/76] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:10.768786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb8562-167f-4a0c-adb5-2c10ec8e5371 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.814218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64b163-d809-43fe-85d7-10f0ff9dda26 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.849400 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01cc39-b65c-4fc7-bd3f-4ce1f400724b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.849990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01cc39-b65c-4fc7-bd3f-4ce1f400724b None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.850272 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01cc39-b65c-4fc7-bd3f-4ce1f400724b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.850550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01cc39-b65c-4fc7-bd3f-4ce1f400724b None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.851251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01cc39-b65c-4fc7-bd3f-4ce1f400724b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:10.851531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01cc39-b65c-4fc7-bd3f-4ce1f400724b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.852973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01cc39-b65c-4fc7-bd3f-4ce1f400724b None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.861470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 36/77] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:10.862054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01cc39-b65c-4fc7-bd3f-4ce1f400724b None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.894710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb8562-167f-4a0c-adb5-2c10ec8e5371 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.904858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.930037 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808bff8-e24e-4caf-ace0-34d43b148fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.930710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808bff8-e24e-4caf-ace0-34d43b148fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.930984 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808bff8-e24e-4caf-ace0-34d43b148fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.931257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808bff8-e24e-4caf-ace0-34d43b148fe9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.932896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808bff8-e24e-4caf-ace0-34d43b148fe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.934382 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808bff8-e24e-4caf-ace0-34d43b148fe9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.936251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 42/78] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:10.936786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808bff8-e24e-4caf-ace0-34d43b148fe9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.950383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.965413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01cc39-b65c-4fc7-bd3f-4ce1f400724b None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.999092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1e396-df4b-4299-9eed-50858d56a7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.999747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1e396-df4b-4299-9eed-50858d56a7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.000041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1e396-df4b-4299-9eed-50858d56a7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.000319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1e396-df4b-4299-9eed-50858d56a7a9 None admin] PATH_INFO: `/v3/users/09d7ab687f544d1faaad37cdef56ae55` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.014184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1e396-df4b-4299-9eed-50858d56a7a9 None admin] RBAC: Authorizing `identity:get_user(user_id=09d7ab687f544d1faaad37cdef56ae55)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.015663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1e396-df4b-4299-9eed-50858d56a7a9 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.017323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 37/79] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/users/09d7ab687f544d1faaad37cdef56ae55 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:11.018102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1e396-df4b-4299-9eed-50858d56a7a9 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.034708 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808bff8-e24e-4caf-ace0-34d43b148fe9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.068575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eebb5b-dcc2-44bc-aefa-9e9b99e39079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.069225 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eebb5b-dcc2-44bc-aefa-9e9b99e39079 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.069555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eebb5b-dcc2-44bc-aefa-9e9b99e39079 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.069838 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eebb5b-dcc2-44bc-aefa-9e9b99e39079 None admin] PATH_INFO: `/v3/users/e54946c04b664d3c9e1fcc1a14c448bd` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.070981 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eebb5b-dcc2-44bc-aefa-9e9b99e39079 None admin] RBAC: Authorizing `identity:get_user(user_id=e54946c04b664d3c9e1fcc1a14c448bd)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.072627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eebb5b-dcc2-44bc-aefa-9e9b99e39079 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.074413 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 43/80] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/users/e54946c04b664d3c9e1fcc1a14c448bd => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:11.075006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eebb5b-dcc2-44bc-aefa-9e9b99e39079 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.119988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.126363 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1e396-df4b-4299-9eed-50858d56a7a9 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.159614 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbdcec-26bd-4c68-991b-faa41376693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.160712 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbdcec-26bd-4c68-991b-faa41376693c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.160990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbdcec-26bd-4c68-991b-faa41376693c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.161268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbdcec-26bd-4c68-991b-faa41376693c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.171499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbdcec-26bd-4c68-991b-faa41376693c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-bddbdcec-26bd-4c68-991b-faa41376693c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:11.176431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:11.177412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:11.180377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:11.180377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:11.180377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:11.180377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:11.180377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:11.180377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:11.180377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:11.180377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:11.180377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:11.180377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:11.180377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:11.180377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:11.180377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 38/81] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:11.180377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbdcec-26bd-4c68-991b-faa41376693c None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.181187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eebb5b-dcc2-44bc-aefa-9e9b99e39079 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.183634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.216048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10cf94-29ec-45f7-840f-fff70aba77af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.216685 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10cf94-29ec-45f7-840f-fff70aba77af None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.216969 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10cf94-29ec-45f7-840f-fff70aba77af None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.217256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10cf94-29ec-45f7-840f-fff70aba77af None admin] PATH_INFO: `/v3/users/09d7ab687f544d1faaad37cdef56ae55` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.218385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10cf94-29ec-45f7-840f-fff70aba77af None admin] RBAC: Authorizing `identity:get_user(user_id=09d7ab687f544d1faaad37cdef56ae55)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.219890 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10cf94-29ec-45f7-840f-fff70aba77af None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.221488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 44/82] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/users/09d7ab687f544d1faaad37cdef56ae55 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:11.222239 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10cf94-29ec-45f7-840f-fff70aba77af None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.295540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbdcec-26bd-4c68-991b-faa41376693c None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.327373 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10cf94-29ec-45f7-840f-fff70aba77af None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.329175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429359c-9531-45eb-ae44-e8caf8683927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429359c-9531-45eb-ae44-e8caf8683927 None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.330091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429359c-9531-45eb-ae44-e8caf8683927 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.330363 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429359c-9531-45eb-ae44-e8caf8683927 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.331025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429359c-9531-45eb-ae44-e8caf8683927 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.332527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429359c-9531-45eb-ae44-e8caf8683927 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.340632 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.361743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 39/83] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:11 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:11.362002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8ba75-6769-4bb2-9d69-58f6be6ec669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.362651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ba75-6769-4bb2-9d69-58f6be6ec669 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.362950 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ba75-6769-4bb2-9d69-58f6be6ec669 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.363155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429359c-9531-45eb-ae44-e8caf8683927 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.363258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ba75-6769-4bb2-9d69-58f6be6ec669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.431622 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.445150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8ba75-6769-4bb2-9d69-58f6be6ec669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.446679 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8ba75-6769-4bb2-9d69-58f6be6ec669 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.479086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429359c-9531-45eb-ae44-e8caf8683927 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.526575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad064763-8e12-45c1-918f-770a622d4b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.527213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad064763-8e12-45c1-918f-770a622d4b4d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.527495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad064763-8e12-45c1-918f-770a622d4b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.527800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad064763-8e12-45c1-918f-770a622d4b4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.556311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 45/84] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:11.557222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8ba75-6769-4bb2-9d69-58f6be6ec669 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.572477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.607227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad064763-8e12-45c1-918f-770a622d4b4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.608918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad064763-8e12-45c1-918f-770a622d4b4d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.673428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8ba75-6769-4bb2-9d69-58f6be6ec669 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.681917 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.712545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53372b98-729b-4dff-9e1a-968b92b4864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.713521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53372b98-729b-4dff-9e1a-968b92b4864e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.713953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53372b98-729b-4dff-9e1a-968b92b4864e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.714381 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53372b98-729b-4dff-9e1a-968b92b4864e None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.715233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53372b98-729b-4dff-9e1a-968b92b4864e None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:11.715679 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53372b98-729b-4dff-9e1a-968b92b4864e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.717245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53372b98-729b-4dff-9e1a-968b92b4864e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.726996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 46/85] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:11.728178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53372b98-729b-4dff-9e1a-968b92b4864e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.752436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 40/86] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:11.753443 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad064763-8e12-45c1-918f-770a622d4b4d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.834182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.863901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53372b98-729b-4dff-9e1a-968b92b4864e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.876602 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad064763-8e12-45c1-918f-770a622d4b4d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.901047 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a904be-ff81-458f-a309-89c79ff58d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.901753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a904be-ff81-458f-a309-89c79ff58d01 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.902314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a904be-ff81-458f-a309-89c79ff58d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.902465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a904be-ff81-458f-a309-89c79ff58d01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.915001 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67d096-5d4b-4a2b-93d2-efb529140c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.916080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67d096-5d4b-4a2b-93d2-efb529140c64 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.916563 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67d096-5d4b-4a2b-93d2-efb529140c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.917014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67d096-5d4b-4a2b-93d2-efb529140c64 None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.918342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67d096-5d4b-4a2b-93d2-efb529140c64 None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.921161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67d096-5d4b-4a2b-93d2-efb529140c64 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.923219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 41/87] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:11.924404 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67d096-5d4b-4a2b-93d2-efb529140c64 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.954897 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.981182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a904be-ff81-458f-a309-89c79ff58d01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.982744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a904be-ff81-458f-a309-89c79ff58d01 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.027960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67d096-5d4b-4a2b-93d2-efb529140c64 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.062982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab165d-cde6-4873-92b8-ea086d64be21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.063358 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.064334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab165d-cde6-4873-92b8-ea086d64be21 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.064826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab165d-cde6-4873-92b8-ea086d64be21 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.065262 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab165d-cde6-4873-92b8-ea086d64be21 None admin] PATH_INFO: `/v3/users/09d7ab687f544d1faaad37cdef56ae55` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.066642 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab165d-cde6-4873-92b8-ea086d64be21 None admin] RBAC: Authorizing `identity:get_user(user_id=09d7ab687f544d1faaad37cdef56ae55)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.068394 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab165d-cde6-4873-92b8-ea086d64be21 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.070232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 42/88] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/users/09d7ab687f544d1faaad37cdef56ae55 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:12.071324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab165d-cde6-4873-92b8-ea086d64be21 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.093030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 47/89] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:12.098601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a904be-ff81-458f-a309-89c79ff58d01 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.169963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.176055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab165d-cde6-4873-92b8-ea086d64be21 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.213454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4c36b-1918-4564-8e4b-42d4a6d39c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.214442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4c36b-1918-4564-8e4b-42d4a6d39c8f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.214919 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4c36b-1918-4564-8e4b-42d4a6d39c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.215385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4c36b-1918-4564-8e4b-42d4a6d39c8f None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.215663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a904be-ff81-458f-a309-89c79ff58d01 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.217073 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4c36b-1918-4564-8e4b-42d4a6d39c8f None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.218914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4c36b-1918-4564-8e4b-42d4a6d39c8f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.220946 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 43/90] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:12.222060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4c36b-1918-4564-8e4b-42d4a6d39c8f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.259267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee787cc3-c5a3-436d-b1b9-fd0156f4443d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.260549 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee787cc3-c5a3-436d-b1b9-fd0156f4443d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.260549 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee787cc3-c5a3-436d-b1b9-fd0156f4443d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.260745 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee787cc3-c5a3-436d-b1b9-fd0156f4443d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.261324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee787cc3-c5a3-436d-b1b9-fd0156f4443d None admin] RBAC: Adding query filter params (role.id=8615852d81aa46c39661d01a0372d8e8, scope.project.id=1221b9ee938248cf926034ec51adb9cf, user.id=09d7ab687f544d1faaad37cdef56ae55) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:12.261635 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee787cc3-c5a3-436d-b1b9-fd0156f4443d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.263098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee787cc3-c5a3-436d-b1b9-fd0156f4443d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.272086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 48/91] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/role_assignments?user.id=09d7ab687f544d1faaad37cdef56ae55&scope.project.id=1221b9ee938248cf926034ec51adb9cf&role.id=8615852d81aa46c39661d01a0372d8e8 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:12.272890 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee787cc3-c5a3-436d-b1b9-fd0156f4443d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.319691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.334315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4c36b-1918-4564-8e4b-42d4a6d39c8f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.371496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10728e62-ea28-4276-b00d-37c2e7073fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.372577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10728e62-ea28-4276-b00d-37c2e7073fff None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.373051 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10728e62-ea28-4276-b00d-37c2e7073fff None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.373514 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10728e62-ea28-4276-b00d-37c2e7073fff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.391495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee787cc3-c5a3-436d-b1b9-fd0156f4443d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.408553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.431092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bb36a-9ed1-4bea-ad3d-91ec42f2656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.431911 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bb36a-9ed1-4bea-ad3d-91ec42f2656e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.432200 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bb36a-9ed1-4bea-ad3d-91ec42f2656e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.432471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bb36a-9ed1-4bea-ad3d-91ec42f2656e None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.434273 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58bb36a-9ed1-4bea-ad3d-91ec42f2656e None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.435468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58bb36a-9ed1-4bea-ad3d-91ec42f2656e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.437271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 49/92] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:12.438173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bb36a-9ed1-4bea-ad3d-91ec42f2656e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.453005 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10728e62-ea28-4276-b00d-37c2e7073fff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.455046 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10728e62-ea28-4276-b00d-37c2e7073fff None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.551592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bb36a-9ed1-4bea-ad3d-91ec42f2656e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.560484 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.575224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 44/93] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:12.576489 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10728e62-ea28-4276-b00d-37c2e7073fff None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.600624 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa51a8-6800-440c-a998-95316885b1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.601253 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa51a8-6800-440c-a998-95316885b1eb None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.601531 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa51a8-6800-440c-a998-95316885b1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.601805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa51a8-6800-440c-a998-95316885b1eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.602665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa51a8-6800-440c-a998-95316885b1eb None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=1221b9ee938248cf926034ec51adb9cf, user.id=e54946c04b664d3c9e1fcc1a14c448bd) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:12.602982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa51a8-6800-440c-a998-95316885b1eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.605238 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa51a8-6800-440c-a998-95316885b1eb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.612473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 50/94] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/role_assignments?user.id=e54946c04b664d3c9e1fcc1a14c448bd&scope.project.id=1221b9ee938248cf926034ec51adb9cf&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:12.613623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa51a8-6800-440c-a998-95316885b1eb None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.659512 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.743583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa51a8-6800-440c-a998-95316885b1eb None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.745942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10728e62-ea28-4276-b00d-37c2e7073fff None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.785336 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989deea-8a00-40ff-bb99-29a4c5c9b9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.786120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989deea-8a00-40ff-bb99-29a4c5c9b9ed None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.786404 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989deea-8a00-40ff-bb99-29a4c5c9b9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.786681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989deea-8a00-40ff-bb99-29a4c5c9b9ed None admin] PATH_INFO: `/v3/projects/d80112390a1e4506bf43d4240b12d592` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.787860 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989deea-8a00-40ff-bb99-29a4c5c9b9ed None admin] RBAC: Authorizing `identity:get_project(project_id=d80112390a1e4506bf43d4240b12d592)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.789517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989deea-8a00-40ff-bb99-29a4c5c9b9ed None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.791815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 51/95] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/projects/d80112390a1e4506bf43d4240b12d592 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:12.798064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989deea-8a00-40ff-bb99-29a4c5c9b9ed None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.852214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.857216 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963484b-8d9d-4a41-bb06-9cd06ba9024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.857857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963484b-8d9d-4a41-bb06-9cd06ba9024a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.858142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963484b-8d9d-4a41-bb06-9cd06ba9024a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.858416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963484b-8d9d-4a41-bb06-9cd06ba9024a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.859174 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963484b-8d9d-4a41-bb06-9cd06ba9024a None admin] RBAC: Adding query filter params (role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1, scope.project.id=1221b9ee938248cf926034ec51adb9cf, user.id=09d7ab687f544d1faaad37cdef56ae55) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:12.859485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963484b-8d9d-4a41-bb06-9cd06ba9024a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.861015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963484b-8d9d-4a41-bb06-9cd06ba9024a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.881484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 45/96] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/role_assignments?user.id=09d7ab687f544d1faaad37cdef56ae55&scope.project.id=1221b9ee938248cf926034ec51adb9cf&role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:12.925651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989deea-8a00-40ff-bb99-29a4c5c9b9ed None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.996605 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464456a-4327-4f55-8f25-b697f726690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.997617 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464456a-4327-4f55-8f25-b697f726690e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.998123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464456a-4327-4f55-8f25-b697f726690e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.998595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464456a-4327-4f55-8f25-b697f726690e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.999550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464456a-4327-4f55-8f25-b697f726690e None admin] RBAC: Adding query filter params (role.id=8615852d81aa46c39661d01a0372d8e8, scope.project.id=d80112390a1e4506bf43d4240b12d592, user.id=09d7ab687f544d1faaad37cdef56ae55) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:13.000081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464456a-4327-4f55-8f25-b697f726690e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.001775 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464456a-4327-4f55-8f25-b697f726690e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.008584 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 52/97] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/role_assignments?user.id=09d7ab687f544d1faaad37cdef56ae55&scope.project.id=d80112390a1e4506bf43d4240b12d592&role.id=8615852d81aa46c39661d01a0372d8e8 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:13.732421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b089d5c-59d4-47f3-bcd2-b2656000c146 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.732809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b089d5c-59d4-47f3-bcd2-b2656000c146 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.732984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b089d5c-59d4-47f3-bcd2-b2656000c146 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.734376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 46/98] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:13.739973 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c06191-76d5-4199-8c22-4a6cc90c33d3 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.740272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c06191-76d5-4199-8c22-4a6cc90c33d3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.740554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c06191-76d5-4199-8c22-4a6cc90c33d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.768740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-16c06191-76d5-4199-8c22-4a6cc90c33d3 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:13.769991 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-16c06191-76d5-4199-8c22-4a6cc90c33d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:13.847153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 53/99] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:14.281921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e286e0c-be3f-437e-bb0b-3192be751981 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.282493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e286e0c-be3f-437e-bb0b-3192be751981 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.282493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e286e0c-be3f-437e-bb0b-3192be751981 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.283891 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 47/100] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:14.289178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b24039-1c49-4f8a-bbff-a9daa7ea20d2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.289582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b24039-1c49-4f8a-bbff-a9daa7ea20d2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.289742 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b24039-1c49-4f8a-bbff-a9daa7ea20d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.296749 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e286e0c-be3f-437e-bb0b-3192be751981 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:14.314564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f9b24039-1c49-4f8a-bbff-a9daa7ea20d2 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:14.315810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f9b24039-1c49-4f8a-bbff-a9daa7ea20d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:14.362404 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:14.439768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 54/101] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:14.490216 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e286e0c-be3f-437e-bb0b-3192be751981 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:14.528894 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:14.540356 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8cb58-9d2a-4ea9-a879-9fdc7061761d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:14.541005 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8cb58-9d2a-4ea9-a879-9fdc7061761d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.541327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8cb58-9d2a-4ea9-a879-9fdc7061761d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.541609 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8cb58-9d2a-4ea9-a879-9fdc7061761d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.555250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8cb58-9d2a-4ea9-a879-9fdc7061761d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-09c8cb58-9d2a-4ea9-a879-9fdc7061761d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:14.560539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:14.561393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:14.562172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:14.562172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:14.562172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:14.562172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:14.562172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:14.562172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:14.562172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:14.562172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:14.562172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:14.562172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:14.562172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:14.562172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:14.562172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 48/102] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:14.568750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b24039-1c49-4f8a-bbff-a9daa7ea20d2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:14.713324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b24039-1c49-4f8a-bbff-a9daa7ea20d2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:14.765000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fabcf-250e-4c1b-abd6-51169ce40b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:14.765629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fabcf-250e-4c1b-abd6-51169ce40b0e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.765913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fabcf-250e-4c1b-abd6-51169ce40b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.766192 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fabcf-250e-4c1b-abd6-51169ce40b0e None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.766876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fabcf-250e-4c1b-abd6-51169ce40b0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:14.767181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fabcf-250e-4c1b-abd6-51169ce40b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:14.768686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fabcf-250e-4c1b-abd6-51169ce40b0e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:14.783615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 55/103] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:14.789043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8cb58-9d2a-4ea9-a879-9fdc7061761d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:14.895594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fabcf-250e-4c1b-abd6-51169ce40b0e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:14.938072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:15.055569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fabcf-250e-4c1b-abd6-51169ce40b0e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:15.063162 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8cb58-9d2a-4ea9-a879-9fdc7061761d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:15.107558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f781f2-ec65-478e-957a-ca13c7676b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:15.108252 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f781f2-ec65-478e-957a-ca13c7676b0f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.108531 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f781f2-ec65-478e-957a-ca13c7676b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.108808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f781f2-ec65-478e-957a-ca13c7676b0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.109965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f781f2-ec65-478e-957a-ca13c7676b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:15.110143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b6ba1-f72e-4a4f-9fad-a4b3fb45b39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:15.110942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b6ba1-f72e-4a4f-9fad-a4b3fb45b39c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.111376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b6ba1-f72e-4a4f-9fad-a4b3fb45b39c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.111479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f781f2-ec65-478e-957a-ca13c7676b0f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:15.111900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b6ba1-f72e-4a4f-9fad-a4b3fb45b39c None admin] PATH_INFO: `/v3/users/f237ad35ec3b4cddb722644233b37aaf` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.113295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 56/104] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:15.117981 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545346-5877-4fa1-8852-a0fc0e4638b8 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.117981 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545346-5877-4fa1-8852-a0fc0e4638b8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.117981 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f545346-5877-4fa1-8852-a0fc0e4638b8 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.124663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 57/105] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:15.125317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f545346-5877-4fa1-8852-a0fc0e4638b8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:15.131398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b6ba1-f72e-4a4f-9fad-a4b3fb45b39c None admin] RBAC: Authorizing `identity:get_user(user_id=f237ad35ec3b4cddb722644233b37aaf)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:15.133109 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b6ba1-f72e-4a4f-9fad-a4b3fb45b39c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:15.135072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 49/106] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:14 2022] GET /identity/v3/users/f237ad35ec3b4cddb722644233b37aaf => generated 289 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:15.136499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077e256-d21f-46d4-b792-fb2466a70ceb None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.136922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077e256-d21f-46d4-b792-fb2466a70ceb None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.137357 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077e256-d21f-46d4-b792-fb2466a70ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.164809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e077e256-d21f-46d4-b792-fb2466a70ceb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:15.166476 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e077e256-d21f-46d4-b792-fb2466a70ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:15.245496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:15.297280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 50/107] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:15.298309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077e256-d21f-46d4-b792-fb2466a70ceb None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:15.322898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:15.339729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f545346-5877-4fa1-8852-a0fc0e4638b8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:15.390550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5f34f-8b68-4390-8dad-3aeab58fe17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:15.391251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5f34f-8b68-4390-8dad-3aeab58fe17f None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.391537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5f34f-8b68-4390-8dad-3aeab58fe17f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.391838 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5f34f-8b68-4390-8dad-3aeab58fe17f None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.392491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5f34f-8b68-4390-8dad-3aeab58fe17f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:15.393948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5f34f-8b68-4390-8dad-3aeab58fe17f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:15.436298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077e256-d21f-46d4-b792-fb2466a70ceb None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:15.440561 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 58/108] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 31 00:07:15 2022] POST /identity/v3/projects => generated 302 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:15.447890 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dc250-daf0-4034-a39f-081b9ee23f85 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.448211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dc250-daf0-4034-a39f-081b9ee23f85 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.448543 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dc250-daf0-4034-a39f-081b9ee23f85 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.450340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 59/109] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:15.455766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05135c37-2491-49c1-a334-8dc946bf3171 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.456079 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05135c37-2491-49c1-a334-8dc946bf3171 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.456329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05135c37-2491-49c1-a334-8dc946bf3171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.476084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce8d55-cc2c-4586-99ee-175a700602a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:15.477104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce8d55-cc2c-4586-99ee-175a700602a6 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.477678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce8d55-cc2c-4586-99ee-175a700602a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.478140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce8d55-cc2c-4586-99ee-175a700602a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.486500 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-05135c37-2491-49c1-a334-8dc946bf3171 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:15.487896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-05135c37-2491-49c1-a334-8dc946bf3171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:15.530773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:15.559039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce8d55-cc2c-4586-99ee-175a700602a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:15.560989 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce8d55-cc2c-4586-99ee-175a700602a6 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:15.610364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 60/110] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:15.620184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131cb35-212b-4634-9696-1149263d4a00 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.620380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131cb35-212b-4634-9696-1149263d4a00 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.620636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131cb35-212b-4634-9696-1149263d4a00 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.622171 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 61/111] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:15.637578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d489b37-438b-4a82-aa57-89caa8119d39 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.637886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d489b37-438b-4a82-aa57-89caa8119d39 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.638143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d489b37-438b-4a82-aa57-89caa8119d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.676061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 51/112] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:15.683720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2d489b37-438b-4a82-aa57-89caa8119d39 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:15.683720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2d489b37-438b-4a82-aa57-89caa8119d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:15.685096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce8d55-cc2c-4586-99ee-175a700602a6 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:15.769070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 62/113] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:15.770205 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d489b37-438b-4a82-aa57-89caa8119d39 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:15.784110 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:15.817812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:15.849156 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce8d55-cc2c-4586-99ee-175a700602a6 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:15.890672 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8197c8-de30-4e1f-bf4c-112fa9d8a8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:15.891306 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8197c8-de30-4e1f-bf4c-112fa9d8a8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.891587 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8197c8-de30-4e1f-bf4c-112fa9d8a8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.891931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8197c8-de30-4e1f-bf4c-112fa9d8a8a6 None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.893436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8197c8-de30-4e1f-bf4c-112fa9d8a8a6 None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:15.895111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8197c8-de30-4e1f-bf4c-112fa9d8a8a6 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:15.898411 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 52/114] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:15 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:15.905125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8197c8-de30-4e1f-bf4c-112fa9d8a8a6 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.038009 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d489b37-438b-4a82-aa57-89caa8119d39 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.042735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8197c8-de30-4e1f-bf4c-112fa9d8a8a6 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.083424 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9bd1d-e548-48dd-90f9-0b60d617a129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.084078 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9bd1d-e548-48dd-90f9-0b60d617a129 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.084366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9bd1d-e548-48dd-90f9-0b60d617a129 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.084770 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9bd1d-e548-48dd-90f9-0b60d617a129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.085524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9bd1d-e548-48dd-90f9-0b60d617a129 None admin] RBAC: Adding query filter params (role.id=f23c33107fdc4e839449e5bdf255e364, scope.project.id=1221b9ee938248cf926034ec51adb9cf, user.id=f237ad35ec3b4cddb722644233b37aaf) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:16.085835 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9bd1d-e548-48dd-90f9-0b60d617a129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.087323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9bd1d-e548-48dd-90f9-0b60d617a129 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.093778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 53/115] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:15 2022] GET /identity/v3/role_assignments?user.id=f237ad35ec3b4cddb722644233b37aaf&scope.project.id=1221b9ee938248cf926034ec51adb9cf&role.id=f23c33107fdc4e839449e5bdf255e364 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:16.094421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9bd1d-e548-48dd-90f9-0b60d617a129 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.107028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.173097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c672-77a0-40a5-b2ed-ebd61c98d316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.173772 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c672-77a0-40a5-b2ed-ebd61c98d316 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.174058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c672-77a0-40a5-b2ed-ebd61c98d316 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.174338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c672-77a0-40a5-b2ed-ebd61c98d316 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.207663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66c672-77a0-40a5-b2ed-ebd61c98d316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:16.211519 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9bd1d-e548-48dd-90f9-0b60d617a129 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-6d66c672-77a0-40a5-b2ed-ebd61c98d316 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:16.220835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:16.221796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:16.222562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:16.222562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:16.222562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:16.222562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:16.222562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:16.222562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:16.222562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:16.222562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:16.222562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:16.222562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:16.222562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:16.222562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:16.222562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 63/116] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 453 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:16.223777 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c672-77a0-40a5-b2ed-ebd61c98d316 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.257242 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c86795-70d1-4c19-89af-70c66372417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.257913 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c86795-70d1-4c19-89af-70c66372417a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.258196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c86795-70d1-4c19-89af-70c66372417a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.258473 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c86795-70d1-4c19-89af-70c66372417a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.270698 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c86795-70d1-4c19-89af-70c66372417a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-06c86795-70d1-4c19-89af-70c66372417a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:16.276345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:16.277207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:16.277985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:16.277985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:16.277985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:16.277985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:16.277985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:16.277985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:16.277985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:16.277985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:16.277985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:16.277985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:16.277985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:16.277985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:16.277985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 54/117] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:16.279345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c86795-70d1-4c19-89af-70c66372417a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.357227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.367585 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.412437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c86795-70d1-4c19-89af-70c66372417a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.418630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c672-77a0-40a5-b2ed-ebd61c98d316 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.455079 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdca2f-1f2d-4361-97d6-31e23123ec7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.456077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdca2f-1f2d-4361-97d6-31e23123ec7e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.456458 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdca2f-1f2d-4361-97d6-31e23123ec7e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.456775 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe39eb-c4c8-47e5-9874-5a64506aa819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.456897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdca2f-1f2d-4361-97d6-31e23123ec7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.457640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe39eb-c4c8-47e5-9874-5a64506aa819 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.458216 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe39eb-c4c8-47e5-9874-5a64506aa819 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.458624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe39eb-c4c8-47e5-9874-5a64506aa819 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.459713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe39eb-c4c8-47e5-9874-5a64506aa819 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:16.460152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe39eb-c4c8-47e5-9874-5a64506aa819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.462122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe39eb-c4c8-47e5-9874-5a64506aa819 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.469134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdca2f-1f2d-4361-97d6-31e23123ec7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:16.473861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 55/118] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-fccdca2f-1f2d-4361-97d6-31e23123ec7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:16.474112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:16.475179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:16.476196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:16.476196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:16.476196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:16.476196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:16.476196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:16.476196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:16.476196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:16.476196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:16.476196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:16.476196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:16.476196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:16.476196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:16.477767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe39eb-c4c8-47e5-9874-5a64506aa819 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.478223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 64/119] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:16.482967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f9a9-309b-465a-8746-047906d933d3 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.482967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f9a9-309b-465a-8746-047906d933d3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.482967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741f9a9-309b-465a-8746-047906d933d3 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.482967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 65/120] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:16.482967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741f9a9-309b-465a-8746-047906d933d3 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.604279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741f9a9-309b-465a-8746-047906d933d3 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.609863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe39eb-c4c8-47e5-9874-5a64506aa819 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.629950 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.642559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f897b4-42b0-49c0-ba92-b4e62489aa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.643403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f897b4-42b0-49c0-ba92-b4e62489aa3f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.643825 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f897b4-42b0-49c0-ba92-b4e62489aa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.644203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f897b4-42b0-49c0-ba92-b4e62489aa3f None admin] PATH_INFO: `/v3/users/e54946c04b664d3c9e1fcc1a14c448bd` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.645617 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f897b4-42b0-49c0-ba92-b4e62489aa3f None admin] RBAC: Authorizing `identity:get_user(user_id=e54946c04b664d3c9e1fcc1a14c448bd)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.647178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f897b4-42b0-49c0-ba92-b4e62489aa3f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.648920 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 66/121] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/users/e54946c04b664d3c9e1fcc1a14c448bd => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:16.649769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f897b4-42b0-49c0-ba92-b4e62489aa3f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.650589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.659234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e88f27-1aa7-4fd7-87c2-c0d3d88258d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.660822 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e88f27-1aa7-4fd7-87c2-c0d3d88258d7 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.661318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e88f27-1aa7-4fd7-87c2-c0d3d88258d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.661800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e88f27-1aa7-4fd7-87c2-c0d3d88258d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.662751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e88f27-1aa7-4fd7-87c2-c0d3d88258d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:16.663223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e88f27-1aa7-4fd7-87c2-c0d3d88258d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.666582 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e88f27-1aa7-4fd7-87c2-c0d3d88258d7 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.678932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 56/122] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:16.680608 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e4ae-3a16-4319-8130-7493a3aa79e7 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.681092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e4ae-3a16-4319-8130-7493a3aa79e7 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.681559 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e4ae-3a16-4319-8130-7493a3aa79e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.705308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-6b38e4ae-3a16-4319-8130-7493a3aa79e7 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:16.707304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6b38e4ae-3a16-4319-8130-7493a3aa79e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:16.768227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f897b4-42b0-49c0-ba92-b4e62489aa3f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.792707 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 57/123] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:16.794265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38e4ae-3a16-4319-8130-7493a3aa79e7 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.806881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9dbfa-a184-43ab-a950-9d73277374d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.807497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9dbfa-a184-43ab-a950-9d73277374d4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.808180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9dbfa-a184-43ab-a950-9d73277374d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.808528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9dbfa-a184-43ab-a950-9d73277374d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.809434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9dbfa-a184-43ab-a950-9d73277374d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:16.809583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9dbfa-a184-43ab-a950-9d73277374d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.811104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9dbfa-a184-43ab-a950-9d73277374d4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.820181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 67/124] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:16.825281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9dbfa-a184-43ab-a950-9d73277374d4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.889763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.911730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38e4ae-3a16-4319-8130-7493a3aa79e7 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.937994 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.941951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9dbfa-a184-43ab-a950-9d73277374d4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.951747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf03cd7-630c-4295-a06f-2da7042accda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.952592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf03cd7-630c-4295-a06f-2da7042accda None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.953060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf03cd7-630c-4295-a06f-2da7042accda None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.953496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf03cd7-630c-4295-a06f-2da7042accda None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.954740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf03cd7-630c-4295-a06f-2da7042accda None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.956335 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf03cd7-630c-4295-a06f-2da7042accda None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.958352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 58/125] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:16.959127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf03cd7-630c-4295-a06f-2da7042accda None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.979074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bed526-0353-4e88-a458-0b8b3b3e4a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.980075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bed526-0353-4e88-a458-0b8b3b3e4a11 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.980525 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bed526-0353-4e88-a458-0b8b3b3e4a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.980962 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bed526-0353-4e88-a458-0b8b3b3e4a11 None admin] PATH_INFO: `/v3/users/09d7ab687f544d1faaad37cdef56ae55` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.982240 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bed526-0353-4e88-a458-0b8b3b3e4a11 None admin] RBAC: Authorizing `identity:get_user(user_id=09d7ab687f544d1faaad37cdef56ae55)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.983903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bed526-0353-4e88-a458-0b8b3b3e4a11 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.986021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 68/126] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/users/09d7ab687f544d1faaad37cdef56ae55 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:16.987006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bed526-0353-4e88-a458-0b8b3b3e4a11 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.069330 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf03cd7-630c-4295-a06f-2da7042accda None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.089533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bed526-0353-4e88-a458-0b8b3b3e4a11 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.109315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f930f4c-dfe4-4277-a6a4-5930e6cd0b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.110019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f930f4c-dfe4-4277-a6a4-5930e6cd0b6c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.110310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f930f4c-dfe4-4277-a6a4-5930e6cd0b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.110583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f930f4c-dfe4-4277-a6a4-5930e6cd0b6c None admin] PATH_INFO: `/v3/users/09d7ab687f544d1faaad37cdef56ae55` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.114156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:17.116390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f930f4c-dfe4-4277-a6a4-5930e6cd0b6c None admin] RBAC: Authorizing `identity:get_user(user_id=09d7ab687f544d1faaad37cdef56ae55)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.118083 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f930f4c-dfe4-4277-a6a4-5930e6cd0b6c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.119918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 59/127] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/users/09d7ab687f544d1faaad37cdef56ae55 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:17.120529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f930f4c-dfe4-4277-a6a4-5930e6cd0b6c None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.133592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324f77e-5f84-4bc5-b80e-e98ef456fd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.134593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324f77e-5f84-4bc5-b80e-e98ef456fd57 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.135146 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324f77e-5f84-4bc5-b80e-e98ef456fd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.135612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324f77e-5f84-4bc5-b80e-e98ef456fd57 None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf/users/e54946c04b664d3c9e1fcc1a14c448bd/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.137773 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324f77e-5f84-4bc5-b80e-e98ef456fd57 None admin] RBAC: Authorizing `identity:create_grant(project_id=1221b9ee938248cf926034ec51adb9cf, user_id=e54946c04b664d3c9e1fcc1a14c448bd, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.144387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324f77e-5f84-4bc5-b80e-e98ef456fd57 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.172816 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 69/128] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:16 2022] PUT /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf/users/e54946c04b664d3c9e1fcc1a14c448bd/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:17.174856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324f77e-5f84-4bc5-b80e-e98ef456fd57 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.222948 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:17.279672 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f930f4c-dfe4-4277-a6a4-5930e6cd0b6c None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.343880 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324f77e-5f84-4bc5-b80e-e98ef456fd57 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.358794 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd12236-eedf-4b57-aa6c-963a39f7519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.359457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd12236-eedf-4b57-aa6c-963a39f7519f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.359757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd12236-eedf-4b57-aa6c-963a39f7519f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.360038 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd12236-eedf-4b57-aa6c-963a39f7519f None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.361237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd12236-eedf-4b57-aa6c-963a39f7519f None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.362773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd12236-eedf-4b57-aa6c-963a39f7519f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.364937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 60/129] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:17 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:17.365777 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd12236-eedf-4b57-aa6c-963a39f7519f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.408761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058c667-b6f2-49cd-811c-d03de7d73591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.409407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058c667-b6f2-49cd-811c-d03de7d73591 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.409692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058c667-b6f2-49cd-811c-d03de7d73591 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.409973 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058c667-b6f2-49cd-811c-d03de7d73591 None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.411170 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058c667-b6f2-49cd-811c-d03de7d73591 None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.412721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058c667-b6f2-49cd-811c-d03de7d73591 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.415743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 70/130] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:17 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:17.416496 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058c667-b6f2-49cd-811c-d03de7d73591 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.483338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:17.515009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd12236-eedf-4b57-aa6c-963a39f7519f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.561790 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:17.572400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058c667-b6f2-49cd-811c-d03de7d73591 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.583899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cfb91-20cf-4860-9a02-0386914c5c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.584549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cfb91-20cf-4860-9a02-0386914c5c53 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.584825 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cfb91-20cf-4860-9a02-0386914c5c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.585095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cfb91-20cf-4860-9a02-0386914c5c53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.603630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cfb91-20cf-4860-9a02-0386914c5c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-bb6cfb91-20cf-4860-9a02-0386914c5c53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:17.610980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:17.611904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:17.612691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:17.612691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:17.612691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:17.612691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:17.612691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:17.612691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:17.612691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:17.612691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:17.612691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:17.612691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:17.612691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:17.612691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:17.612691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 61/131] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:17.613805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cfb91-20cf-4860-9a02-0386914c5c53 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.639535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a49c5c-eeb0-4c51-ba91-ea8b30a60f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.640248 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a49c5c-eeb0-4c51-ba91-ea8b30a60f55 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.640532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a49c5c-eeb0-4c51-ba91-ea8b30a60f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.640809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a49c5c-eeb0-4c51-ba91-ea8b30a60f55 None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf/users/09d7ab687f544d1faaad37cdef56ae55/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.645696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a49c5c-eeb0-4c51-ba91-ea8b30a60f55 None admin] RBAC: Authorizing `identity:create_grant(project_id=1221b9ee938248cf926034ec51adb9cf, user_id=09d7ab687f544d1faaad37cdef56ae55, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.647407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a49c5c-eeb0-4c51-ba91-ea8b30a60f55 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.672791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 71/132] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:17 2022] PUT /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf/users/09d7ab687f544d1faaad37cdef56ae55/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:17.673895 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a49c5c-eeb0-4c51-ba91-ea8b30a60f55 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.820720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cfb91-20cf-4860-9a02-0386914c5c53 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.868308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a49c5c-eeb0-4c51-ba91-ea8b30a60f55 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.876306 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e80ac-5fc8-46bb-838f-5bb121ae53be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.877040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e80ac-5fc8-46bb-838f-5bb121ae53be None admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.877321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e80ac-5fc8-46bb-838f-5bb121ae53be None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.877603 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e80ac-5fc8-46bb-838f-5bb121ae53be None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf/users/09d7ab687f544d1faaad37cdef56ae55/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.880844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e80ac-5fc8-46bb-838f-5bb121ae53be None admin] RBAC: Authorizing `identity:create_grant(project_id=1221b9ee938248cf926034ec51adb9cf, user_id=09d7ab687f544d1faaad37cdef56ae55, role_id=f9b0f326bcf6425d9e2aa62dc35ddbc1)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.883653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:17.884713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e80ac-5fc8-46bb-838f-5bb121ae53be None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.910598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 62/133] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:17 2022] PUT /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf/users/09d7ab687f544d1faaad37cdef56ae55/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:17.912047 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e406d-10cf-40e2-83de-b7a5c4ab1265 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.912329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e406d-10cf-40e2-83de-b7a5c4ab1265 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.912648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e406d-10cf-40e2-83de-b7a5c4ab1265 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.914264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 63/134] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:17.925381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaae39-369a-4d01-836a-abc82d0d2ded None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.925869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaae39-369a-4d01-836a-abc82d0d2ded None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.926366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaae39-369a-4d01-836a-abc82d0d2ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.941226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b71039-87e8-4e6b-9aea-9d56f1cf2a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.941936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71039-87e8-4e6b-9aea-9d56f1cf2a75 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.942274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71039-87e8-4e6b-9aea-9d56f1cf2a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.942557 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b71039-87e8-4e6b-9aea-9d56f1cf2a75 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.943252 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b71039-87e8-4e6b-9aea-9d56f1cf2a75 None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:17.943561 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b71039-87e8-4e6b-9aea-9d56f1cf2a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.948071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b71039-87e8-4e6b-9aea-9d56f1cf2a75 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.966589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-a5aaae39-369a-4d01-836a-abc82d0d2ded None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:17.967844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a5aaae39-369a-4d01-836a-abc82d0d2ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:17.969515 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 72/135] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:17.975762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b71039-87e8-4e6b-9aea-9d56f1cf2a75 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:18.069240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:18.119560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 64/136] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:18.121615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b71039-87e8-4e6b-9aea-9d56f1cf2a75 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:18.163734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13e5c2-444b-4ad9-98bb-4eb98c5d340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:18.163734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13e5c2-444b-4ad9-98bb-4eb98c5d340d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.163734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13e5c2-444b-4ad9-98bb-4eb98c5d340d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.163734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13e5c2-444b-4ad9-98bb-4eb98c5d340d None admin] PATH_INFO: `/v3/users/09d7ab687f544d1faaad37cdef56ae55` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.164802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13e5c2-444b-4ad9-98bb-4eb98c5d340d None admin] RBAC: Authorizing `identity:get_user(user_id=09d7ab687f544d1faaad37cdef56ae55)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:18.166328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13e5c2-444b-4ad9-98bb-4eb98c5d340d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:18.169734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 73/137] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:17 2022] GET /identity/v3/users/09d7ab687f544d1faaad37cdef56ae55 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:18.176866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaae39-369a-4d01-836a-abc82d0d2ded None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:18.340757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaae39-369a-4d01-836a-abc82d0d2ded None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:18.389856 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a3cd2-0a4b-42ee-a4ee-25d1102fe0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:18.390427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3cd2-0a4b-42ee-a4ee-25d1102fe0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.390708 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3cd2-0a4b-42ee-a4ee-25d1102fe0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.390986 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3cd2-0a4b-42ee-a4ee-25d1102fe0b4 None admin] PATH_INFO: `/v3/projects/d80112390a1e4506bf43d4240b12d592` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.392169 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a3cd2-0a4b-42ee-a4ee-25d1102fe0b4 None admin] RBAC: Authorizing `identity:get_project(project_id=d80112390a1e4506bf43d4240b12d592)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:18.393641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a3cd2-0a4b-42ee-a4ee-25d1102fe0b4 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:18.395500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 65/138] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:18 2022] GET /identity/v3/projects/d80112390a1e4506bf43d4240b12d592 => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:18.401189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13e5c2-444b-4ad9-98bb-4eb98c5d340d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:18.464079 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:18.490552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a3cd2-0a4b-42ee-a4ee-25d1102fe0b4 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:18.550798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13e5c2-444b-4ad9-98bb-4eb98c5d340d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:18.609752 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:18.616451 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f5988-37d5-416f-88b1-cbd8af4a3a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:18.617158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f5988-37d5-416f-88b1-cbd8af4a3a22 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.617447 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f5988-37d5-416f-88b1-cbd8af4a3a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.617726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f5988-37d5-416f-88b1-cbd8af4a3a22 None admin] PATH_INFO: `/v3/projects/d80112390a1e4506bf43d4240b12d592/users/09d7ab687f544d1faaad37cdef56ae55/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.619829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f5988-37d5-416f-88b1-cbd8af4a3a22 None admin] RBAC: Authorizing `identity:create_grant(project_id=d80112390a1e4506bf43d4240b12d592, user_id=09d7ab687f544d1faaad37cdef56ae55, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:18.621323 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f5988-37d5-416f-88b1-cbd8af4a3a22 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:18.640016 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 74/139] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:18 2022] PUT /identity/v3/projects/d80112390a1e4506bf43d4240b12d592/users/09d7ab687f544d1faaad37cdef56ae55/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:18.712969 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a3cd2-0a4b-42ee-a4ee-25d1102fe0b4 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:18.763340 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99813e-b4d2-4fc2-93c7-f09e05f44d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:18.764071 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99813e-b4d2-4fc2-93c7-f09e05f44d34 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.764360 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99813e-b4d2-4fc2-93c7-f09e05f44d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.764643 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99813e-b4d2-4fc2-93c7-f09e05f44d34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.768581 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99813e-b4d2-4fc2-93c7-f09e05f44d34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:18.770099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99813e-b4d2-4fc2-93c7-f09e05f44d34 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:18.772023 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 66/140] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:18.777889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f5988-37d5-416f-88b1-cbd8af4a3a22 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:18.823925 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef6833-ec07-4f92-8486-2e60d8366ab8 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.824226 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef6833-ec07-4f92-8486-2e60d8366ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.824536 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef6833-ec07-4f92-8486-2e60d8366ab8 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.826038 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 67/141] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:18.838054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b18179-1497-456b-97f4-2aa943779e8b None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.838419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b18179-1497-456b-97f4-2aa943779e8b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.838665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b18179-1497-456b-97f4-2aa943779e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.870940 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-b7b18179-1497-456b-97f4-2aa943779e8b None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:18.872262 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b7b18179-1497-456b-97f4-2aa943779e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:18.959088 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:18.964738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f5988-37d5-416f-88b1-cbd8af4a3a22 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.004534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14b6dd-eaab-4e45-ab0a-b4fe96e209ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.005764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b6dd-eaab-4e45-ab0a-b4fe96e209ee None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.006302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b6dd-eaab-4e45-ab0a-b4fe96e209ee None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.006762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b6dd-eaab-4e45-ab0a-b4fe96e209ee None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.007663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14b6dd-eaab-4e45-ab0a-b4fe96e209ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.009723 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14b6dd-eaab-4e45-ab0a-b4fe96e209ee None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.022365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 68/142] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 00:07:19.037063 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 75/143] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:18 2022] POST /identity/v3/users => generated 283 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:19.501252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b18179-1497-456b-97f4-2aa943779e8b None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.554761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:19.622955 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b18179-1497-456b-97f4-2aa943779e8b None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.662369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc7fe1-db1e-42bb-8b2b-ef0a973599ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.663180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc7fe1-db1e-42bb-8b2b-ef0a973599ee None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.663368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc7fe1-db1e-42bb-8b2b-ef0a973599ee None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.663644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc7fe1-db1e-42bb-8b2b-ef0a973599ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.674698 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc7fe1-db1e-42bb-8b2b-ef0a973599ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-08bc7fe1-db1e-42bb-8b2b-ef0a973599ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:19.679664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:19.680596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:19.681371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:19.681371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:19.681371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:19.681371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:19.681371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:19.681371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:19.681371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:19.681371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:19.681371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:19.681371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:19.681371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:19.681371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:19.683449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 69/144] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:19.689400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14b6dd-eaab-4e45-ab0a-b4fe96e209ee None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.833617 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14b6dd-eaab-4e45-ab0a-b4fe96e209ee None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.845270 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96405233-2707-4477-a342-ced74bfd64e9 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.845645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96405233-2707-4477-a342-ced74bfd64e9 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.845841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96405233-2707-4477-a342-ced74bfd64e9 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.847213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 70/145] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:19.854475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9444aa-227a-4cd3-bb8d-eebb45753671 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.854869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9444aa-227a-4cd3-bb8d-eebb45753671 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.855050 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9444aa-227a-4cd3-bb8d-eebb45753671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.876727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4539f09-62a5-4fe2-ab67-38bf753bf56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.877839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4539f09-62a5-4fe2-ab67-38bf753bf56d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.878309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4539f09-62a5-4fe2-ab67-38bf753bf56d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.878765 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4539f09-62a5-4fe2-ab67-38bf753bf56d None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.879641 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4539f09-62a5-4fe2-ab67-38bf753bf56d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:19.880167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4539f09-62a5-4fe2-ab67-38bf753bf56d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.881736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4539f09-62a5-4fe2-ab67-38bf753bf56d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.885254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7d9444aa-227a-4cd3-bb8d-eebb45753671 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:19.885254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7d9444aa-227a-4cd3-bb8d-eebb45753671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:19.894184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 76/146] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:19.922311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4539f09-62a5-4fe2-ab67-38bf753bf56d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.958051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:19.980957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 71/147] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:20.088384 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4539f09-62a5-4fe2-ab67-38bf753bf56d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.125085 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa59357-c8ef-49ef-b85d-889e3a258e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.125733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa59357-c8ef-49ef-b85d-889e3a258e79 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.126011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa59357-c8ef-49ef-b85d-889e3a258e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.126289 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa59357-c8ef-49ef-b85d-889e3a258e79 None admin] PATH_INFO: `/v3/users/f237ad35ec3b4cddb722644233b37aaf` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.127466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa59357-c8ef-49ef-b85d-889e3a258e79 None admin] RBAC: Authorizing `identity:get_user(user_id=f237ad35ec3b4cddb722644233b37aaf)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:20.128976 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa59357-c8ef-49ef-b85d-889e3a258e79 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:20.130590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 77/148] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/users/f237ad35ec3b4cddb722644233b37aaf => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:20.136551 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9444aa-227a-4cd3-bb8d-eebb45753671 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.184054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:20.264958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9444aa-227a-4cd3-bb8d-eebb45753671 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.300476 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2f746-78b8-4016-9348-bd0e2862a1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.301119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2f746-78b8-4016-9348-bd0e2862a1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.301399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2f746-78b8-4016-9348-bd0e2862a1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.301675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2f746-78b8-4016-9348-bd0e2862a1d5 None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.302808 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2f746-78b8-4016-9348-bd0e2862a1d5 None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:20.304327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2f746-78b8-4016-9348-bd0e2862a1d5 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:20.306375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 72/149] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:20 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:20.312774 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa59357-c8ef-49ef-b85d-889e3a258e79 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.350714 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2f746-78b8-4016-9348-bd0e2862a1d5 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.450677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:20.453503 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:20.457207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2f746-78b8-4016-9348-bd0e2862a1d5 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.487479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa59357-c8ef-49ef-b85d-889e3a258e79 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.494475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee4191-4468-4150-9178-9fcd58d1ce6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.495189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4191-4468-4150-9178-9fcd58d1ce6d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.495470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4191-4468-4150-9178-9fcd58d1ce6d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.496483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4191-4468-4150-9178-9fcd58d1ce6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.508761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee4191-4468-4150-9178-9fcd58d1ce6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-35ee4191-4468-4150-9178-9fcd58d1ce6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:20.517449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:20.518353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:20.519129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:20.519129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:20.519129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:20.519129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:20.519129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:20.519129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:20.519129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:20.519129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:20.519129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:20.519129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:20.519129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:20.519129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:20.519129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 73/150] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:20.532838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee4191-4468-4150-9178-9fcd58d1ce6d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.556440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99309b-597a-461e-b3a2-ad7e5114a7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.557316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99309b-597a-461e-b3a2-ad7e5114a7c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.557600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99309b-597a-461e-b3a2-ad7e5114a7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.557876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99309b-597a-461e-b3a2-ad7e5114a7c2 None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf/users/f237ad35ec3b4cddb722644233b37aaf/roles/f23c33107fdc4e839449e5bdf255e364` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.561792 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99309b-597a-461e-b3a2-ad7e5114a7c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1221b9ee938248cf926034ec51adb9cf, user_id=f237ad35ec3b4cddb722644233b37aaf, role_id=f23c33107fdc4e839449e5bdf255e364)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:20.563295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99309b-597a-461e-b3a2-ad7e5114a7c2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:20.592039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 78/151] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:20 2022] PUT /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf/users/f237ad35ec3b4cddb722644233b37aaf/roles/f23c33107fdc4e839449e5bdf255e364 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:20.595326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed050-4984-4beb-988e-f732f19b2ac8 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.597250 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed050-4984-4beb-988e-f732f19b2ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.597812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed050-4984-4beb-988e-f732f19b2ac8 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.599845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 79/152] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:20.642212 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7a62d-9916-4f89-a46d-9f48358418a2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.642590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7a62d-9916-4f89-a46d-9f48358418a2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.642770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7a62d-9916-4f89-a46d-9f48358418a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.678164 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ecf7a62d-9916-4f89-a46d-9f48358418a2 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:20.679422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ecf7a62d-9916-4f89-a46d-9f48358418a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:20.722511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee4191-4468-4150-9178-9fcd58d1ce6d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.765783 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f4b87-2ff9-41d8-816a-a68dffefc039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.766424 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f4b87-2ff9-41d8-816a-a68dffefc039 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.766700 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f4b87-2ff9-41d8-816a-a68dffefc039 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.766974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f4b87-2ff9-41d8-816a-a68dffefc039 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.767665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f4b87-2ff9-41d8-816a-a68dffefc039 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:20.768005 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f4b87-2ff9-41d8-816a-a68dffefc039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:20.769426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f4b87-2ff9-41d8-816a-a68dffefc039 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:20.779517 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 74/153] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:20.780749 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0623b0d-eade-4665-9a34-2d1bf0aa88f2 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.781042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0623b0d-eade-4665-9a34-2d1bf0aa88f2 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.781318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0623b0d-eade-4665-9a34-2d1bf0aa88f2 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.782624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 75/154] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:20.788354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ba589-64b4-44c5-992e-9efc6ec5a695 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.788633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ba589-64b4-44c5-992e-9efc6ec5a695 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.788916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ba589-64b4-44c5-992e-9efc6ec5a695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.810965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-9c6ba589-64b4-44c5-992e-9efc6ec5a695 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:20.812264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-9c6ba589-64b4-44c5-992e-9efc6ec5a695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:20.832127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:20.836241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 80/155] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:20.836851 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7a62d-9916-4f89-a46d-9f48358418a2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.907674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 76/156] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:20.928940 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:20.958372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7a62d-9916-4f89-a46d-9f48358418a2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:21.011400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8f2c3-a3f1-4736-8be7-3464bcfaea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:21.012392 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f2c3-a3f1-4736-8be7-3464bcfaea91 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.012835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f2c3-a3f1-4736-8be7-3464bcfaea91 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.013274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f2c3-a3f1-4736-8be7-3464bcfaea91 None admin] PATH_INFO: `/v3/users/e54946c04b664d3c9e1fcc1a14c448bd` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.015782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8f2c3-a3f1-4736-8be7-3464bcfaea91 None admin] RBAC: Authorizing `identity:get_user(user_id=e54946c04b664d3c9e1fcc1a14c448bd)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:21.017435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8f2c3-a3f1-4736-8be7-3464bcfaea91 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:21.019607 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 81/157] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:20 2022] GET /identity/v3/users/e54946c04b664d3c9e1fcc1a14c448bd => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:21.025598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ba589-64b4-44c5-992e-9efc6ec5a695 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:21.141972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ba589-64b4-44c5-992e-9efc6ec5a695 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:21.182518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c8a2b-c55f-4963-9dfe-7930c0c3a14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:21.183500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c8a2b-c55f-4963-9dfe-7930c0c3a14b None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.183809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c8a2b-c55f-4963-9dfe-7930c0c3a14b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.184084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c8a2b-c55f-4963-9dfe-7930c0c3a14b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.209359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:21.262266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c8a2b-c55f-4963-9dfe-7930c0c3a14b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:21.263840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c8a2b-c55f-4963-9dfe-7930c0c3a14b None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:21.357060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8f2c3-a3f1-4736-8be7-3464bcfaea91 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:21.388223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 77/158] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:21.399724 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c8a2b-c55f-4963-9dfe-7930c0c3a14b None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:21.497429 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:21.569195 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c8a2b-c55f-4963-9dfe-7930c0c3a14b None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:21.612231 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8f2c3-a3f1-4736-8be7-3464bcfaea91 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:21.629511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0501dc3-4b47-4852-ae60-14d36e25e317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:21.630159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0501dc3-4b47-4852-ae60-14d36e25e317 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.630462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0501dc3-4b47-4852-ae60-14d36e25e317 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.630720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0501dc3-4b47-4852-ae60-14d36e25e317 None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.631934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0501dc3-4b47-4852-ae60-14d36e25e317 None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:21.633640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0501dc3-4b47-4852-ae60-14d36e25e317 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:21.635358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 78/159] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:21 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:21.636209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0501dc3-4b47-4852-ae60-14d36e25e317 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:21.688171 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3160eba-c500-41f9-80e2-b7a7cbe31d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:21.688820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3160eba-c500-41f9-80e2-b7a7cbe31d78 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.689090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3160eba-c500-41f9-80e2-b7a7cbe31d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.690508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3160eba-c500-41f9-80e2-b7a7cbe31d78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.713666 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3160eba-c500-41f9-80e2-b7a7cbe31d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-c3160eba-c500-41f9-80e2-b7a7cbe31d78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:21.719986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:21.720896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:21.721725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:21.721725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:21.721725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:21.721725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:21.721725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:21.721725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:21.721725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:21.721725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:21.721725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:21.721725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:21.721725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:21.721725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:21.721725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 82/160] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:21.722364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3160eba-c500-41f9-80e2-b7a7cbe31d78 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:21.736421 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:21.833070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0501dc3-4b47-4852-ae60-14d36e25e317 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:21.867368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:21.898919 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22335f6c-4a78-4b5d-a979-cd9bd7dfa889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:21.899564 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22335f6c-4a78-4b5d-a979-cd9bd7dfa889 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.899871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22335f6c-4a78-4b5d-a979-cd9bd7dfa889 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.900142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22335f6c-4a78-4b5d-a979-cd9bd7dfa889 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.923354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22335f6c-4a78-4b5d-a979-cd9bd7dfa889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-22335f6c-4a78-4b5d-a979-cd9bd7dfa889 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:21.934006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:21.934985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:21.935802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:21.935802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:21.935802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:21.935802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:21.935802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:21.935802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:21.935802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:21.935802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:21.935802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:21.935802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:21.935802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:21.935802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:21.936454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 79/161] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:21.936991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22335f6c-4a78-4b5d-a979-cd9bd7dfa889 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:21.940235 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3160eba-c500-41f9-80e2-b7a7cbe31d78 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.006682 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a13754-9140-41ab-ba51-c26b4936d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.007393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a13754-9140-41ab-ba51-c26b4936d7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.007677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a13754-9140-41ab-ba51-c26b4936d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.007971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a13754-9140-41ab-ba51-c26b4936d7f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.009452 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a13754-9140-41ab-ba51-c26b4936d7f1 None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=1221b9ee938248cf926034ec51adb9cf, user.id=e54946c04b664d3c9e1fcc1a14c448bd) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:22.010700 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a13754-9140-41ab-ba51-c26b4936d7f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.014558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a13754-9140-41ab-ba51-c26b4936d7f1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.024461 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 83/162] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:21 2022] GET /identity/v3/role_assignments?user.id=e54946c04b664d3c9e1fcc1a14c448bd&scope.project.id=1221b9ee938248cf926034ec51adb9cf&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:22.025098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a13754-9140-41ab-ba51-c26b4936d7f1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.091012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22335f6c-4a78-4b5d-a979-cd9bd7dfa889 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.155773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9baffb-509d-442d-88c0-ed5aa3afd951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.156409 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9baffb-509d-442d-88c0-ed5aa3afd951 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.156694 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9baffb-509d-442d-88c0-ed5aa3afd951 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.156969 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9baffb-509d-442d-88c0-ed5aa3afd951 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.157662 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9baffb-509d-442d-88c0-ed5aa3afd951 None admin] RBAC: Adding query filter params (name=member) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:22.157969 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9baffb-509d-442d-88c0-ed5aa3afd951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.159563 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9baffb-509d-442d-88c0-ed5aa3afd951 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.179502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 80/163] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:22.185452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9baffb-509d-442d-88c0-ed5aa3afd951 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.233529 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.253981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.316204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a13754-9140-41ab-ba51-c26b4936d7f1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.352425 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9baffb-509d-442d-88c0-ed5aa3afd951 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.397432 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af70061-7aad-4c5c-926b-27eb481d45b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.398071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af70061-7aad-4c5c-926b-27eb481d45b9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.398351 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af70061-7aad-4c5c-926b-27eb481d45b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.398622 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af70061-7aad-4c5c-926b-27eb481d45b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.399312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af70061-7aad-4c5c-926b-27eb481d45b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:22.399617 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af70061-7aad-4c5c-926b-27eb481d45b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.401079 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af70061-7aad-4c5c-926b-27eb481d45b9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.413804 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d45c4-c60e-42ab-bc7c-c6a59ad4490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.414594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d45c4-c60e-42ab-bc7c-c6a59ad4490a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.414874 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d45c4-c60e-42ab-bc7c-c6a59ad4490a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.415143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d45c4-c60e-42ab-bc7c-c6a59ad4490a None admin] PATH_INFO: `/v3/users/09d7ab687f544d1faaad37cdef56ae55` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.416382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d45c4-c60e-42ab-bc7c-c6a59ad4490a None admin] RBAC: Authorizing `identity:get_user(user_id=09d7ab687f544d1faaad37cdef56ae55)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.417967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d45c4-c60e-42ab-bc7c-c6a59ad4490a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.418303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 84/164] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:22.419561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 81/165] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/users/09d7ab687f544d1faaad37cdef56ae55 => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:22.424031 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af70061-7aad-4c5c-926b-27eb481d45b9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.425421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d45c4-c60e-42ab-bc7c-c6a59ad4490a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.629128 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d45c4-c60e-42ab-bc7c-c6a59ad4490a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.640271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af70061-7aad-4c5c-926b-27eb481d45b9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.649966 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.688052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.693455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaca0f8-e785-437d-b30d-4271ab829398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.694084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaca0f8-e785-437d-b30d-4271ab829398 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.694362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaca0f8-e785-437d-b30d-4271ab829398 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.694637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaca0f8-e785-437d-b30d-4271ab829398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.697903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507e23d-4c51-4333-b0cd-d7d404734b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.698567 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507e23d-4c51-4333-b0cd-d7d404734b55 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.698846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507e23d-4c51-4333-b0cd-d7d404734b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.699126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507e23d-4c51-4333-b0cd-d7d404734b55 None admin] PATH_INFO: `/v3/users/09d7ab687f544d1faaad37cdef56ae55` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.700441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507e23d-4c51-4333-b0cd-d7d404734b55 None admin] RBAC: Authorizing `identity:get_user(user_id=09d7ab687f544d1faaad37cdef56ae55)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.702534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507e23d-4c51-4333-b0cd-d7d404734b55 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.709243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 85/166] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/users/09d7ab687f544d1faaad37cdef56ae55 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:22.711885 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89c63-0539-48e1-bad5-de19004a90c8 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.711885 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89c63-0539-48e1-bad5-de19004a90c8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.711885 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89c63-0539-48e1-bad5-de19004a90c8 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.713031 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 86/167] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:22.714196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab89c63-0539-48e1-bad5-de19004a90c8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.790460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaca0f8-e785-437d-b30d-4271ab829398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.792460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaca0f8-e785-437d-b30d-4271ab829398 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.838457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab89c63-0539-48e1-bad5-de19004a90c8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.883148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0e8f5-13ec-4aa1-8f40-03ede2bc171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.884440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e8f5-13ec-4aa1-8f40-03ede2bc171e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.885406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e8f5-13ec-4aa1-8f40-03ede2bc171e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.886019 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e8f5-13ec-4aa1-8f40-03ede2bc171e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.905290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 82/168] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:07:22.907391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0180b9-c875-431c-9854-e8ea5168118c None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.907861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0180b9-c875-431c-9854-e8ea5168118c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.908293 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0180b9-c875-431c-9854-e8ea5168118c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.927788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-cb0180b9-c875-431c-9854-e8ea5168118c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:22.929217 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-cb0180b9-c875-431c-9854-e8ea5168118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:22.933503 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.989932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.997472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0e8f5-13ec-4aa1-8f40-03ede2bc171e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.999198 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0e8f5-13ec-4aa1-8f40-03ede2bc171e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.004251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 83/169] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:23.005484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0180b9-c875-431c-9854-e8ea5168118c None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.122265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0180b9-c875-431c-9854-e8ea5168118c None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.159937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76672f72-fdc8-4273-8da9-368a8e47114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.160929 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672f72-fdc8-4273-8da9-368a8e47114c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.161509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672f72-fdc8-4273-8da9-368a8e47114c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.161992 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672f72-fdc8-4273-8da9-368a8e47114c None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.163389 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76672f72-fdc8-4273-8da9-368a8e47114c None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.165567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76672f72-fdc8-4273-8da9-368a8e47114c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.169551 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 84/170] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:23.173390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76672f72-fdc8-4273-8da9-368a8e47114c None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.185261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:23.210944 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 87/171] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:07:23.223732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0e8f5-13ec-4aa1-8f40-03ede2bc171e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.365198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76672f72-fdc8-4273-8da9-368a8e47114c None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.453923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567e889-3d11-45ec-95cc-6d427117f834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.454461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567e889-3d11-45ec-95cc-6d427117f834 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.454738 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567e889-3d11-45ec-95cc-6d427117f834 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.455009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567e889-3d11-45ec-95cc-6d427117f834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.455792 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567e889-3d11-45ec-95cc-6d427117f834 None admin] RBAC: Adding query filter params (role.id=8615852d81aa46c39661d01a0372d8e8, scope.project.id=1221b9ee938248cf926034ec51adb9cf, user.id=09d7ab687f544d1faaad37cdef56ae55) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:23.456109 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567e889-3d11-45ec-95cc-6d427117f834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.457550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567e889-3d11-45ec-95cc-6d427117f834 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.472219 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:23.474073 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 85/172] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/role_assignments?user.id=09d7ab687f544d1faaad37cdef56ae55&scope.project.id=1221b9ee938248cf926034ec51adb9cf&role.id=8615852d81aa46c39661d01a0372d8e8 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:23.478006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0e8f5-13ec-4aa1-8f40-03ede2bc171e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.514137 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567e889-3d11-45ec-95cc-6d427117f834 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.554492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2d027-7b94-4e19-b78d-7e1e3dda1717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.555147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2d027-7b94-4e19-b78d-7e1e3dda1717 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.555425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2d027-7b94-4e19-b78d-7e1e3dda1717 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.555718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2d027-7b94-4e19-b78d-7e1e3dda1717 None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.557840 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2d027-7b94-4e19-b78d-7e1e3dda1717 None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.559648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2d027-7b94-4e19-b78d-7e1e3dda1717 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.561763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 88/173] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:23.567545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2d027-7b94-4e19-b78d-7e1e3dda1717 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.663936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:23.715060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567e889-3d11-45ec-95cc-6d427117f834 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.741985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2d027-7b94-4e19-b78d-7e1e3dda1717 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.777973 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c2641-a7c3-4295-b59b-4cc83988179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.778591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c2641-a7c3-4295-b59b-4cc83988179f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.778868 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c2641-a7c3-4295-b59b-4cc83988179f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.779139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c2641-a7c3-4295-b59b-4cc83988179f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.779906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c2641-a7c3-4295-b59b-4cc83988179f None admin] RBAC: Adding query filter params (role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1, scope.project.id=1221b9ee938248cf926034ec51adb9cf, user.id=09d7ab687f544d1faaad37cdef56ae55) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:23.780210 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c2641-a7c3-4295-b59b-4cc83988179f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.780410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13037d-93e2-4272-85d2-5b41ca3bc1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.781069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13037d-93e2-4272-85d2-5b41ca3bc1dc None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.781354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13037d-93e2-4272-85d2-5b41ca3bc1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.781632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13037d-93e2-4272-85d2-5b41ca3bc1dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.781730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c2641-a7c3-4295-b59b-4cc83988179f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.788238 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 89/174] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/role_assignments?user.id=09d7ab687f544d1faaad37cdef56ae55&scope.project.id=1221b9ee938248cf926034ec51adb9cf&role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:23.803232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13037d-93e2-4272-85d2-5b41ca3bc1dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-cb13037d-93e2-4272-85d2-5b41ca3bc1dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:23.809292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:23.810309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:23.811167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:23.811167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:23.811167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:23.811167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:23.811167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:23.811167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:23.811167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:23.811167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:23.811167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:23.811167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:23.811167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:23.811167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:23.811167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 86/175] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:23.816892 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c2641-a7c3-4295-b59b-4cc83988179f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.860531 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:23.945056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c2641-a7c3-4295-b59b-4cc83988179f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.986169 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db00bc-90ca-493f-ac05-3680d09d9de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.986718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db00bc-90ca-493f-ac05-3680d09d9de6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.986997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db00bc-90ca-493f-ac05-3680d09d9de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.987269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db00bc-90ca-493f-ac05-3680d09d9de6 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.987974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db00bc-90ca-493f-ac05-3680d09d9de6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:23.988277 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db00bc-90ca-493f-ac05-3680d09d9de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.989703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db00bc-90ca-493f-ac05-3680d09d9de6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:24.000053 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 90/176] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:24.006380 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13037d-93e2-4272-85d2-5b41ca3bc1dc None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.012950 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30b80-f877-464e-aeb5-f1c0e457449f None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.013281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30b80-f877-464e-aeb5-f1c0e457449f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.013502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30b80-f877-464e-aeb5-f1c0e457449f None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.015173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 91/177] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:24.020829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d81b0-1797-4c99-ade9-0801c99f39d9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.021128 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d81b0-1797-4c99-ade9-0801c99f39d9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.021573 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d81b0-1797-4c99-ade9-0801c99f39d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.040506 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-667d81b0-1797-4c99-ade9-0801c99f39d9 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:24.041783 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-667d81b0-1797-4c99-ade9-0801c99f39d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:24.128497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 92/178] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:24.158401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13037d-93e2-4272-85d2-5b41ca3bc1dc None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.205352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:24.211527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24824b-1684-499e-a9a0-040fb459b907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.212692 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24824b-1684-499e-a9a0-040fb459b907 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.213255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24824b-1684-499e-a9a0-040fb459b907 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.213972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24824b-1684-499e-a9a0-040fb459b907 None admin] PATH_INFO: `/v3/users/09d7ab687f544d1faaad37cdef56ae55` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.215214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24824b-1684-499e-a9a0-040fb459b907 None admin] RBAC: Authorizing `identity:get_user(user_id=09d7ab687f544d1faaad37cdef56ae55)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:24.216761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24824b-1684-499e-a9a0-040fb459b907 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:24.218496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 87/179] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/users/09d7ab687f544d1faaad37cdef56ae55 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:24.225194 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d81b0-1797-4c99-ade9-0801c99f39d9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.251340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:24.299424 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287925d-4a38-4519-8b77-1aed50a22517 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.299776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287925d-4a38-4519-8b77-1aed50a22517 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.300054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287925d-4a38-4519-8b77-1aed50a22517 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.301441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 88/180] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:24.309574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc8880-fc86-4b86-b178-549acdc58b3b None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.309861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc8880-fc86-4b86-b178-549acdc58b3b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.310140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc8880-fc86-4b86-b178-549acdc58b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.337155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d81b0-1797-4c99-ade9-0801c99f39d9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.342558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-afdc8880-fc86-4b86-b178-549acdc58b3b None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:24.343767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-afdc8880-fc86-4b86-b178-549acdc58b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:24.382558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535da0b6-c167-403f-8be5-df2272e46d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.383177 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535da0b6-c167-403f-8be5-df2272e46d7e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.383458 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535da0b6-c167-403f-8be5-df2272e46d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.383754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535da0b6-c167-403f-8be5-df2272e46d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.422561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 89/181] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 00:07:24.423890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c8593-6b64-4c30-823c-b39ad9af5a5d None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.424179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c8593-6b64-4c30-823c-b39ad9af5a5d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.424451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c8593-6b64-4c30-823c-b39ad9af5a5d None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.425733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 90/182] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:24.431065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d188a-0c45-4a37-9d2b-abbbcdc26520 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.431346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d188a-0c45-4a37-9d2b-abbbcdc26520 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.431636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d188a-0c45-4a37-9d2b-abbbcdc26520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.452297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-d63d188a-0c45-4a37-9d2b-abbbcdc26520 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:24.453575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d63d188a-0c45-4a37-9d2b-abbbcdc26520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:24.488800 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535da0b6-c167-403f-8be5-df2272e46d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:24.490286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535da0b6-c167-403f-8be5-df2272e46d7e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:24.522890 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:24.542855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 91/183] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:24.544261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d188a-0c45-4a37-9d2b-abbbcdc26520 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.611437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:24.626657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 93/184] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:24.631909 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ae562-5d90-4113-b239-14dd4a1eb96b None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.632487 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ae562-5d90-4113-b239-14dd4a1eb96b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.634752 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ae562-5d90-4113-b239-14dd4a1eb96b None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.636687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 94/185] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:24.637637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ae562-5d90-4113-b239-14dd4a1eb96b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.664558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d188a-0c45-4a37-9d2b-abbbcdc26520 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.708335 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d7def-23ab-4456-9a24-e0ab1e5e4064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.709168 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d7def-23ab-4456-9a24-e0ab1e5e4064 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.709666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d7def-23ab-4456-9a24-e0ab1e5e4064 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.710047 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d7def-23ab-4456-9a24-e0ab1e5e4064 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.723962 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d7def-23ab-4456-9a24-e0ab1e5e4064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-952d7def-23ab-4456-9a24-e0ab1e5e4064 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:24.729879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:24.730791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:24.731604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:24.731604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:24.731604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:24.731604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:24.731604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:24.731604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:24.731604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:24.731604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:24.731604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:24.731604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:24.731604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:24.731604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:24.731604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 92/186] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:24.735944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdc067-4b41-4438-bae5-f28391ddebd3 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.735944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdc067-4b41-4438-bae5-f28391ddebd3 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.735944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdc067-4b41-4438-bae5-f28391ddebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.756646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-bacdc067-4b41-4438-bae5-f28391ddebd3 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:24.757839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-bacdc067-4b41-4438-bae5-f28391ddebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:24.764450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ae562-5d90-4113-b239-14dd4a1eb96b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.792862 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:24.806195 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cd519-7f0d-4b5a-9374-993cbadeadfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.807145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd519-7f0d-4b5a-9374-993cbadeadfc None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.807453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd519-7f0d-4b5a-9374-993cbadeadfc None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.807747 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cd519-7f0d-4b5a-9374-993cbadeadfc None admin] PATH_INFO: `/v3/projects/d80112390a1e4506bf43d4240b12d592` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.809612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cd519-7f0d-4b5a-9374-993cbadeadfc None admin] RBAC: Authorizing `identity:get_project(project_id=d80112390a1e4506bf43d4240b12d592)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:24.811179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cd519-7f0d-4b5a-9374-993cbadeadfc None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:24.818541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 95/187] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/projects/d80112390a1e4506bf43d4240b12d592 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:24.818541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cd519-7f0d-4b5a-9374-993cbadeadfc None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.825512 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 93/188] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:24.826574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdc067-4b41-4438-bae5-f28391ddebd3 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.887934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:24.934729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cd519-7f0d-4b5a-9374-993cbadeadfc None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.943602 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdc067-4b41-4438-bae5-f28391ddebd3 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.972543 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3002b-e461-46a5-a16d-70ed2b550b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.973163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3002b-e461-46a5-a16d-70ed2b550b08 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.973446 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3002b-e461-46a5-a16d-70ed2b550b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.973933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3002b-e461-46a5-a16d-70ed2b550b08 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.974385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3002b-e461-46a5-a16d-70ed2b550b08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:24.974764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3002b-e461-46a5-a16d-70ed2b550b08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:24.976094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3002b-e461-46a5-a16d-70ed2b550b08 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:24.978805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5639f2-19f6-43b2-a8e1-f877f6efa8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.979470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5639f2-19f6-43b2-a8e1-f877f6efa8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.979780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5639f2-19f6-43b2-a8e1-f877f6efa8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.980056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5639f2-19f6-43b2-a8e1-f877f6efa8e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.981531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5639f2-19f6-43b2-a8e1-f877f6efa8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:24.982606 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5639f2-19f6-43b2-a8e1-f877f6efa8e1 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:24.984225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 94/189] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:24.984977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5639f2-19f6-43b2-a8e1-f877f6efa8e1 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.985139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 96/190] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:24.990548 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3002b-e461-46a5-a16d-70ed2b550b08 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.044407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.087912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5639f2-19f6-43b2-a8e1-f877f6efa8e1 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.093701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3002b-e461-46a5-a16d-70ed2b550b08 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.107525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.124394 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13c20c-96d5-4dfa-b7b2-a75e9be7651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.125000 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13c20c-96d5-4dfa-b7b2-a75e9be7651e None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.125283 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13c20c-96d5-4dfa-b7b2-a75e9be7651e None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.125550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13c20c-96d5-4dfa-b7b2-a75e9be7651e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.126275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13c20c-96d5-4dfa-b7b2-a75e9be7651e None admin] RBAC: Adding query filter params (role.id=8615852d81aa46c39661d01a0372d8e8, scope.project.id=d80112390a1e4506bf43d4240b12d592, user.id=09d7ab687f544d1faaad37cdef56ae55) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:25.126581 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13c20c-96d5-4dfa-b7b2-a75e9be7651e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.126819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa6f63-567e-40d4-b96f-6a8b0653eeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.127460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa6f63-567e-40d4-b96f-6a8b0653eeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.127765 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa6f63-567e-40d4-b96f-6a8b0653eeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.128041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa6f63-567e-40d4-b96f-6a8b0653eeb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.128140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13c20c-96d5-4dfa-b7b2-a75e9be7651e None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.133842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 95/191] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/role_assignments?user.id=09d7ab687f544d1faaad37cdef56ae55&scope.project.id=d80112390a1e4506bf43d4240b12d592&role.id=8615852d81aa46c39661d01a0372d8e8 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:25.133842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13c20c-96d5-4dfa-b7b2-a75e9be7651e None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.144050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa6f63-567e-40d4-b96f-6a8b0653eeb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-f1aa6f63-567e-40d4-b96f-6a8b0653eeb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:25.149662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:25.150764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:25.151684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:25.151684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:25.151684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:25.151684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:25.151684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:25.151684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:25.151684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:25.151684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:25.151684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:25.151684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:25.151684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:25.151684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:25.151684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 97/192] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:25.152894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa6f63-567e-40d4-b96f-6a8b0653eeb2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.273940 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13c20c-96d5-4dfa-b7b2-a75e9be7651e None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.274841 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa6f63-567e-40d4-b96f-6a8b0653eeb2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.292554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.314439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0ae23-247e-475d-8e11-2c15f1aa7e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.314995 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0ae23-247e-475d-8e11-2c15f1aa7e55 None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.315272 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0ae23-247e-475d-8e11-2c15f1aa7e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.315539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0ae23-247e-475d-8e11-2c15f1aa7e55 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.316331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0ae23-247e-475d-8e11-2c15f1aa7e55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.317783 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0ae23-247e-475d-8e11-2c15f1aa7e55 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.324964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada3764-d9c9-447d-a27d-b492c943512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.325619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada3764-d9c9-447d-a27d-b492c943512e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.325905 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada3764-d9c9-447d-a27d-b492c943512e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.326184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada3764-d9c9-447d-a27d-b492c943512e None admin] PATH_INFO: `/v3/users/7a0c08554afc4f608a1b331bc3ab0b32` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.342060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 96/193] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:25 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:25.344036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0ae23-247e-475d-8e11-2c15f1aa7e55 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.345356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada3764-d9c9-447d-a27d-b492c943512e None admin] RBAC: Authorizing `identity:get_user(user_id=7a0c08554afc4f608a1b331bc3ab0b32)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.347201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada3764-d9c9-447d-a27d-b492c943512e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.349010 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 98/194] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/users/7a0c08554afc4f608a1b331bc3ab0b32 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:25.349836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada3764-d9c9-447d-a27d-b492c943512e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.398516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.479897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada3764-d9c9-447d-a27d-b492c943512e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.486154 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0ae23-247e-475d-8e11-2c15f1aa7e55 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.519926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd203c-a904-469a-8d66-ef45aa86eec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.520601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd203c-a904-469a-8d66-ef45aa86eec3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.520879 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd203c-a904-469a-8d66-ef45aa86eec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.521149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd203c-a904-469a-8d66-ef45aa86eec3 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.521821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd203c-a904-469a-8d66-ef45aa86eec3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:25.522125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd203c-a904-469a-8d66-ef45aa86eec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.523554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd203c-a904-469a-8d66-ef45aa86eec3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.530643 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadce90-a3f1-457c-b666-5158acb8e39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.531293 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadce90-a3f1-457c-b666-5158acb8e39d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.531566 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadce90-a3f1-457c-b666-5158acb8e39d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.531866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadce90-a3f1-457c-b666-5158acb8e39d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.533732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 99/195] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:25.535169 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd203c-a904-469a-8d66-ef45aa86eec3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.545172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baadce90-a3f1-457c-b666-5158acb8e39d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-baadce90-a3f1-457c-b666-5158acb8e39d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:25.551466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:25.552629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:25.553638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:25.553638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:25.553638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:25.553638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:25.553638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:25.553638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:25.553638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:25.553638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:25.553638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:25.553638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:25.553638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:25.553638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:25.555971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 97/196] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:25.561974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadce90-a3f1-457c-b666-5158acb8e39d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.573972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.664138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd203c-a904-469a-8d66-ef45aa86eec3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.688067 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.694218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadce90-a3f1-457c-b666-5158acb8e39d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.717364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054c098-5a80-4c98-a29e-bafd5d454a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.718786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054c098-5a80-4c98-a29e-bafd5d454a33 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.719217 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054c098-5a80-4c98-a29e-bafd5d454a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.719640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054c098-5a80-4c98-a29e-bafd5d454a33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.732903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8fa98-2cdc-4fdd-98bf-5fe89e15b5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.733628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8fa98-2cdc-4fdd-98bf-5fe89e15b5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.733978 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8fa98-2cdc-4fdd-98bf-5fe89e15b5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.734320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8fa98-2cdc-4fdd-98bf-5fe89e15b5c5 None admin] PATH_INFO: `/v3/users/7a0c08554afc4f608a1b331bc3ab0b32` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.735594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8fa98-2cdc-4fdd-98bf-5fe89e15b5c5 None admin] RBAC: Authorizing `identity:get_user(user_id=7a0c08554afc4f608a1b331bc3ab0b32)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.737158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8fa98-2cdc-4fdd-98bf-5fe89e15b5c5 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.739207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 98/197] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/users/7a0c08554afc4f608a1b331bc3ab0b32 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:25.740135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8fa98-2cdc-4fdd-98bf-5fe89e15b5c5 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.816393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054c098-5a80-4c98-a29e-bafd5d454a33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.819056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054c098-5a80-4c98-a29e-bafd5d454a33 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.856578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8fa98-2cdc-4fdd-98bf-5fe89e15b5c5 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.860824 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.902366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6a94d-4a14-44be-afab-fbe8513d55e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.903227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6a94d-4a14-44be-afab-fbe8513d55e6 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.903980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6a94d-4a14-44be-afab-fbe8513d55e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.905286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6a94d-4a14-44be-afab-fbe8513d55e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.906226 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6a94d-4a14-44be-afab-fbe8513d55e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:25.906687 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6a94d-4a14-44be-afab-fbe8513d55e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.908354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6a94d-4a14-44be-afab-fbe8513d55e6 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.922366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 99/198] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:25.927779 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6a94d-4a14-44be-afab-fbe8513d55e6 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.949523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 100/199] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:25.950758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054c098-5a80-4c98-a29e-bafd5d454a33 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.964306 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.037083 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6a94d-4a14-44be-afab-fbe8513d55e6 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.063070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054c098-5a80-4c98-a29e-bafd5d454a33 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.076597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0690f26-874c-4623-9c88-705329f00217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.077558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690f26-874c-4623-9c88-705329f00217 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.078190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690f26-874c-4623-9c88-705329f00217 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.078640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690f26-874c-4623-9c88-705329f00217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.095630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.102286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78140c7-2bf9-4c0d-8aaf-a486684d4451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.103461 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78140c7-2bf9-4c0d-8aaf-a486684d4451 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.104302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78140c7-2bf9-4c0d-8aaf-a486684d4451 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.104778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78140c7-2bf9-4c0d-8aaf-a486684d4451 None admin] PATH_INFO: `/v3/users/f237ad35ec3b4cddb722644233b37aaf` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.106163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78140c7-2bf9-4c0d-8aaf-a486684d4451 None admin] RBAC: Authorizing `identity:get_user(user_id=f237ad35ec3b4cddb722644233b37aaf)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.108700 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78140c7-2bf9-4c0d-8aaf-a486684d4451 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.115633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 101/200] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/users/f237ad35ec3b4cddb722644233b37aaf => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:26.115633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78140c7-2bf9-4c0d-8aaf-a486684d4451 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.171343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0690f26-874c-4623-9c88-705329f00217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.173028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0690f26-874c-4623-9c88-705329f00217 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.204341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.252628 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78140c7-2bf9-4c0d-8aaf-a486684d4451 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.285511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 100/201] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:26.286337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0690f26-874c-4623-9c88-705329f00217 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.303421 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e99fe-07d2-4602-843d-9bb809051507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.304592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e99fe-07d2-4602-843d-9bb809051507 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.305400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e99fe-07d2-4602-843d-9bb809051507 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.305846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e99fe-07d2-4602-843d-9bb809051507 None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.307207 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e99fe-07d2-4602-843d-9bb809051507 None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.310023 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e99fe-07d2-4602-843d-9bb809051507 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.312571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 102/202] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:26 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:26.313834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e99fe-07d2-4602-843d-9bb809051507 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.392231 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.404215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0690f26-874c-4623-9c88-705329f00217 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.428323 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e99fe-07d2-4602-843d-9bb809051507 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.439839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.450774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255cee0-61b9-4400-a5bb-ba47cb468563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.451459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255cee0-61b9-4400-a5bb-ba47cb468563 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.451832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255cee0-61b9-4400-a5bb-ba47cb468563 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.452165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255cee0-61b9-4400-a5bb-ba47cb468563 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.467411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa378800-5fb7-4449-ba5b-8d4ed9971221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.468492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378800-5fb7-4449-ba5b-8d4ed9971221 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.468978 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378800-5fb7-4449-ba5b-8d4ed9971221 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.469588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378800-5fb7-4449-ba5b-8d4ed9971221 None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.471036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa378800-5fb7-4449-ba5b-8d4ed9971221 None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.472858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa378800-5fb7-4449-ba5b-8d4ed9971221 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.474987 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 103/203] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:26 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:26.475916 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa378800-5fb7-4449-ba5b-8d4ed9971221 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.537262 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255cee0-61b9-4400-a5bb-ba47cb468563 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.539237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255cee0-61b9-4400-a5bb-ba47cb468563 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.612640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa378800-5fb7-4449-ba5b-8d4ed9971221 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.654761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 101/204] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:26.655971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255cee0-61b9-4400-a5bb-ba47cb468563 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.666497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ded806-d753-4618-baf6-6cef93e157dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.667794 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ded806-d753-4618-baf6-6cef93e157dd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.668080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ded806-d753-4618-baf6-6cef93e157dd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.668357 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ded806-d753-4618-baf6-6cef93e157dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.669097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ded806-d753-4618-baf6-6cef93e157dd None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e, user.id=7a0c08554afc4f608a1b331bc3ab0b32) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:26.669407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ded806-d753-4618-baf6-6cef93e157dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.671376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ded806-d753-4618-baf6-6cef93e157dd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.675378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.687377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 104/205] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:26 2022] GET /identity/v3/role_assignments?user.id=7a0c08554afc4f608a1b331bc3ab0b32&scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:26.687377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ded806-d753-4618-baf6-6cef93e157dd None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.705519 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.800280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ded806-d753-4618-baf6-6cef93e157dd None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.841417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8bb3b-5968-4cf4-9852-7dc5636fa681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.842565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8bb3b-5968-4cf4-9852-7dc5636fa681 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.842811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8bb3b-5968-4cf4-9852-7dc5636fa681 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.843089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8bb3b-5968-4cf4-9852-7dc5636fa681 None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.847717 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8bb3b-5968-4cf4-9852-7dc5636fa681 None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.847717 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8bb3b-5968-4cf4-9852-7dc5636fa681 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.847717 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 105/206] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:26 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:26.853979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8bb3b-5968-4cf4-9852-7dc5636fa681 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.888750 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255cee0-61b9-4400-a5bb-ba47cb468563 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.935236 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.963263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aec200-4642-4d19-9fde-ea65cb9b9f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.963965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aec200-4642-4d19-9fde-ea65cb9b9f68 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.964250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aec200-4642-4d19-9fde-ea65cb9b9f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.964526 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aec200-4642-4d19-9fde-ea65cb9b9f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.965268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aec200-4642-4d19-9fde-ea65cb9b9f68 None admin] RBAC: Adding query filter params (role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1, scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e, user.id=7a0c08554afc4f608a1b331bc3ab0b32) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:26.965589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aec200-4642-4d19-9fde-ea65cb9b9f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.967063 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aec200-4642-4d19-9fde-ea65cb9b9f68 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.983463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 102/207] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:26 2022] GET /identity/v3/role_assignments?user.id=7a0c08554afc4f608a1b331bc3ab0b32&scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e&role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 259 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:26.991943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8bb3b-5968-4cf4-9852-7dc5636fa681 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:27.031460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87394075-aab5-4ccb-9f56-b5e882df5022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:27.032113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87394075-aab5-4ccb-9f56-b5e882df5022 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.032396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87394075-aab5-4ccb-9f56-b5e882df5022 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.032661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87394075-aab5-4ccb-9f56-b5e882df5022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.033398 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87394075-aab5-4ccb-9f56-b5e882df5022 None admin] RBAC: Adding query filter params (role.id=f23c33107fdc4e839449e5bdf255e364, scope.project.id=1221b9ee938248cf926034ec51adb9cf, user.id=f237ad35ec3b4cddb722644233b37aaf) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:27.033709 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87394075-aab5-4ccb-9f56-b5e882df5022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:27.035202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87394075-aab5-4ccb-9f56-b5e882df5022 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:27.042121 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 106/208] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:26 2022] GET /identity/v3/role_assignments?user.id=f237ad35ec3b4cddb722644233b37aaf&scope.project.id=1221b9ee938248cf926034ec51adb9cf&role.id=f23c33107fdc4e839449e5bdf255e364 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:27.523103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9d2ee-d586-4d93-9651-fea24bd1ae77 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.523613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9d2ee-d586-4d93-9651-fea24bd1ae77 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.523735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9d2ee-d586-4d93-9651-fea24bd1ae77 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.525280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 103/209] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:27.530752 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa72650-185f-42bd-baf3-295358e51dc1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.531146 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa72650-185f-42bd-baf3-295358e51dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.531312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa72650-185f-42bd-baf3-295358e51dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.552050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4aa72650-185f-42bd-baf3-295358e51dc1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:27.553238 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4aa72650-185f-42bd-baf3-295358e51dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:27.572853 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde93c-88ab-4270-982e-e06ad1f43ac1 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.573207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde93c-88ab-4270-982e-e06ad1f43ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.573459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde93c-88ab-4270-982e-e06ad1f43ac1 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.575143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 104/210] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:27.580296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128135a-af74-409b-8b1c-f9f53bb249fd None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.580578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128135a-af74-409b-8b1c-f9f53bb249fd None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.580853 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128135a-af74-409b-8b1c-f9f53bb249fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.601322 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-0128135a-af74-409b-8b1c-f9f53bb249fd None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:27.602117 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-0128135a-af74-409b-8b1c-f9f53bb249fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:27.636956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 107/211] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:27.688148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 105/212] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:27.916747 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa72650-185f-42bd-baf3-295358e51dc1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.952274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128135a-af74-409b-8b1c-f9f53bb249fd None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.981075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:27.989616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.037417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa72650-185f-42bd-baf3-295358e51dc1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.084328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128135a-af74-409b-8b1c-f9f53bb249fd None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.086297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062eb59-5793-4132-9168-225cc51c840d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.088019 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062eb59-5793-4132-9168-225cc51c840d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.088491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062eb59-5793-4132-9168-225cc51c840d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.089000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062eb59-5793-4132-9168-225cc51c840d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.102870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062eb59-5793-4132-9168-225cc51c840d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7062eb59-5793-4132-9168-225cc51c840d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:28.109425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:28.110335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:28.111153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:28.111153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:28.111153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:28.111153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:28.111153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:28.111153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:28.111153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:28.111153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:28.111153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:28.111153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:28.111153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:28.111153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:28.115756 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 108/213] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:28.120900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062eb59-5793-4132-9168-225cc51c840d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.129281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249f0e7-71c5-4a91-89b6-57e527374458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.130185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f0e7-71c5-4a91-89b6-57e527374458 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.130635 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f0e7-71c5-4a91-89b6-57e527374458 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.131075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f0e7-71c5-4a91-89b6-57e527374458 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.132759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249f0e7-71c5-4a91-89b6-57e527374458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.134871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249f0e7-71c5-4a91-89b6-57e527374458 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.141998 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 106/214] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:28.143037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249f0e7-71c5-4a91-89b6-57e527374458 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.246596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062eb59-5793-4132-9168-225cc51c840d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.253506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.267667 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249f0e7-71c5-4a91-89b6-57e527374458 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.284737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.300943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a2357-c803-4f65-819e-3f630d9a722f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.301587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a2357-c803-4f65-819e-3f630d9a722f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.301972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a2357-c803-4f65-819e-3f630d9a722f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.302263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a2357-c803-4f65-819e-3f630d9a722f None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.303162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a2357-c803-4f65-819e-3f630d9a722f None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:28.303467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a2357-c803-4f65-819e-3f630d9a722f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.305201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a2357-c803-4f65-819e-3f630d9a722f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.306966 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46cc7-5924-453e-ba81-5754f6e9daa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.307910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46cc7-5924-453e-ba81-5754f6e9daa7 None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.308379 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46cc7-5924-453e-ba81-5754f6e9daa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.309175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46cc7-5924-453e-ba81-5754f6e9daa7 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.310044 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f46cc7-5924-453e-ba81-5754f6e9daa7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.311676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f46cc7-5924-453e-ba81-5754f6e9daa7 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.314992 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 109/215] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:28.320528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a2357-c803-4f65-819e-3f630d9a722f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.342241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 107/216] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:28 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:28.452317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a2357-c803-4f65-819e-3f630d9a722f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.491829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e03acf-35d8-4d17-9774-5d3a62dca94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.492477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e03acf-35d8-4d17-9774-5d3a62dca94c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.492756 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e03acf-35d8-4d17-9774-5d3a62dca94c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.493026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e03acf-35d8-4d17-9774-5d3a62dca94c None admin] PATH_INFO: `/v3/users/e79bc7e02b074c24b2333ceada77865c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.507631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e03acf-35d8-4d17-9774-5d3a62dca94c None admin] RBAC: Authorizing `identity:get_user(user_id=e79bc7e02b074c24b2333ceada77865c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.509105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e03acf-35d8-4d17-9774-5d3a62dca94c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.510774 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 110/217] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/users/e79bc7e02b074c24b2333ceada77865c => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:28.516719 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46cc7-5924-453e-ba81-5754f6e9daa7 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.624342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46cc7-5924-453e-ba81-5754f6e9daa7 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.660404 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6935ad-6624-40da-b5b3-816900c9a108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.661088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6935ad-6624-40da-b5b3-816900c9a108 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.661366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6935ad-6624-40da-b5b3-816900c9a108 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.661680 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6935ad-6624-40da-b5b3-816900c9a108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.678868 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.701505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c146b60-eca6-496b-920b-a402b04af659 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.702506 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c146b60-eca6-496b-920b-a402b04af659 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.702992 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c146b60-eca6-496b-920b-a402b04af659 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.705329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 111/218] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:28.711816 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845663c8-cd1b-49b2-9084-ef2a98e4b6d1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.712419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845663c8-cd1b-49b2-9084-ef2a98e4b6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.712894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845663c8-cd1b-49b2-9084-ef2a98e4b6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.736416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6935ad-6624-40da-b5b3-816900c9a108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.738056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6935ad-6624-40da-b5b3-816900c9a108 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.738758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-845663c8-cd1b-49b2-9084-ef2a98e4b6d1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:28.740888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-845663c8-cd1b-49b2-9084-ef2a98e4b6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:28.786368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.827162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 112/219] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:28.876229 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 108/220] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:28.881808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845663c8-cd1b-49b2-9084-ef2a98e4b6d1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.995526 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845663c8-cd1b-49b2-9084-ef2a98e4b6d1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.031051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4f20e-23c2-4f1d-8040-8f76a12e882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.031730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4f20e-23c2-4f1d-8040-8f76a12e882b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.032006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4f20e-23c2-4f1d-8040-8f76a12e882b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.032359 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4f20e-23c2-4f1d-8040-8f76a12e882b None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.033501 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4f20e-23c2-4f1d-8040-8f76a12e882b None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.034990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4f20e-23c2-4f1d-8040-8f76a12e882b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.036953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 113/221] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:29.042936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6935ad-6624-40da-b5b3-816900c9a108 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.093418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:29.147313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4f20e-23c2-4f1d-8040-8f76a12e882b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.154328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6935ad-6624-40da-b5b3-816900c9a108 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.216111 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:29.236862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b2c42-6a11-4ec0-9119-128d86243f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.237851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b2c42-6a11-4ec0-9119-128d86243f09 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.238327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b2c42-6a11-4ec0-9119-128d86243f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.238820 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b2c42-6a11-4ec0-9119-128d86243f09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.247889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b2c42-6a11-4ec0-9119-128d86243f09 None admin] RBAC: Adding query filter params (role.id=8615852d81aa46c39661d01a0372d8e8, scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e, user.id=e79bc7e02b074c24b2333ceada77865c) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:29.248610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b2c42-6a11-4ec0-9119-128d86243f09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.250304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b2c42-6a11-4ec0-9119-128d86243f09 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.265030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4f20e-23c2-4f1d-8040-8f76a12e882b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.266042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 109/222] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/role_assignments?user.id=e79bc7e02b074c24b2333ceada77865c&scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e&role.id=8615852d81aa46c39661d01a0372d8e8 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:29.305320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5e8f9-c828-4080-bb95-310d0e399acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.305878 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e8f9-c828-4080-bb95-310d0e399acf None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.306159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e8f9-c828-4080-bb95-310d0e399acf None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.306434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e8f9-c828-4080-bb95-310d0e399acf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.319963 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5e8f9-c828-4080-bb95-310d0e399acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-10d5e8f9-c828-4080-bb95-310d0e399acf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:29.326897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:29.329074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:29.330686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:29.330686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:29.330686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:29.330686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:29.330686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:29.330686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:29.330686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:29.330686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:29.330686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:29.330686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:29.330686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:29.330686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:29.330686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 114/223] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:29.334416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5a8d1-f65c-42ad-a971-5013626f1cda None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.335007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5a8d1-f65c-42ad-a971-5013626f1cda None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.335479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5a8d1-f65c-42ad-a971-5013626f1cda None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.337275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 110/224] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:29 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:29.341563 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5e8f9-c828-4080-bb95-310d0e399acf None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.343179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628eeed-da2d-4bb1-b5ec-de1499410dde None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.343674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628eeed-da2d-4bb1-b5ec-de1499410dde None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.344208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628eeed-da2d-4bb1-b5ec-de1499410dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.376783 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-b628eeed-da2d-4bb1-b5ec-de1499410dde None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:29.383658 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b628eeed-da2d-4bb1-b5ec-de1499410dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:29.508302 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 111/225] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:29.544112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:29.546659 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5e8f9-c828-4080-bb95-310d0e399acf None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.594633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d9b88-e191-40f0-bb84-997d1004cf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.595161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d9b88-e191-40f0-bb84-997d1004cf9f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.595439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d9b88-e191-40f0-bb84-997d1004cf9f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.595729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d9b88-e191-40f0-bb84-997d1004cf9f None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.596562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d9b88-e191-40f0-bb84-997d1004cf9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:29.596860 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d9b88-e191-40f0-bb84-997d1004cf9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.598256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d9b88-e191-40f0-bb84-997d1004cf9f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.611818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 115/226] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:29.617556 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628eeed-da2d-4bb1-b5ec-de1499410dde None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.684423 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:29.770899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628eeed-da2d-4bb1-b5ec-de1499410dde None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.813932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a376b-f3bb-4405-aae8-2e3753016a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.814577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a376b-f3bb-4405-aae8-2e3753016a37 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.814858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a376b-f3bb-4405-aae8-2e3753016a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.815133 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a376b-f3bb-4405-aae8-2e3753016a37 None admin] PATH_INFO: `/v3/users/7a0c08554afc4f608a1b331bc3ab0b32` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.816285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a376b-f3bb-4405-aae8-2e3753016a37 None admin] RBAC: Authorizing `identity:get_user(user_id=7a0c08554afc4f608a1b331bc3ab0b32)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.817747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a376b-f3bb-4405-aae8-2e3753016a37 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.819347 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 112/227] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/users/7a0c08554afc4f608a1b331bc3ab0b32 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:29.825343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d9b88-e191-40f0-bb84-997d1004cf9f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.868195 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a376b-f3bb-4405-aae8-2e3753016a37 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.998403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d9b88-e191-40f0-bb84-997d1004cf9f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:30.036126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a376b-f3bb-4405-aae8-2e3753016a37 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:30.050694 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:30.065761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51e519-6d3c-44d3-b6a7-3f5223495959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:30.066853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51e519-6d3c-44d3-b6a7-3f5223495959 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.068343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51e519-6d3c-44d3-b6a7-3f5223495959 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.068830 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51e519-6d3c-44d3-b6a7-3f5223495959 None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.071013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51e519-6d3c-44d3-b6a7-3f5223495959 None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:30.072790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51e519-6d3c-44d3-b6a7-3f5223495959 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:30.077785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 116/228] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:30.083068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51e519-6d3c-44d3-b6a7-3f5223495959 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:30.105280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72257f-2eb0-4abd-a922-b246cead0c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:30.106370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72257f-2eb0-4abd-a922-b246cead0c64 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.106832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72257f-2eb0-4abd-a922-b246cead0c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.107459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72257f-2eb0-4abd-a922-b246cead0c64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.127599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72257f-2eb0-4abd-a922-b246cead0c64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-0a72257f-2eb0-4abd-a922-b246cead0c64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:30.135397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:30.136383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:30.137237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:30.137237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:30.137237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:30.137237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:30.137237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:30.137237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:30.137237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:30.137237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:30.137237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:30.137237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:30.137237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:30.137237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:30.143520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 113/229] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:30.149186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:30.153002 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72257f-2eb0-4abd-a922-b246cead0c64 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:30.259818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51e519-6d3c-44d3-b6a7-3f5223495959 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:30.295301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d0554-2529-4bf6-985d-391ca68530b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:30.296318 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d0554-2529-4bf6-985d-391ca68530b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.296783 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d0554-2529-4bf6-985d-391ca68530b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.297233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d0554-2529-4bf6-985d-391ca68530b2 None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e/users/7a0c08554afc4f608a1b331bc3ab0b32/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.299476 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d0554-2529-4bf6-985d-391ca68530b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d0c329e56b34ee385eebcfa74a51f6e, user_id=7a0c08554afc4f608a1b331bc3ab0b32, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:30.301158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d0554-2529-4bf6-985d-391ca68530b2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:30.323293 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72257f-2eb0-4abd-a922-b246cead0c64 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:30.326260 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 117/230] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:30 2022] PUT /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e/users/7a0c08554afc4f608a1b331bc3ab0b32/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:30.374173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcd5ec-7fd5-4abd-b7e1-5067c8a0e579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:30.374954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcd5ec-7fd5-4abd-b7e1-5067c8a0e579 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.375346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcd5ec-7fd5-4abd-b7e1-5067c8a0e579 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.375680 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcd5ec-7fd5-4abd-b7e1-5067c8a0e579 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.376481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcd5ec-7fd5-4abd-b7e1-5067c8a0e579 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:30.376847 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcd5ec-7fd5-4abd-b7e1-5067c8a0e579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:30.378608 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcd5ec-7fd5-4abd-b7e1-5067c8a0e579 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:30.388810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 114/231] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:30.394793 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d0554-2529-4bf6-985d-391ca68530b2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:30.513618 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:30.523264 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d0554-2529-4bf6-985d-391ca68530b2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:30.563035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ba82a-b7ea-4b2b-9f4f-184c3020dabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:30.563706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba82a-b7ea-4b2b-9f4f-184c3020dabd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.564008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba82a-b7ea-4b2b-9f4f-184c3020dabd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.564277 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba82a-b7ea-4b2b-9f4f-184c3020dabd None admin] PATH_INFO: `/v3/users/7a0c08554afc4f608a1b331bc3ab0b32` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.565387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ba82a-b7ea-4b2b-9f4f-184c3020dabd None admin] RBAC: Authorizing `identity:get_user(user_id=7a0c08554afc4f608a1b331bc3ab0b32)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:30.566837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ba82a-b7ea-4b2b-9f4f-184c3020dabd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:30.568678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 118/232] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:30 2022] GET /identity/v3/users/7a0c08554afc4f608a1b331bc3ab0b32 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:30.574339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcd5ec-7fd5-4abd-b7e1-5067c8a0e579 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:30.610928 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:30.697912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcd5ec-7fd5-4abd-b7e1-5067c8a0e579 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:30.744420 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655ef5d-1eac-4a5a-b084-6b4b2d7bad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:30.745116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655ef5d-1eac-4a5a-b084-6b4b2d7bad2c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.745455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655ef5d-1eac-4a5a-b084-6b4b2d7bad2c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.745729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655ef5d-1eac-4a5a-b084-6b4b2d7bad2c None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.746941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655ef5d-1eac-4a5a-b084-6b4b2d7bad2c None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:30.748492 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655ef5d-1eac-4a5a-b084-6b4b2d7bad2c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:30.750167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 115/233] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:30 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:30.756072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ba82a-b7ea-4b2b-9f4f-184c3020dabd None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:30.878970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ba82a-b7ea-4b2b-9f4f-184c3020dabd None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:30.921362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ac78e-1c24-4243-b25d-c30e08520475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:30.922061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ac78e-1c24-4243-b25d-c30e08520475 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.922375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ac78e-1c24-4243-b25d-c30e08520475 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.922714 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ac78e-1c24-4243-b25d-c30e08520475 None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e/users/7a0c08554afc4f608a1b331bc3ab0b32/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.924922 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ac78e-1c24-4243-b25d-c30e08520475 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d0c329e56b34ee385eebcfa74a51f6e, user_id=7a0c08554afc4f608a1b331bc3ab0b32, role_id=f9b0f326bcf6425d9e2aa62dc35ddbc1)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:30.926390 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ac78e-1c24-4243-b25d-c30e08520475 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:30.943744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 119/234] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:30 2022] PUT /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e/users/7a0c08554afc4f608a1b331bc3ab0b32/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:30.957055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17d04-8af7-4c17-9f9c-189c3cf96995 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.957232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17d04-8af7-4c17-9f9c-189c3cf96995 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.957511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17d04-8af7-4c17-9f9c-189c3cf96995 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.959227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 116/235] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:30.965232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ce330-f0ea-4ffd-975e-2778ba5ca817 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.965873 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ce330-f0ea-4ffd-975e-2778ba5ca817 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.966350 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ce330-f0ea-4ffd-975e-2778ba5ca817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.004919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-193ce330-f0ea-4ffd-975e-2778ba5ca817 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:31.006516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-193ce330-f0ea-4ffd-975e-2778ba5ca817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:31.018932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebd6e9-f260-48d3-a31a-6c92460fade4 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.019239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebd6e9-f260-48d3-a31a-6c92460fade4 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.019473 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebd6e9-f260-48d3-a31a-6c92460fade4 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.023526 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 117/236] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:31.027086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.036128 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f319574-6b86-4b8d-ab62-95af682c8d3d None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.036458 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f319574-6b86-4b8d-ab62-95af682c8d3d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.036730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f319574-6b86-4b8d-ab62-95af682c8d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.058427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-4f319574-6b86-4b8d-ab62-95af682c8d3d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:31.060290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-4f319574-6b86-4b8d-ab62-95af682c8d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:31.135409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 120/237] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:31.165035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 118/238] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:31.425122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ce330-f0ea-4ffd-975e-2778ba5ca817 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.491423 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f319574-6b86-4b8d-ab62-95af682c8d3d None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.529706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.559629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ce330-f0ea-4ffd-975e-2778ba5ca817 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.606759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912aa0d-35e7-40a1-9fbd-18c76523d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.607405 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912aa0d-35e7-40a1-9fbd-18c76523d1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.607848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912aa0d-35e7-40a1-9fbd-18c76523d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.608336 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912aa0d-35e7-40a1-9fbd-18c76523d1e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.611948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912aa0d-35e7-40a1-9fbd-18c76523d1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.613422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912aa0d-35e7-40a1-9fbd-18c76523d1e6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.615029 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 121/239] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:31.624132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912aa0d-35e7-40a1-9fbd-18c76523d1e6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.645926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.689929 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f319574-6b86-4b8d-ab62-95af682c8d3d None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.734812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b2935-86fb-4ceb-88f3-f35beeb13813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.736294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b2935-86fb-4ceb-88f3-f35beeb13813 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.736956 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b2935-86fb-4ceb-88f3-f35beeb13813 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.737362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b2935-86fb-4ceb-88f3-f35beeb13813 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.750523 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b2935-86fb-4ceb-88f3-f35beeb13813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:31.753887 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912aa0d-35e7-40a1-9fbd-18c76523d1e6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-984b2935-86fb-4ceb-88f3-f35beeb13813 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:31.757414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:31.758435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:31.759267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:31.759267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:31.759267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:31.759267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:31.759267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:31.759267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:31.759267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:31.759267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:31.759267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:31.759267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:31.759267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:31.759267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:31.761615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 119/240] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:31.764080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0c82-99ab-442f-b8c6-7ac20ae4dd57 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.764528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0c82-99ab-442f-b8c6-7ac20ae4dd57 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.765268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0c82-99ab-442f-b8c6-7ac20ae4dd57 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.767104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 120/241] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:31.772244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc0c82-99ab-442f-b8c6-7ac20ae4dd57 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.794693 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f1a02-2af9-4534-bfa0-a53ca6d448cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.795418 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f1a02-2af9-4534-bfa0-a53ca6d448cf None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.795825 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f1a02-2af9-4534-bfa0-a53ca6d448cf None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.796774 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f1a02-2af9-4534-bfa0-a53ca6d448cf None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.797549 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f1a02-2af9-4534-bfa0-a53ca6d448cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.799420 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f1a02-2af9-4534-bfa0-a53ca6d448cf None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.828313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 122/242] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:31 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:31.833936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7bab0-b4f5-4b1a-847b-9c38523af0f2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.833936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7bab0-b4f5-4b1a-847b-9c38523af0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.833936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7bab0-b4f5-4b1a-847b-9c38523af0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.857845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-93f7bab0-b4f5-4b1a-847b-9c38523af0f2 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:31.859075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-93f7bab0-b4f5-4b1a-847b-9c38523af0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:31.921941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.940319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc0c82-99ab-442f-b8c6-7ac20ae4dd57 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.974331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b121c-5f1d-455f-b067-ce4fcf7e2d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.974945 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b121c-5f1d-455f-b067-ce4fcf7e2d77 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.975215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b121c-5f1d-455f-b067-ce4fcf7e2d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.975628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b121c-5f1d-455f-b067-ce4fcf7e2d77 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.976487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b121c-5f1d-455f-b067-ce4fcf7e2d77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:31.976674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b121c-5f1d-455f-b067-ce4fcf7e2d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.978081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b121c-5f1d-455f-b067-ce4fcf7e2d77 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.994781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 123/243] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:32.006529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 121/244] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:32.011986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7bab0-b4f5-4b1a-847b-9c38523af0f2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.031785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.151611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7bab0-b4f5-4b1a-847b-9c38523af0f2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.195836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8079905-44cb-40ee-b77d-bd45735443aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.196388 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079905-44cb-40ee-b77d-bd45735443aa None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.196667 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079905-44cb-40ee-b77d-bd45735443aa None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.196944 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079905-44cb-40ee-b77d-bd45735443aa None admin] PATH_INFO: `/v3/users/370d4aa759d64919bf9cb6be277cc9bb` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.213282 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8079905-44cb-40ee-b77d-bd45735443aa None admin] RBAC: Authorizing `identity:get_user(user_id=370d4aa759d64919bf9cb6be277cc9bb)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.214797 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8079905-44cb-40ee-b77d-bd45735443aa None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.216871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 124/245] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/users/370d4aa759d64919bf9cb6be277cc9bb => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:32.222418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b121c-5f1d-455f-b067-ce4fcf7e2d77 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.338630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b121c-5f1d-455f-b067-ce4fcf7e2d77 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.365113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8079905-44cb-40ee-b77d-bd45735443aa None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.383648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12753b-056c-41e6-b702-845b94e54540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.383648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12753b-056c-41e6-b702-845b94e54540 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.383930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12753b-056c-41e6-b702-845b94e54540 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.384183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12753b-056c-41e6-b702-845b94e54540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.409285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.447898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.469524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12753b-056c-41e6-b702-845b94e54540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.470867 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12753b-056c-41e6-b702-845b94e54540 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.494978 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8079905-44cb-40ee-b77d-bd45735443aa None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.541591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9c2a9-9159-4d52-88d2-ed9e622b44f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.542279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9c2a9-9159-4d52-88d2-ed9e622b44f1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.542555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9c2a9-9159-4d52-88d2-ed9e622b44f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.543528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9c2a9-9159-4d52-88d2-ed9e622b44f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.556377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9c2a9-9159-4d52-88d2-ed9e622b44f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9fe9c2a9-9159-4d52-88d2-ed9e622b44f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:32.562908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:32.563958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:32.564900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:32.564900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:32.564900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:32.564900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:32.564900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:32.564900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:32.564900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:32.564900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:32.564900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:32.564900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:32.564900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:32.564900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:32.564900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 125/246] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:32.569707 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9c2a9-9159-4d52-88d2-ed9e622b44f1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.596591 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 122/247] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:32.602441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12753b-056c-41e6-b702-845b94e54540 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.667549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.695201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9c2a9-9159-4d52-88d2-ed9e622b44f1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.721249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.736783 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12753b-056c-41e6-b702-845b94e54540 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.737474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06460418-cdd5-4869-863d-df8f71725901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.738306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06460418-cdd5-4869-863d-df8f71725901 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.738779 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06460418-cdd5-4869-863d-df8f71725901 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.739269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06460418-cdd5-4869-863d-df8f71725901 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.740270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06460418-cdd5-4869-863d-df8f71725901 None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:32.740778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06460418-cdd5-4869-863d-df8f71725901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.742439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06460418-cdd5-4869-863d-df8f71725901 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.753356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 126/248] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:32.761087 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06460418-cdd5-4869-863d-df8f71725901 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.795977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22385669-ecca-4c3b-a9f0-2bd8c46fa1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.796623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22385669-ecca-4c3b-a9f0-2bd8c46fa1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.796895 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22385669-ecca-4c3b-a9f0-2bd8c46fa1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.797161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22385669-ecca-4c3b-a9f0-2bd8c46fa1d0 None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.799762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22385669-ecca-4c3b-a9f0-2bd8c46fa1d0 None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.801230 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22385669-ecca-4c3b-a9f0-2bd8c46fa1d0 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.803102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 123/249] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:32.810316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f024f0d-738d-41e5-b17f-abb18612d809 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.810593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f024f0d-738d-41e5-b17f-abb18612d809 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.810862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f024f0d-738d-41e5-b17f-abb18612d809 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.815633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 124/250] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:32.816404 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f024f0d-738d-41e5-b17f-abb18612d809 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.955173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f024f0d-738d-41e5-b17f-abb18612d809 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.958401 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06460418-cdd5-4869-863d-df8f71725901 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.992387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:33.011985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7e920-d355-4f12-b902-279f5306142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.012865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7e920-d355-4f12-b902-279f5306142c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.013142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7e920-d355-4f12-b902-279f5306142c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.013430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7e920-d355-4f12-b902-279f5306142c None admin] PATH_INFO: `/v3/users/e79bc7e02b074c24b2333ceada77865c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.015296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7e920-d355-4f12-b902-279f5306142c None admin] RBAC: Authorizing `identity:get_user(user_id=e79bc7e02b074c24b2333ceada77865c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:33.017422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7e920-d355-4f12-b902-279f5306142c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:33.019729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 127/251] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/users/e79bc7e02b074c24b2333ceada77865c => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:33.021105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ded682-ee9e-4cd4-ab2d-ee767b7ed9ef None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.021386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ded682-ee9e-4cd4-ab2d-ee767b7ed9ef None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.021654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ded682-ee9e-4cd4-ab2d-ee767b7ed9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.032438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99935180-8c14-4760-8dc2-07d8f814b67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.033063 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99935180-8c14-4760-8dc2-07d8f814b67c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.033343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99935180-8c14-4760-8dc2-07d8f814b67c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.033609 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99935180-8c14-4760-8dc2-07d8f814b67c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.034356 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99935180-8c14-4760-8dc2-07d8f814b67c None admin] RBAC: Adding query filter params (role.id=f23c33107fdc4e839449e5bdf255e364, scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e, user.id=370d4aa759d64919bf9cb6be277cc9bb) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:33.034681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99935180-8c14-4760-8dc2-07d8f814b67c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:33.036193 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99935180-8c14-4760-8dc2-07d8f814b67c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:33.040853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-57ded682-ee9e-4cd4-ab2d-ee767b7ed9ef None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:33.042090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-57ded682-ee9e-4cd4-ab2d-ee767b7ed9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:33.050439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 125/252] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/role_assignments?user.id=370d4aa759d64919bf9cb6be277cc9bb&scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e&role.id=f23c33107fdc4e839449e5bdf255e364 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:33.051276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99935180-8c14-4760-8dc2-07d8f814b67c None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:33.100218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:33.121971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 128/253] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:33.240358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99935180-8c14-4760-8dc2-07d8f814b67c None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:33.286487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da46ca-912e-4ff7-9922-684d3e45633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.287054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da46ca-912e-4ff7-9922-684d3e45633f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.287329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da46ca-912e-4ff7-9922-684d3e45633f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.287599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da46ca-912e-4ff7-9922-684d3e45633f None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.288754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da46ca-912e-4ff7-9922-684d3e45633f None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:33.290229 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da46ca-912e-4ff7-9922-684d3e45633f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:33.292206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 126/254] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:33 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:33.298500 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ded682-ee9e-4cd4-ab2d-ee767b7ed9ef None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:33.399613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ded682-ee9e-4cd4-ab2d-ee767b7ed9ef None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:33.443038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556bd0f-38f1-4ec7-9b56-0a87d992b049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.444129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556bd0f-38f1-4ec7-9b56-0a87d992b049 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.444600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556bd0f-38f1-4ec7-9b56-0a87d992b049 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.445118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556bd0f-38f1-4ec7-9b56-0a87d992b049 None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e/users/e79bc7e02b074c24b2333ceada77865c/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.449203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fcdd8-4bc5-43ee-9846-24749960a712 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.449736 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fcdd8-4bc5-43ee-9846-24749960a712 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.450180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fcdd8-4bc5-43ee-9846-24749960a712 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.451743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 127/255] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:33.454172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556bd0f-38f1-4ec7-9b56-0a87d992b049 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d0c329e56b34ee385eebcfa74a51f6e, user_id=e79bc7e02b074c24b2333ceada77865c, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:33.455903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556bd0f-38f1-4ec7-9b56-0a87d992b049 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:33.464428 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f53cf-ae07-402a-8fda-82ec9ffe0f49 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.464975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f53cf-ae07-402a-8fda-82ec9ffe0f49 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.465448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f53cf-ae07-402a-8fda-82ec9ffe0f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.485300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 129/256] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:33 2022] PUT /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e/users/e79bc7e02b074c24b2333ceada77865c/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:33.497000 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-302f53cf-ae07-402a-8fda-82ec9ffe0f49 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:33.498236 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-302f53cf-ae07-402a-8fda-82ec9ffe0f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:33.588459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:33.616011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 128/257] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:33.695997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556bd0f-38f1-4ec7-9b56-0a87d992b049 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:33.749925 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:33.829356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556bd0f-38f1-4ec7-9b56-0a87d992b049 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:33.869647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092382b2-59b9-40ea-875f-f7a1c2b91104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.870318 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092382b2-59b9-40ea-875f-f7a1c2b91104 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.870606 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092382b2-59b9-40ea-875f-f7a1c2b91104 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.870883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092382b2-59b9-40ea-875f-f7a1c2b91104 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.884938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092382b2-59b9-40ea-875f-f7a1c2b91104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-092382b2-59b9-40ea-875f-f7a1c2b91104 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:33.890159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:33.891073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:33.891942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:33.891942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:33.891942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:33.891942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:33.891942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:33.891942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:33.891942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:33.891942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:33.891942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:33.891942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:33.891942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:33.891942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:33.891942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 130/258] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:33.898778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f53cf-ae07-402a-8fda-82ec9ffe0f49 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:34.052368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f53cf-ae07-402a-8fda-82ec9ffe0f49 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:34.082862 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092382b2-59b9-40ea-875f-f7a1c2b91104 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:34.094493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9bc82-0398-41cb-b140-ed3601e6e8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:34.095346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9bc82-0398-41cb-b140-ed3601e6e8bc None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.095833 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9bc82-0398-41cb-b140-ed3601e6e8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.096278 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9bc82-0398-41cb-b140-ed3601e6e8bc None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.097141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9bc82-0398-41cb-b140-ed3601e6e8bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:34.097609 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9bc82-0398-41cb-b140-ed3601e6e8bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:34.099152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9bc82-0398-41cb-b140-ed3601e6e8bc None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:34.108712 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 129/259] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:34.115796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9bc82-0398-41cb-b140-ed3601e6e8bc None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:34.192124 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:34.270774 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:34.273677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092382b2-59b9-40ea-875f-f7a1c2b91104 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:34.292968 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9bc82-0398-41cb-b140-ed3601e6e8bc None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:34.336454 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6b50b-2e9d-4482-8fa8-2cc777cc476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:34.337097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6b50b-2e9d-4482-8fa8-2cc777cc476e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.337369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6b50b-2e9d-4482-8fa8-2cc777cc476e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.337638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6b50b-2e9d-4482-8fa8-2cc777cc476e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.352866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924e8ce-bf80-4662-9012-c81d208f6d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:34.353504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e8ce-bf80-4662-9012-c81d208f6d15 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.353780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e8ce-bf80-4662-9012-c81d208f6d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.354047 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e8ce-bf80-4662-9012-c81d208f6d15 None admin] PATH_INFO: `/v3/users/7a0c08554afc4f608a1b331bc3ab0b32` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.355417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924e8ce-bf80-4662-9012-c81d208f6d15 None admin] RBAC: Authorizing `identity:get_user(user_id=7a0c08554afc4f608a1b331bc3ab0b32)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:34.356893 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924e8ce-bf80-4662-9012-c81d208f6d15 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:34.358693 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6b50b-2e9d-4482-8fa8-2cc777cc476e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:34.361113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 130/260] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:34 2022] GET /identity/v3/users/7a0c08554afc4f608a1b331bc3ab0b32 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7fb6b50b-2e9d-4482-8fa8-2cc777cc476e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:34.364082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:34.364961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:34.366204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:34.366204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:34.366204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:34.366204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:34.366204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:34.366204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:34.366204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:34.366204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:34.366204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:34.366204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:34.366204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:34.366204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:34.366204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 131/261] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:34.369205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924e8ce-bf80-4662-9012-c81d208f6d15 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:34.374956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6b50b-2e9d-4482-8fa8-2cc777cc476e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:34.555918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924e8ce-bf80-4662-9012-c81d208f6d15 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:34.563153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6b50b-2e9d-4482-8fa8-2cc777cc476e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:34.577505 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:34.614060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cffc4c-320d-424f-8b1a-3e52df786701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:34.614967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cffc4c-320d-424f-8b1a-3e52df786701 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.615587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cffc4c-320d-424f-8b1a-3e52df786701 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.616805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cffc4c-320d-424f-8b1a-3e52df786701 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.617641 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cffc4c-320d-424f-8b1a-3e52df786701 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:34.619341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cffc4c-320d-424f-8b1a-3e52df786701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:34.621859 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cffc4c-320d-424f-8b1a-3e52df786701 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:34.630027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443ca3b-d53d-4e4d-8bfd-fc9699fb2466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:34.630925 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ca3b-d53d-4e4d-8bfd-fc9699fb2466 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.631343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ca3b-d53d-4e4d-8bfd-fc9699fb2466 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.631776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ca3b-d53d-4e4d-8bfd-fc9699fb2466 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.645405 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 132/262] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:34.661498 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cffc4c-320d-424f-8b1a-3e52df786701 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:34.702492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:34.737395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443ca3b-d53d-4e4d-8bfd-fc9699fb2466 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:34.739096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443ca3b-d53d-4e4d-8bfd-fc9699fb2466 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:34.781375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cffc4c-320d-424f-8b1a-3e52df786701 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:34.816736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29347c83-f5e6-4141-a0e8-b5f30c2390e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:34.817406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29347c83-f5e6-4141-a0e8-b5f30c2390e1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.817565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29347c83-f5e6-4141-a0e8-b5f30c2390e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.817840 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29347c83-f5e6-4141-a0e8-b5f30c2390e1 None admin] PATH_INFO: `/v3/users/7a0c08554afc4f608a1b331bc3ab0b32` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.819073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29347c83-f5e6-4141-a0e8-b5f30c2390e1 None admin] RBAC: Authorizing `identity:get_user(user_id=7a0c08554afc4f608a1b331bc3ab0b32)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:34.820599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29347c83-f5e6-4141-a0e8-b5f30c2390e1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:34.822632 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 133/263] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:34 2022] GET /identity/v3/users/7a0c08554afc4f608a1b331bc3ab0b32 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:34.828523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29347c83-f5e6-4141-a0e8-b5f30c2390e1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:34.847463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 131/264] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:34.853268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443ca3b-d53d-4e4d-8bfd-fc9699fb2466 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:34.865133 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:34.923013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:34.935153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29347c83-f5e6-4141-a0e8-b5f30c2390e1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:34.958430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443ca3b-d53d-4e4d-8bfd-fc9699fb2466 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:34.970873 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12235db7-f810-40c4-91f5-163d0e58d3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:34.971720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12235db7-f810-40c4-91f5-163d0e58d3ed None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.972166 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12235db7-f810-40c4-91f5-163d0e58d3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.972571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12235db7-f810-40c4-91f5-163d0e58d3ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.993770 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c56b79-27e7-4048-bf5a-64d393c176a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:34.994403 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c56b79-27e7-4048-bf5a-64d393c176a2 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.994678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c56b79-27e7-4048-bf5a-64d393c176a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.994954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c56b79-27e7-4048-bf5a-64d393c176a2 None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.996380 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c56b79-27e7-4048-bf5a-64d393c176a2 None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:34.997704 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c56b79-27e7-4048-bf5a-64d393c176a2 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:34.999387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 132/265] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:34 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:35.005369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c56b79-27e7-4048-bf5a-64d393c176a2 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:35.044417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12235db7-f810-40c4-91f5-163d0e58d3ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:35.046289 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12235db7-f810-40c4-91f5-163d0e58d3ed None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:35.088032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:35.112029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c56b79-27e7-4048-bf5a-64d393c176a2 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:35.140558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:35.148194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd7966-e20c-4c6d-aa87-9b0f1ff6755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:35.148907 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd7966-e20c-4c6d-aa87-9b0f1ff6755a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:35.149240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd7966-e20c-4c6d-aa87-9b0f1ff6755a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:35.149568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd7966-e20c-4c6d-aa87-9b0f1ff6755a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:35.150360 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd7966-e20c-4c6d-aa87-9b0f1ff6755a None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e, user.id=7a0c08554afc4f608a1b331bc3ab0b32) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:35.150725 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd7966-e20c-4c6d-aa87-9b0f1ff6755a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:35.152294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd7966-e20c-4c6d-aa87-9b0f1ff6755a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:35.155121 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 134/266] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:35.158546 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 133/267] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:35 2022] GET /identity/v3/role_assignments?user.id=7a0c08554afc4f608a1b331bc3ab0b32&scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:35.161094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12235db7-f810-40c4-91f5-163d0e58d3ed None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:35.321156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12235db7-f810-40c4-91f5-163d0e58d3ed None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:35.367258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd541003-6341-4762-9031-4044ab6f99bd None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:35.367566 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd541003-6341-4762-9031-4044ab6f99bd None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:35.367838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd541003-6341-4762-9031-4044ab6f99bd None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:35.369203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 134/268] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:35.373913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef51544-6df4-47e5-a119-039e0ed0488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:35.374300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87c17-6e6e-4a33-bb57-8bd3d8fc84a1 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:35.374588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87c17-6e6e-4a33-bb57-8bd3d8fc84a1 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:35.374686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef51544-6df4-47e5-a119-039e0ed0488e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:35.374849 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87c17-6e6e-4a33-bb57-8bd3d8fc84a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:35.374939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef51544-6df4-47e5-a119-039e0ed0488e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:35.375140 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef51544-6df4-47e5-a119-039e0ed0488e None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:35.376378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef51544-6df4-47e5-a119-039e0ed0488e None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:35.377833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef51544-6df4-47e5-a119-039e0ed0488e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:35.379670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 135/269] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:35 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:35.385304 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef51544-6df4-47e5-a119-039e0ed0488e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:35.411081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-2ac87c17-6e6e-4a33-bb57-8bd3d8fc84a1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:35.412891 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2ac87c17-6e6e-4a33-bb57-8bd3d8fc84a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:35.503488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:35.520257 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 135/270] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:35.521527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae654d1-ddd4-4027-b149-9ccfc2a5f3ab None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:35.521813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae654d1-ddd4-4027-b149-9ccfc2a5f3ab None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:35.522874 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae654d1-ddd4-4027-b149-9ccfc2a5f3ab None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:35.528843 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 136/271] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:35.530457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf1c15-403b-4ac4-b303-a9b9f2fd9417 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:35.530932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf1c15-403b-4ac4-b303-a9b9f2fd9417 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:35.533534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf1c15-403b-4ac4-b303-a9b9f2fd9417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:35.561109 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-99cf1c15-403b-4ac4-b303-a9b9f2fd9417 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:35.562536 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-99cf1c15-403b-4ac4-b303-a9b9f2fd9417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:35.581514 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef51544-6df4-47e5-a119-039e0ed0488e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:35.644122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfed72-7afe-497e-ab7d-23ecebbe685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:35.644655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfed72-7afe-497e-ab7d-23ecebbe685c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:35.644939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfed72-7afe-497e-ab7d-23ecebbe685c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:35.645206 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfed72-7afe-497e-ab7d-23ecebbe685c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:35.645997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfed72-7afe-497e-ab7d-23ecebbe685c None admin] RBAC: Adding query filter params (role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1, scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e, user.id=7a0c08554afc4f608a1b331bc3ab0b32) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:35.646307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfed72-7afe-497e-ab7d-23ecebbe685c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:35.647769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfed72-7afe-497e-ab7d-23ecebbe685c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:35.656441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 136/272] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:35 2022] GET /identity/v3/role_assignments?user.id=7a0c08554afc4f608a1b331bc3ab0b32&scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e&role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:35.676914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 137/273] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:35.903540 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfed72-7afe-497e-ab7d-23ecebbe685c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:36.011279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfed72-7afe-497e-ab7d-23ecebbe685c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:36.021918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf1c15-403b-4ac4-b303-a9b9f2fd9417 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:36.024295 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:36.044803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:36.062941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b3b5f-6bca-4545-933b-1a18dd686606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:36.063600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b3b5f-6bca-4545-933b-1a18dd686606 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.063920 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b3b5f-6bca-4545-933b-1a18dd686606 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.064195 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b3b5f-6bca-4545-933b-1a18dd686606 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.076820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b3b5f-6bca-4545-933b-1a18dd686606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-510b3b5f-6bca-4545-933b-1a18dd686606 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:36.083457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:36.084603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:36.085638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:36.085638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:36.085638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:36.085638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:36.085638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:36.085638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:36.085638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:36.085638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:36.085638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:36.085638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:36.085638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:36.085638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:36.085638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 137/274] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:36.087089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff6882-b45e-4182-ab50-880655ab83d8 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.087089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff6882-b45e-4182-ab50-880655ab83d8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.087089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff6882-b45e-4182-ab50-880655ab83d8 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.088605 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 138/275] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:36.093074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff6882-b45e-4182-ab50-880655ab83d8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:36.164810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf1c15-403b-4ac4-b303-a9b9f2fd9417 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:36.200727 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc9e27-4e1a-4f16-82d8-cd14024b106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:36.201370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc9e27-4e1a-4f16-82d8-cd14024b106c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.201651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc9e27-4e1a-4f16-82d8-cd14024b106c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.201922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc9e27-4e1a-4f16-82d8-cd14024b106c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.203052 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc9e27-4e1a-4f16-82d8-cd14024b106c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:36.204617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc9e27-4e1a-4f16-82d8-cd14024b106c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:36.206466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 138/276] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:36.207433 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2718e0-13af-489f-9b5c-3938e90a29c5 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.207757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2718e0-13af-489f-9b5c-3938e90a29c5 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.208105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2718e0-13af-489f-9b5c-3938e90a29c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.219470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff6882-b45e-4182-ab50-880655ab83d8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:36.226630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-be2718e0-13af-489f-9b5c-3938e90a29c5 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:36.227857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-be2718e0-13af-489f-9b5c-3938e90a29c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:36.259134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58faa2a-d42a-465e-a34f-14fb22f0b02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:36.259776 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58faa2a-d42a-465e-a34f-14fb22f0b02d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.260060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58faa2a-d42a-465e-a34f-14fb22f0b02d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.260343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58faa2a-d42a-465e-a34f-14fb22f0b02d None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.261005 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58faa2a-d42a-465e-a34f-14fb22f0b02d None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:36.261444 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58faa2a-d42a-465e-a34f-14fb22f0b02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:36.263185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58faa2a-d42a-465e-a34f-14fb22f0b02d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:36.277495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 139/277] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:36.277495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58faa2a-d42a-465e-a34f-14fb22f0b02d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:36.298306 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:36.304531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 139/278] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:36.305248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2718e0-13af-489f-9b5c-3938e90a29c5 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:36.336821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:36.394438 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58faa2a-d42a-465e-a34f-14fb22f0b02d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:36.415339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2718e0-13af-489f-9b5c-3938e90a29c5 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:36.430529 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c584dc6-960f-4c34-83b6-7e592188823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:36.431144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584dc6-960f-4c34-83b6-7e592188823a None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.431424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584dc6-960f-4c34-83b6-7e592188823a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.431722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584dc6-960f-4c34-83b6-7e592188823a None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.432385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c584dc6-960f-4c34-83b6-7e592188823a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:36.433892 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c584dc6-960f-4c34-83b6-7e592188823a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:36.454027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d589f-5398-487a-9294-bb7a6b4f6104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:36.454706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d589f-5398-487a-9294-bb7a6b4f6104 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.454995 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d589f-5398-487a-9294-bb7a6b4f6104 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.455264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d589f-5398-487a-9294-bb7a6b4f6104 None admin] PATH_INFO: `/v3/users/c756239ae8f448f0a360955607332164` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.456724 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 140/279] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:36 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:36.458180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918ad97-56a4-422e-b2ad-267d72ea0923 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.458537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918ad97-56a4-422e-b2ad-267d72ea0923 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.458876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918ad97-56a4-422e-b2ad-267d72ea0923 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.460388 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 141/280] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:36.466687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff6282-618d-4d46-8cac-3d14c8dbb063 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.466963 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff6282-618d-4d46-8cac-3d14c8dbb063 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.467241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff6282-618d-4d46-8cac-3d14c8dbb063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.480321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d589f-5398-487a-9294-bb7a6b4f6104 None admin] RBAC: Authorizing `identity:get_user(user_id=c756239ae8f448f0a360955607332164)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:36.482118 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d589f-5398-487a-9294-bb7a6b4f6104 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:36.484138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 140/281] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:36 2022] GET /identity/v3/users/c756239ae8f448f0a360955607332164 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:36.490327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d589f-5398-487a-9294-bb7a6b4f6104 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:36.490667 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d5ff6282-618d-4d46-8cac-3d14c8dbb063 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:36.492213 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d5ff6282-618d-4d46-8cac-3d14c8dbb063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:36.561084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:36.575174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 142/282] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:36.576074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff6282-618d-4d46-8cac-3d14c8dbb063 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:36.617718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d589f-5398-487a-9294-bb7a6b4f6104 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:36.617923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:36.662419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004eecb-de8c-4acc-a949-a7faa5f1057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:36.662419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004eecb-de8c-4acc-a949-a7faa5f1057b None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.662748 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004eecb-de8c-4acc-a949-a7faa5f1057b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.663023 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004eecb-de8c-4acc-a949-a7faa5f1057b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.663824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004eecb-de8c-4acc-a949-a7faa5f1057b None admin] RBAC: Adding query filter params (role.id=8615852d81aa46c39661d01a0372d8e8, user.id=c756239ae8f448f0a360955607332164, scope.system=all) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:36.664135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004eecb-de8c-4acc-a949-a7faa5f1057b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:36.665650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004eecb-de8c-4acc-a949-a7faa5f1057b None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:36.672567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 141/283] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Aug 31 00:07:36 2022] GET /identity/v3/role_assignments?user.id=c756239ae8f448f0a360955607332164&scope.system=all&role.id=8615852d81aa46c39661d01a0372d8e8 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:36.721460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff6282-618d-4d46-8cac-3d14c8dbb063 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:36.761726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dbaaa-3441-4a84-8c02-9ea22a5069bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:36.762391 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dbaaa-3441-4a84-8c02-9ea22a5069bb None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.762671 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dbaaa-3441-4a84-8c02-9ea22a5069bb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.762946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dbaaa-3441-4a84-8c02-9ea22a5069bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.775318 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9dbaaa-3441-4a84-8c02-9ea22a5069bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-be9dbaaa-3441-4a84-8c02-9ea22a5069bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:36.780370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:36.781352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:36.782473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:36.782473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:36.782473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:36.782473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:36.782473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:36.782473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:36.782473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:36.782473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:36.782473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:36.782473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:36.782473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:36.782473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:36.782473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 143/284] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:36.787423 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004eecb-de8c-4acc-a949-a7faa5f1057b None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:36.856455 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dbaaa-3441-4a84-8c02-9ea22a5069bb None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:36.921946 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004eecb-de8c-4acc-a949-a7faa5f1057b None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:36.946815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:36.959890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31afad6-6b1b-4af2-a8a1-12c5457c9b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:36.960621 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31afad6-6b1b-4af2-a8a1-12c5457c9b9a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.960972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31afad6-6b1b-4af2-a8a1-12c5457c9b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.961316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31afad6-6b1b-4af2-a8a1-12c5457c9b9a None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.961999 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31afad6-6b1b-4af2-a8a1-12c5457c9b9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:36.962303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31afad6-6b1b-4af2-a8a1-12c5457c9b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:36.963713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31afad6-6b1b-4af2-a8a1-12c5457c9b9a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:36.972708 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 142/285] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:36.981688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31afad6-6b1b-4af2-a8a1-12c5457c9b9a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:36.988362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:36.999528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dbaaa-3441-4a84-8c02-9ea22a5069bb None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.037064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ff701-62eb-4de2-88a2-b8d81089f654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.037727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff701-62eb-4de2-88a2-b8d81089f654 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.038097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff701-62eb-4de2-88a2-b8d81089f654 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.038371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff701-62eb-4de2-88a2-b8d81089f654 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.050099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ff701-62eb-4de2-88a2-b8d81089f654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-a34ff701-62eb-4de2-88a2-b8d81089f654 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:37.055387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:37.056331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:37.057340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:37.057340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:37.057340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:37.057340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:37.057340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:37.057340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:37.057340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:37.057340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:37.057340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:37.057340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:37.057340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:37.057340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:37.057340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 144/286] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:37.068791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ff701-62eb-4de2-88a2-b8d81089f654 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:37.091135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31afad6-6b1b-4af2-a8a1-12c5457c9b9a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.127019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233a68b-8bf7-457f-a8a6-4f8b040b3128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.127663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a68b-8bf7-457f-a8a6-4f8b040b3128 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.127971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a68b-8bf7-457f-a8a6-4f8b040b3128 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.128247 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a68b-8bf7-457f-a8a6-4f8b040b3128 None admin] PATH_INFO: `/v3/users/370d4aa759d64919bf9cb6be277cc9bb` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.129399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233a68b-8bf7-457f-a8a6-4f8b040b3128 None admin] RBAC: Authorizing `identity:get_user(user_id=370d4aa759d64919bf9cb6be277cc9bb)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.130931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233a68b-8bf7-457f-a8a6-4f8b040b3128 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.132991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 143/287] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:36 2022] GET /identity/v3/users/370d4aa759d64919bf9cb6be277cc9bb => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:37.140686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233a68b-8bf7-457f-a8a6-4f8b040b3128 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:37.240073 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:37.259667 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ff701-62eb-4de2-88a2-b8d81089f654 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.289257 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233a68b-8bf7-457f-a8a6-4f8b040b3128 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.322941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba84c3-5f9c-44fc-8206-81449d7b108f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.323830 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba84c3-5f9c-44fc-8206-81449d7b108f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.324216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba84c3-5f9c-44fc-8206-81449d7b108f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.324590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba84c3-5f9c-44fc-8206-81449d7b108f None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.325095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46725c86-01d7-47bd-afed-5fdd993bff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.325296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba84c3-5f9c-44fc-8206-81449d7b108f None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:37.325581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba84c3-5f9c-44fc-8206-81449d7b108f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.325752 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46725c86-01d7-47bd-afed-5fdd993bff65 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.325996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46725c86-01d7-47bd-afed-5fdd993bff65 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.326263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46725c86-01d7-47bd-afed-5fdd993bff65 None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.327079 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba84c3-5f9c-44fc-8206-81449d7b108f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.327376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46725c86-01d7-47bd-afed-5fdd993bff65 None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.328854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46725c86-01d7-47bd-afed-5fdd993bff65 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.330489 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 144/288] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:37 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:37.336548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46725c86-01d7-47bd-afed-5fdd993bff65 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:37.350028 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 145/289] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:37.360751 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba84c3-5f9c-44fc-8206-81449d7b108f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:37.405505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:37.445440 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46725c86-01d7-47bd-afed-5fdd993bff65 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.480157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:37.489024 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7a56d-088f-4636-b97a-b9d374604027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.489705 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7a56d-088f-4636-b97a-b9d374604027 None admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.489978 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7a56d-088f-4636-b97a-b9d374604027 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.490300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7a56d-088f-4636-b97a-b9d374604027 None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e/users/370d4aa759d64919bf9cb6be277cc9bb/roles/f23c33107fdc4e839449e5bdf255e364` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.492562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7a56d-088f-4636-b97a-b9d374604027 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d0c329e56b34ee385eebcfa74a51f6e, user_id=370d4aa759d64919bf9cb6be277cc9bb, role_id=f23c33107fdc4e839449e5bdf255e364)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.496382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7a56d-088f-4636-b97a-b9d374604027 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.518223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 145/290] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:37 2022] PUT /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e/users/370d4aa759d64919bf9cb6be277cc9bb/roles/f23c33107fdc4e839449e5bdf255e364 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:37.570989 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba84c3-5f9c-44fc-8206-81449d7b108f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.619423 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb261f6-1a6d-499a-81c5-44961fac6ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.620137 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb261f6-1a6d-499a-81c5-44961fac6ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.620419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb261f6-1a6d-499a-81c5-44961fac6ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.620730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb261f6-1a6d-499a-81c5-44961fac6ac2 None admin] PATH_INFO: `/v3/users/e79bc7e02b074c24b2333ceada77865c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.621913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb261f6-1a6d-499a-81c5-44961fac6ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=e79bc7e02b074c24b2333ceada77865c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.623392 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb261f6-1a6d-499a-81c5-44961fac6ac2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.625226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 146/291] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:37 2022] GET /identity/v3/users/e79bc7e02b074c24b2333ceada77865c => generated 297 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:37.630862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7a56d-088f-4636-b97a-b9d374604027 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:37.784814 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7a56d-088f-4636-b97a-b9d374604027 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.836100 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6655d7e-9ff1-4240-806f-071a77f53fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.836731 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6655d7e-9ff1-4240-806f-071a77f53fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.837004 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6655d7e-9ff1-4240-806f-071a77f53fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.837272 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6655d7e-9ff1-4240-806f-071a77f53fe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.896300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:37.920386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6655d7e-9ff1-4240-806f-071a77f53fe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.921885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6655d7e-9ff1-4240-806f-071a77f53fe3 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:38.058505 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 146/292] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:38.064380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb261f6-1a6d-499a-81c5-44961fac6ac2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:38.172207 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:38.197661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb261f6-1a6d-499a-81c5-44961fac6ac2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:38.237603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850fba5-8e6f-43f1-a872-0606bcb16ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:38.238243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850fba5-8e6f-43f1-a872-0606bcb16ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:38.238526 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850fba5-8e6f-43f1-a872-0606bcb16ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:38.238805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850fba5-8e6f-43f1-a872-0606bcb16ff4 None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:38.240007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850fba5-8e6f-43f1-a872-0606bcb16ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:38.241509 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850fba5-8e6f-43f1-a872-0606bcb16ff4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:38.243156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 147/293] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:38 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:38.249344 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6655d7e-9ff1-4240-806f-071a77f53fe3 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:38.354611 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:38.379497 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6655d7e-9ff1-4240-806f-071a77f53fe3 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:38.414338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757f457-5882-4b8e-8c70-c72cfd442fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:38.415324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757f457-5882-4b8e-8c70-c72cfd442fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:38.415868 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757f457-5882-4b8e-8c70-c72cfd442fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:38.416342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757f457-5882-4b8e-8c70-c72cfd442fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:38.417268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757f457-5882-4b8e-8c70-c72cfd442fd6 None admin] RBAC: Adding query filter params (role.id=8615852d81aa46c39661d01a0372d8e8, scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e, user.id=e79bc7e02b074c24b2333ceada77865c) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:38.417802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757f457-5882-4b8e-8c70-c72cfd442fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:38.419528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757f457-5882-4b8e-8c70-c72cfd442fd6 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:38.426251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 147/294] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:38 2022] GET /identity/v3/role_assignments?user.id=e79bc7e02b074c24b2333ceada77865c&scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e&role.id=8615852d81aa46c39661d01a0372d8e8 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:38.892058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b2aff-d7c2-4dd8-af97-bd39f24214fb None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:38.893082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b2aff-d7c2-4dd8-af97-bd39f24214fb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:38.893571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b2aff-d7c2-4dd8-af97-bd39f24214fb None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:38.895118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 148/295] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:38.901443 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9f244-680e-4c1e-98e0-ad5cf24908a4 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:38.902009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9f244-680e-4c1e-98e0-ad5cf24908a4 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:38.902485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9f244-680e-4c1e-98e0-ad5cf24908a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:38.922573 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7fc9f244-680e-4c1e-98e0-ad5cf24908a4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:38.924130 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7fc9f244-680e-4c1e-98e0-ad5cf24908a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:38.987865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf117e77-74fd-441a-ba6f-dbe167dfb605 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:38.988174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf117e77-74fd-441a-ba6f-dbe167dfb605 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:38.988412 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf117e77-74fd-441a-ba6f-dbe167dfb605 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:38.990011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 149/296] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:38.994839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580d690-9fba-4cb0-8768-d96dd268d49f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:38.995123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580d690-9fba-4cb0-8768-d96dd268d49f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:38.995395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580d690-9fba-4cb0-8768-d96dd268d49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.002862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 148/297] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:39.027861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a5bc6-4399-44b6-a91b-2206d2756f08 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.028158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a5bc6-4399-44b6-a91b-2206d2756f08 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.028422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a5bc6-4399-44b6-a91b-2206d2756f08 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.028542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4580d690-9fba-4cb0-8768-d96dd268d49f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:39.029733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4580d690-9fba-4cb0-8768-d96dd268d49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:39.029909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 149/298] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:39.035129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a30aa-b2f0-43c6-bb55-537530c763d3 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.035412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a30aa-b2f0-43c6-bb55-537530c763d3 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.035687 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a30aa-b2f0-43c6-bb55-537530c763d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.054698 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5f9a30aa-b2f0-43c6-bb55-537530c763d3 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:39.055930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5f9a30aa-b2f0-43c6-bb55-537530c763d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:39.116975 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 150/299] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:39.141575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 150/300] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:39.272149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580d690-9fba-4cb0-8768-d96dd268d49f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:39.356694 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:39.379206 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580d690-9fba-4cb0-8768-d96dd268d49f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:39.409734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a30aa-b2f0-43c6-bb55-537530c763d3 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:39.414769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3b0b5-bf7f-4bcf-89e2-aea2d3af446f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:39.414933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:39.415013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3b0b5-bf7f-4bcf-89e2-aea2d3af446f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.415013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3b0b5-bf7f-4bcf-89e2-aea2d3af446f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.415180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3b0b5-bf7f-4bcf-89e2-aea2d3af446f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.425807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3b0b5-bf7f-4bcf-89e2-aea2d3af446f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-29e3b0b5-bf7f-4bcf-89e2-aea2d3af446f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:39.430715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:39.431600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:39.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:39.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:39.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:39.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:39.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:39.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:39.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:39.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:39.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:39.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:39.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:39.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:39.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 151/301] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:39.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3b0b5-bf7f-4bcf-89e2-aea2d3af446f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:39.521317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a30aa-b2f0-43c6-bb55-537530c763d3 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:39.544492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3b0b5-bf7f-4bcf-89e2-aea2d3af446f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:39.556903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08519f32-1a1d-4408-9fb4-5a604039dc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:39.557536 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519f32-1a1d-4408-9fb4-5a604039dc0b None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.557813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519f32-1a1d-4408-9fb4-5a604039dc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.558075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519f32-1a1d-4408-9fb4-5a604039dc0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.559223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08519f32-1a1d-4408-9fb4-5a604039dc0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:39.561017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08519f32-1a1d-4408-9fb4-5a604039dc0b None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:39.562753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 151/302] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:39.564573 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08519f32-1a1d-4408-9fb4-5a604039dc0b None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:39.581125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4c4f-9d5f-4df5-959b-668f78c31b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:39.581761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4c4f-9d5f-4df5-959b-668f78c31b27 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.582038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4c4f-9d5f-4df5-959b-668f78c31b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.582310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4c4f-9d5f-4df5-959b-668f78c31b27 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.589752 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:39.597901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a4c4f-9d5f-4df5-959b-668f78c31b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-228a4c4f-9d5f-4df5-959b-668f78c31b27 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:39.606338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:39.607378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:39.613603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:39.613603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:39.613603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:39.613603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:39.613603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:39.613603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:39.613603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:39.613603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:39.613603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:39.613603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:39.613603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:39.613603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:39.613603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 152/303] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:39.613603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4c4f-9d5f-4df5-959b-668f78c31b27 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:39.650062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:39.681688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08519f32-1a1d-4408-9fb4-5a604039dc0b None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:39.715672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4c4f-9d5f-4df5-959b-668f78c31b27 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:39.716200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffac671-2cb7-4093-b1f9-b3f7958ca57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:39.716818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffac671-2cb7-4093-b1f9-b3f7958ca57a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.717108 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffac671-2cb7-4093-b1f9-b3f7958ca57a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.717377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffac671-2cb7-4093-b1f9-b3f7958ca57a None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.718040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffac671-2cb7-4093-b1f9-b3f7958ca57a None admin] RBAC: Adding query filter params (name=member) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:39.718338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffac671-2cb7-4093-b1f9-b3f7958ca57a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:39.719763 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffac671-2cb7-4093-b1f9-b3f7958ca57a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:39.733006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 152/304] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:39.733006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffac671-2cb7-4093-b1f9-b3f7958ca57a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:39.756625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619ae96-b413-40ab-8c30-41f3e7dfc1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:39.757251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619ae96-b413-40ab-8c30-41f3e7dfc1fb None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.757532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619ae96-b413-40ab-8c30-41f3e7dfc1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.757811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619ae96-b413-40ab-8c30-41f3e7dfc1fb None admin] PATH_INFO: `/v3/groups` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.758454 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619ae96-b413-40ab-8c30-41f3e7dfc1fb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:39.759972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619ae96-b413-40ab-8c30-41f3e7dfc1fb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:39.779577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 153/305] 10.222.0.50 () {60 vars in 1134 bytes} [Wed Aug 31 00:07:39 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:39.780447 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619ae96-b413-40ab-8c30-41f3e7dfc1fb None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:39.856518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:39.860268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffac671-2cb7-4093-b1f9-b3f7958ca57a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:39.901405 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdfe1e-6441-4a5f-bae5-4452afd73004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:39.902120 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdfe1e-6441-4a5f-bae5-4452afd73004 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.902451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdfe1e-6441-4a5f-bae5-4452afd73004 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.902749 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdfe1e-6441-4a5f-bae5-4452afd73004 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.903542 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdfe1e-6441-4a5f-bae5-4452afd73004 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:39.903881 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdfe1e-6441-4a5f-bae5-4452afd73004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:39.905389 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdfe1e-6441-4a5f-bae5-4452afd73004 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:39.907149 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:39.911691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619ae96-b413-40ab-8c30-41f3e7dfc1fb None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:39.916904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 153/306] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:39.922638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdfe1e-6441-4a5f-bae5-4452afd73004 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:39.953922 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b7bac-2a5a-42ad-9911-3bbea5f2471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:39.954869 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b7bac-2a5a-42ad-9911-3bbea5f2471b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.955322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b7bac-2a5a-42ad-9911-3bbea5f2471b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.955887 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b7bac-2a5a-42ad-9911-3bbea5f2471b None admin] PATH_INFO: `/v3/users/c756239ae8f448f0a360955607332164` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.957274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b7bac-2a5a-42ad-9911-3bbea5f2471b None admin] RBAC: Authorizing `identity:get_user(user_id=c756239ae8f448f0a360955607332164)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:39.959142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b7bac-2a5a-42ad-9911-3bbea5f2471b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:39.961051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 154/307] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:39 2022] GET /identity/v3/users/c756239ae8f448f0a360955607332164 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:39.968322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b7bac-2a5a-42ad-9911-3bbea5f2471b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.040332 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdfe1e-6441-4a5f-bae5-4452afd73004 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.071338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b7bac-2a5a-42ad-9911-3bbea5f2471b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.073520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc1315-5025-4857-9276-00c1f92f96de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.074985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1315-5025-4857-9276-00c1f92f96de None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.074985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1315-5025-4857-9276-00c1f92f96de None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.074985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1315-5025-4857-9276-00c1f92f96de None admin] PATH_INFO: `/v3/users/bcdc557d540c49218011f11c5e6ae4b4` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.088461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc1315-5025-4857-9276-00c1f92f96de None admin] RBAC: Authorizing `identity:get_user(user_id=bcdc557d540c49218011f11c5e6ae4b4)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:40.090071 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc1315-5025-4857-9276-00c1f92f96de None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:40.091768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 154/308] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:39 2022] GET /identity/v3/users/bcdc557d540c49218011f11c5e6ae4b4 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:40.093010 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed51f0-e494-4045-a621-e564250ab11d None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.093295 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed51f0-e494-4045-a621-e564250ab11d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.093568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed51f0-e494-4045-a621-e564250ab11d None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.094922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 155/309] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:40.099584 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed51f0-e494-4045-a621-e564250ab11d None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.104181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:40.117149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac04707-361d-4d96-9d81-721cf77379ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.117810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac04707-361d-4d96-9d81-721cf77379ba None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.118092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac04707-361d-4d96-9d81-721cf77379ba None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.118371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac04707-361d-4d96-9d81-721cf77379ba None admin] PATH_INFO: `/v3/system/users/c756239ae8f448f0a360955607332164/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.120073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac04707-361d-4d96-9d81-721cf77379ba None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c756239ae8f448f0a360955607332164, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:40.121501 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac04707-361d-4d96-9d81-721cf77379ba None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:40.135796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 155/310] 10.222.0.50 () {58 vars in 1334 bytes} [Wed Aug 31 00:07:39 2022] PUT /identity/v3/system/users/c756239ae8f448f0a360955607332164/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:07:40.137523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdecc5-e680-44f6-8939-2f394196cb27 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.137808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdecc5-e680-44f6-8939-2f394196cb27 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.138085 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdecc5-e680-44f6-8939-2f394196cb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.172660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:40.174257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-62cdecc5-e680-44f6-8939-2f394196cb27 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:40.176191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-62cdecc5-e680-44f6-8939-2f394196cb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:40.234350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed51f0-e494-4045-a621-e564250ab11d None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.268134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 156/311] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:40.274911 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330df194-884d-491c-82c4-775d15ce5efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.275906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330df194-884d-491c-82c4-775d15ce5efc None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.276397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330df194-884d-491c-82c4-775d15ce5efc None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.276854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330df194-884d-491c-82c4-775d15ce5efc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.277930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330df194-884d-491c-82c4-775d15ce5efc None admin] RBAC: Adding query filter params (role.id=f23c33107fdc4e839449e5bdf255e364, user.id=bcdc557d540c49218011f11c5e6ae4b4, scope.system=all) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:40.278432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330df194-884d-491c-82c4-775d15ce5efc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:40.280534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330df194-884d-491c-82c4-775d15ce5efc None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:40.287282 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 156/312] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/role_assignments?user.id=bcdc557d540c49218011f11c5e6ae4b4&scope.system=all&role.id=f23c33107fdc4e839449e5bdf255e364 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:40.530859 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdecc5-e680-44f6-8939-2f394196cb27 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.636744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdecc5-e680-44f6-8939-2f394196cb27 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.657303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:40.672920 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff87ff-bb78-4056-90b5-db020c554444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.673556 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff87ff-bb78-4056-90b5-db020c554444 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.673831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff87ff-bb78-4056-90b5-db020c554444 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.674098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff87ff-bb78-4056-90b5-db020c554444 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.685181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff87ff-bb78-4056-90b5-db020c554444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-8eff87ff-bb78-4056-90b5-db020c554444 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:40.689948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:40.690807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:40.692057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:40.692057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:40.692057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:40.692057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:40.692057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:40.692057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:40.692057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:40.692057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:40.692057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:40.692057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:40.692057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:40.692057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:40.692057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 157/313] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:40.697251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330df194-884d-491c-82c4-775d15ce5efc None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.804205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330df194-884d-491c-82c4-775d15ce5efc None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.822604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:40.841735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bf2a9-35ee-419b-b2da-ecfd7c4f1754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.842352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bf2a9-35ee-419b-b2da-ecfd7c4f1754 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.842630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bf2a9-35ee-419b-b2da-ecfd7c4f1754 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.842900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bf2a9-35ee-419b-b2da-ecfd7c4f1754 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.843577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bf2a9-35ee-419b-b2da-ecfd7c4f1754 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:40.843909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bf2a9-35ee-419b-b2da-ecfd7c4f1754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:40.845286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bf2a9-35ee-419b-b2da-ecfd7c4f1754 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:40.854326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 157/314] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:40.860012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff87ff-bb78-4056-90b5-db020c554444 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.971143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff87ff-bb78-4056-90b5-db020c554444 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:41.006244 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8435e2-8629-40e7-9656-0c07b4167cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:41.007205 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8435e2-8629-40e7-9656-0c07b4167cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.007754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8435e2-8629-40e7-9656-0c07b4167cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.008220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8435e2-8629-40e7-9656-0c07b4167cb7 None admin] PATH_INFO: `/v3/users/370d4aa759d64919bf9cb6be277cc9bb` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.009580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8435e2-8629-40e7-9656-0c07b4167cb7 None admin] RBAC: Authorizing `identity:get_user(user_id=370d4aa759d64919bf9cb6be277cc9bb)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:41.011283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8435e2-8629-40e7-9656-0c07b4167cb7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:41.013546 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 158/315] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/users/370d4aa759d64919bf9cb6be277cc9bb => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:41.019206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bf2a9-35ee-419b-b2da-ecfd7c4f1754 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:41.123371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bf2a9-35ee-419b-b2da-ecfd7c4f1754 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:41.157085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7dc55-d4c0-4e9e-af7c-11440cccdbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:41.157715 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7dc55-d4c0-4e9e-af7c-11440cccdbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.157996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7dc55-d4c0-4e9e-af7c-11440cccdbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.158271 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7dc55-d4c0-4e9e-af7c-11440cccdbf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.214025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:41.236434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7dc55-d4c0-4e9e-af7c-11440cccdbf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:41.237903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7dc55-d4c0-4e9e-af7c-11440cccdbf9 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:41.337754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 158/316] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:07:41.343684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8435e2-8629-40e7-9656-0c07b4167cb7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:41.395204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:41.448431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8435e2-8629-40e7-9656-0c07b4167cb7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:41.482890 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f321b10-1f88-45c3-b43d-9823fd45d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:41.483528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f321b10-1f88-45c3-b43d-9823fd45d6aa None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.483833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f321b10-1f88-45c3-b43d-9823fd45d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.484107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f321b10-1f88-45c3-b43d-9823fd45d6aa None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.485228 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f321b10-1f88-45c3-b43d-9823fd45d6aa None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:41.486678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f321b10-1f88-45c3-b43d-9823fd45d6aa None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:41.488647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 159/317] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:41 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:41.496861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7dc55-d4c0-4e9e-af7c-11440cccdbf9 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:41.580337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:41.599291 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7dc55-d4c0-4e9e-af7c-11440cccdbf9 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:41.639334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a645c36-85b3-4951-9cca-541ab113937c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:41.639978 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645c36-85b3-4951-9cca-541ab113937c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.640259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645c36-85b3-4951-9cca-541ab113937c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.640530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645c36-85b3-4951-9cca-541ab113937c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.641332 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a645c36-85b3-4951-9cca-541ab113937c None admin] RBAC: Adding query filter params (role.id=f23c33107fdc4e839449e5bdf255e364, scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e, user.id=370d4aa759d64919bf9cb6be277cc9bb) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:41.641641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a645c36-85b3-4951-9cca-541ab113937c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:41.643084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a645c36-85b3-4951-9cca-541ab113937c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:41.649687 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 159/318] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:41 2022] GET /identity/v3/role_assignments?user.id=370d4aa759d64919bf9cb6be277cc9bb&scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e&role.id=f23c33107fdc4e839449e5bdf255e364 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:41.787184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccde94-6889-4025-a218-708d208f1bbd None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.787520 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccde94-6889-4025-a218-708d208f1bbd None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.787742 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccde94-6889-4025-a218-708d208f1bbd None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.789220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 160/319] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:41.795266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3e09a-6791-476b-b665-f37c99b79064 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.796167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3e09a-6791-476b-b665-f37c99b79064 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.796462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3e09a-6791-476b-b665-f37c99b79064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.816397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-08a3e09a-6791-476b-b665-f37c99b79064 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:41.817895 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-08a3e09a-6791-476b-b665-f37c99b79064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:41.891867 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 160/320] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:42.132491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b1501-4fc0-425d-ba6b-cd1adb51bdeb None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.133017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b1501-4fc0-425d-ba6b-cd1adb51bdeb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.133017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b1501-4fc0-425d-ba6b-cd1adb51bdeb None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.134507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 161/321] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:42.141610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7efa81-3226-4cdb-8007-b7fa659b5b7d None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.141610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7efa81-3226-4cdb-8007-b7fa659b5b7d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.141610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7efa81-3226-4cdb-8007-b7fa659b5b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.158974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-6f7efa81-3226-4cdb-8007-b7fa659b5b7d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:42.160233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6f7efa81-3226-4cdb-8007-b7fa659b5b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:42.167762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b1501-4fc0-425d-ba6b-cd1adb51bdeb None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:42.235770 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 161/322] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:42.263594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacc281-9a04-4607-a2c2-c7dd3d8138a6 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.263918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacc281-9a04-4607-a2c2-c7dd3d8138a6 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.264205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacc281-9a04-4607-a2c2-c7dd3d8138a6 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.265840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 162/323] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:42.270638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e9522-0e84-4a95-b498-b4dd178f5f63 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.270901 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e9522-0e84-4a95-b498-b4dd178f5f63 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.271181 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e9522-0e84-4a95-b498-b4dd178f5f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.278496 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b1501-4fc0-425d-ba6b-cd1adb51bdeb None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:42.279823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:42.290507 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-264e9522-0e84-4a95-b498-b4dd178f5f63 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:42.292534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-264e9522-0e84-4a95-b498-b4dd178f5f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:42.297870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:42.320891 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cda27-c52c-4e49-a936-82f46c8e683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:42.321528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cda27-c52c-4e49-a936-82f46c8e683a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.321968 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cda27-c52c-4e49-a936-82f46c8e683a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.322251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cda27-c52c-4e49-a936-82f46c8e683a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.323947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cda27-c52c-4e49-a936-82f46c8e683a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:42.325818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cda27-c52c-4e49-a936-82f46c8e683a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:42.327771 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 162/324] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:42.333213 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cda27-c52c-4e49-a936-82f46c8e683a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:42.363013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 163/325] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:42.438431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cda27-c52c-4e49-a936-82f46c8e683a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:42.472700 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279128b1-22b2-4a9e-b527-e9491bdd6655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:42.473317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279128b1-22b2-4a9e-b527-e9491bdd6655 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.473594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279128b1-22b2-4a9e-b527-e9491bdd6655 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.473870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279128b1-22b2-4a9e-b527-e9491bdd6655 None admin] PATH_INFO: `/v3/groups` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.474498 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279128b1-22b2-4a9e-b527-e9491bdd6655 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:42.475980 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279128b1-22b2-4a9e-b527-e9491bdd6655 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:42.492533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 163/326] 10.222.0.50 () {60 vars in 1134 bytes} [Wed Aug 31 00:07:42 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:07:42.506855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e9522-0e84-4a95-b498-b4dd178f5f63 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:42.621576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e9522-0e84-4a95-b498-b4dd178f5f63 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:42.630800 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279128b1-22b2-4a9e-b527-e9491bdd6655 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:42.662440 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05add1-5875-4632-b9ab-7eafcb6c352b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:42.663128 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05add1-5875-4632-b9ab-7eafcb6c352b None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.664041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05add1-5875-4632-b9ab-7eafcb6c352b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.664041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05add1-5875-4632-b9ab-7eafcb6c352b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.666092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:42.676651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05add1-5875-4632-b9ab-7eafcb6c352b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-7f05add1-5875-4632-b9ab-7eafcb6c352b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:42.681812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:42.682729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:42.684092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:42.684092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:42.684092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:42.684092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:42.684092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:42.684092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:42.684092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:42.684092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:42.684092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:42.684092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:42.684092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:42.684092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:42.684092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 164/327] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:42.686978 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:42.690212 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05add1-5875-4632-b9ab-7eafcb6c352b None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:42.755334 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279128b1-22b2-4a9e-b527-e9491bdd6655 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:42.796878 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d31d0-bc8f-496f-8589-948db3964e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:42.797529 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d31d0-bc8f-496f-8589-948db3964e76 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.797811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d31d0-bc8f-496f-8589-948db3964e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.798084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d31d0-bc8f-496f-8589-948db3964e76 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.809936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d31d0-bc8f-496f-8589-948db3964e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-332d31d0-bc8f-496f-8589-948db3964e76 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:42.815309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:42.816470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:42.817306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:42.817306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:42.817306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:42.817306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:42.817306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:42.817306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:42.817306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:42.817306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:42.817306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:42.817306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:42.817306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:42.817306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:42.817970 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05add1-5875-4632-b9ab-7eafcb6c352b None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:42.818368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 164/328] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:42.823321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d31d0-bc8f-496f-8589-948db3964e76 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:42.858320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ccbb2-87bf-469e-a8a0-03d5df9cc328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:42.859325 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ccbb2-87bf-469e-a8a0-03d5df9cc328 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.859925 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ccbb2-87bf-469e-a8a0-03d5df9cc328 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.860418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ccbb2-87bf-469e-a8a0-03d5df9cc328 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.861368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ccbb2-87bf-469e-a8a0-03d5df9cc328 None admin] RBAC: Adding query filter params (name=member) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:42.861882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ccbb2-87bf-469e-a8a0-03d5df9cc328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:42.863534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ccbb2-87bf-469e-a8a0-03d5df9cc328 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:42.872738 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 165/329] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:42.878536 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ccbb2-87bf-469e-a8a0-03d5df9cc328 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:42.942775 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d31d0-bc8f-496f-8589-948db3964e76 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:42.945935 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:42.956702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:42.983339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467258f-8f18-44be-8585-724b9756bf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:42.984029 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467258f-8f18-44be-8585-724b9756bf8b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.984311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467258f-8f18-44be-8585-724b9756bf8b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.984587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467258f-8f18-44be-8585-724b9756bf8b None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.985271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467258f-8f18-44be-8585-724b9756bf8b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:42.985576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467258f-8f18-44be-8585-724b9756bf8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:42.987064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467258f-8f18-44be-8585-724b9756bf8b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:42.997965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 165/330] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:43.003621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467258f-8f18-44be-8585-724b9756bf8b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:43.004858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ccbb2-87bf-469e-a8a0-03d5df9cc328 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:43.046477 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37035ad-82f2-45cb-bacf-12c71fcbc520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:43.047115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37035ad-82f2-45cb-bacf-12c71fcbc520 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.047391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37035ad-82f2-45cb-bacf-12c71fcbc520 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.047732 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37035ad-82f2-45cb-bacf-12c71fcbc520 None admin] PATH_INFO: `/v3/users/c756239ae8f448f0a360955607332164` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.048904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37035ad-82f2-45cb-bacf-12c71fcbc520 None admin] RBAC: Authorizing `identity:get_user(user_id=c756239ae8f448f0a360955607332164)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:43.050500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37035ad-82f2-45cb-bacf-12c71fcbc520 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:43.053066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 166/331] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:42 2022] GET /identity/v3/users/c756239ae8f448f0a360955607332164 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:43.058935 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37035ad-82f2-45cb-bacf-12c71fcbc520 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:43.141844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467258f-8f18-44be-8585-724b9756bf8b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:43.188416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e944051-5d7c-47de-9657-5c38c695c089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:43.189609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944051-5d7c-47de-9657-5c38c695c089 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.190053 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944051-5d7c-47de-9657-5c38c695c089 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.190456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944051-5d7c-47de-9657-5c38c695c089 None admin] PATH_INFO: `/v3/users/bcdc557d540c49218011f11c5e6ae4b4` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.192039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e944051-5d7c-47de-9657-5c38c695c089 None admin] RBAC: Authorizing `identity:get_user(user_id=bcdc557d540c49218011f11c5e6ae4b4)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:43.194185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e944051-5d7c-47de-9657-5c38c695c089 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:43.194300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37035ad-82f2-45cb-bacf-12c71fcbc520 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:43.197597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 166/332] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:43 2022] GET /identity/v3/users/bcdc557d540c49218011f11c5e6ae4b4 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:43.205289 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e944051-5d7c-47de-9657-5c38c695c089 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:43.227989 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:43.244910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9ed0b-ece0-4f3e-903f-60632c18c176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:43.246149 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ed0b-ece0-4f3e-903f-60632c18c176 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.246586 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ed0b-ece0-4f3e-903f-60632c18c176 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.247091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ed0b-ece0-4f3e-903f-60632c18c176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.248173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9ed0b-ece0-4f3e-903f-60632c18c176 None admin] RBAC: Adding query filter params (role.id=8615852d81aa46c39661d01a0372d8e8, user.id=c756239ae8f448f0a360955607332164, scope.system=all) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:43.248815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:43.249601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9ed0b-ece0-4f3e-903f-60632c18c176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:43.253033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9ed0b-ece0-4f3e-903f-60632c18c176 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:43.270570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 167/333] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Aug 31 00:07:43 2022] GET /identity/v3/role_assignments?user.id=c756239ae8f448f0a360955607332164&scope.system=all&role.id=8615852d81aa46c39661d01a0372d8e8 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:43.332478 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e944051-5d7c-47de-9657-5c38c695c089 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:43.371530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725285da-76e0-4cd3-a201-91c90cf1a93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:43.372241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725285da-76e0-4cd3-a201-91c90cf1a93f None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.372524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725285da-76e0-4cd3-a201-91c90cf1a93f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.372801 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725285da-76e0-4cd3-a201-91c90cf1a93f None admin] PATH_INFO: `/v3/system/users/bcdc557d540c49218011f11c5e6ae4b4/roles/f23c33107fdc4e839449e5bdf255e364` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.374263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725285da-76e0-4cd3-a201-91c90cf1a93f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bcdc557d540c49218011f11c5e6ae4b4, role_id=f23c33107fdc4e839449e5bdf255e364)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:43.375727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725285da-76e0-4cd3-a201-91c90cf1a93f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:43.384881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 167/334] 10.222.0.50 () {58 vars in 1334 bytes} [Wed Aug 31 00:07:43 2022] PUT /identity/v3/system/users/bcdc557d540c49218011f11c5e6ae4b4/roles/f23c33107fdc4e839449e5bdf255e364 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:44.621781 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c38a4-9a36-4864-8125-660445721a26 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:44.622774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c38a4-9a36-4864-8125-660445721a26 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:44.623246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c38a4-9a36-4864-8125-660445721a26 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:44.625134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 168/335] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:44.630216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff04a07-77c6-47d9-95ce-8ace939412ad None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:44.630653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff04a07-77c6-47d9-95ce-8ace939412ad None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:44.630844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff04a07-77c6-47d9-95ce-8ace939412ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:44.650818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7ff04a07-77c6-47d9-95ce-8ace939412ad None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:44.652056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7ff04a07-77c6-47d9-95ce-8ace939412ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:44.730334 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 168/336] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:45.081252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c38a4-9a36-4864-8125-660445721a26 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:45.208378 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c38a4-9a36-4864-8125-660445721a26 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:45.249575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80113a4-e5fd-4eb8-8c81-61c9a7d98f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:45.250222 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80113a4-e5fd-4eb8-8c81-61c9a7d98f09 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.250498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80113a4-e5fd-4eb8-8c81-61c9a7d98f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.250767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80113a4-e5fd-4eb8-8c81-61c9a7d98f09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.264890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80113a4-e5fd-4eb8-8c81-61c9a7d98f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-c80113a4-e5fd-4eb8-8c81-61c9a7d98f09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:45.269773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:45.270690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:45.271493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:45.271493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:45.271493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:45.271493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:45.271493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:45.271493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:45.271493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:45.271493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:45.271493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:45.271493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:45.271493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:45.271493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:45.271493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 169/337] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:45.282606 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff04a07-77c6-47d9-95ce-8ace939412ad None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:45.326874 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:45.423518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff04a07-77c6-47d9-95ce-8ace939412ad None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:45.477303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd54b9-7115-4a83-bf59-981e92a68e29 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.477499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7628f81-c079-4b4c-ab59-d5c06a790e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:45.477628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd54b9-7115-4a83-bf59-981e92a68e29 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.477868 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd54b9-7115-4a83-bf59-981e92a68e29 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.477960 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7628f81-c079-4b4c-ab59-d5c06a790e93 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.478243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7628f81-c079-4b4c-ab59-d5c06a790e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.478519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7628f81-c079-4b4c-ab59-d5c06a790e93 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.479419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 170/338] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:45.479548 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7628f81-c079-4b4c-ab59-d5c06a790e93 None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:45.479778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7628f81-c079-4b4c-ab59-d5c06a790e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:45.481162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7628f81-c079-4b4c-ab59-d5c06a790e93 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:45.485787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f09a65-6671-4e88-b502-2ba3cf1c6be4 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.486385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f09a65-6671-4e88-b502-2ba3cf1c6be4 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.486953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f09a65-6671-4e88-b502-2ba3cf1c6be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.490572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 169/339] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:45.496464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7628f81-c079-4b4c-ab59-d5c06a790e93 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:45.518562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-88f09a65-6671-4e88-b502-2ba3cf1c6be4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:45.520075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-88f09a65-6671-4e88-b502-2ba3cf1c6be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:45.580517 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:45.597918 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:45.610409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7628f81-c079-4b4c-ab59-d5c06a790e93 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:45.616521 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 171/340] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:45.617859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0790b-3ed9-4b36-b5b7-c9bedab93540 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.618141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0790b-3ed9-4b36-b5b7-c9bedab93540 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.618411 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0790b-3ed9-4b36-b5b7-c9bedab93540 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.623720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 172/341] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:45.629955 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b62f2-9fef-42c8-a28f-843f61c429e7 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.630408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b62f2-9fef-42c8-a28f-843f61c429e7 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.630819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b62f2-9fef-42c8-a28f-843f61c429e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.674564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011586a-ba54-454d-988a-da038ba0e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:45.675168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011586a-ba54-454d-988a-da038ba0e1ac None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.675428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011586a-ba54-454d-988a-da038ba0e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.675717 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011586a-ba54-454d-988a-da038ba0e1ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.678200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e17b62f2-9fef-42c8-a28f-843f61c429e7 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:45.679418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e17b62f2-9fef-42c8-a28f-843f61c429e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:45.768456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011586a-ba54-454d-988a-da038ba0e1ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:45.769943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011586a-ba54-454d-988a-da038ba0e1ac None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:45.873977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 173/342] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:45.901299 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 170/343] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:07:45.901977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:45.907424 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b62f2-9fef-42c8-a28f-843f61c429e7 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.007780 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011586a-ba54-454d-988a-da038ba0e1ac None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.061069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b62f2-9fef-42c8-a28f-843f61c429e7 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.073077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.146712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011586a-ba54-454d-988a-da038ba0e1ac None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.175158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e54c0f-dfe2-412d-b90f-05628e676cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.175892 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e54c0f-dfe2-412d-b90f-05628e676cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.176176 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e54c0f-dfe2-412d-b90f-05628e676cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.176448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e54c0f-dfe2-412d-b90f-05628e676cd6 None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.177684 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e54c0f-dfe2-412d-b90f-05628e676cd6 None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:46.179176 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e54c0f-dfe2-412d-b90f-05628e676cd6 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:46.181203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 174/344] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:45 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:46.188656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e54c0f-dfe2-412d-b90f-05628e676cd6 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.200369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf1895-05d7-49c2-b7a4-8c9b06b01a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.201270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf1895-05d7-49c2-b7a4-8c9b06b01a0b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.201692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf1895-05d7-49c2-b7a4-8c9b06b01a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.202098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf1895-05d7-49c2-b7a4-8c9b06b01a0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.224243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf1895-05d7-49c2-b7a4-8c9b06b01a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9fbf1895-05d7-49c2-b7a4-8c9b06b01a0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:46.229453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:46.230664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:46.235738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:46.235738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:46.235738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:46.235738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:46.235738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:46.235738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:46.235738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:46.235738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:46.235738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:46.235738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:46.235738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:46.235738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:46.238147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 171/345] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:46.244236 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf1895-05d7-49c2-b7a4-8c9b06b01a0b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.320194 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.372880 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf1895-05d7-49c2-b7a4-8c9b06b01a0b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.418571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a0ce1-ade3-47cc-ba83-46037af2d264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.419224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a0ce1-ade3-47cc-ba83-46037af2d264 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.419510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a0ce1-ade3-47cc-ba83-46037af2d264 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.421336 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a0ce1-ade3-47cc-ba83-46037af2d264 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.422057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a0ce1-ade3-47cc-ba83-46037af2d264 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:46.422364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a0ce1-ade3-47cc-ba83-46037af2d264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:46.423835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a0ce1-ade3-47cc-ba83-46037af2d264 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:46.433224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e54c0f-dfe2-412d-b90f-05628e676cd6 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.434036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 172/346] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:46.435265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a0ce1-ade3-47cc-ba83-46037af2d264 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.477510 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747f552-af7b-47a8-bc56-2183da4e6cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.478868 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f552-af7b-47a8-bc56-2183da4e6cce None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.479347 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f552-af7b-47a8-bc56-2183da4e6cce None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.480157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f552-af7b-47a8-bc56-2183da4e6cce None admin] PATH_INFO: `/v3/groups/9e3213e97d924a658f48ac3993e8243a` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.488416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747f552-af7b-47a8-bc56-2183da4e6cce None admin] RBAC: Authorizing `identity:get_group(group_id=9e3213e97d924a658f48ac3993e8243a)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:46.490200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747f552-af7b-47a8-bc56-2183da4e6cce None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:46.493309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 175/347] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/groups/9e3213e97d924a658f48ac3993e8243a => generated 226 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:46.494790 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e512-e085-4a21-9518-07cdbc77dbd6 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.495273 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e512-e085-4a21-9518-07cdbc77dbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.495766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e512-e085-4a21-9518-07cdbc77dbd6 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.497300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 176/348] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:46.498644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924e512-e085-4a21-9518-07cdbc77dbd6 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.545782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.557790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a0ce1-ade3-47cc-ba83-46037af2d264 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.576880 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.598029 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e1914-db0c-47d5-9d5a-0b284e59d150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.598677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e1914-db0c-47d5-9d5a-0b284e59d150 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.599002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e1914-db0c-47d5-9d5a-0b284e59d150 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.602870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e1914-db0c-47d5-9d5a-0b284e59d150 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.619793 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e1914-db0c-47d5-9d5a-0b284e59d150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2c9e1914-db0c-47d5-9d5a-0b284e59d150 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:46.628035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:46.628951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:46.629782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:46.629782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:46.629782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:46.629782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:46.629782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:46.629782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:46.629782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:46.629782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:46.629782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:46.629782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:46.629782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:46.629782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:46.632315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 173/349] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:46.638224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e1914-db0c-47d5-9d5a-0b284e59d150 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.639041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924e512-e085-4a21-9518-07cdbc77dbd6 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.680214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65daf4b5-91a8-4889-82e7-81530c56adea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.681208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daf4b5-91a8-4889-82e7-81530c56adea None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.681685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daf4b5-91a8-4889-82e7-81530c56adea None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.682179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daf4b5-91a8-4889-82e7-81530c56adea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.765039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65daf4b5-91a8-4889-82e7-81530c56adea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:46.767336 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65daf4b5-91a8-4889-82e7-81530c56adea None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:46.773523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e1914-db0c-47d5-9d5a-0b284e59d150 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.813457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.820335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18db9d7-6955-44a6-89cf-0fdd8f184ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.820956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18db9d7-6955-44a6-89cf-0fdd8f184ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.821240 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18db9d7-6955-44a6-89cf-0fdd8f184ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.821844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18db9d7-6955-44a6-89cf-0fdd8f184ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.822247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18db9d7-6955-44a6-89cf-0fdd8f184ae6 None admin] RBAC: Adding query filter params (group.id=9e3213e97d924a658f48ac3993e8243a, role.id=8615852d81aa46c39661d01a0372d8e8, scope.project.id=1221b9ee938248cf926034ec51adb9cf) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:46.822558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18db9d7-6955-44a6-89cf-0fdd8f184ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:46.824026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18db9d7-6955-44a6-89cf-0fdd8f184ae6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:46.830279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 174/350] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/role_assignments?group.id=9e3213e97d924a658f48ac3993e8243a&scope.project.id=1221b9ee938248cf926034ec51adb9cf&role.id=8615852d81aa46c39661d01a0372d8e8 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:46.831404 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd98e16-2fe0-438f-a075-ebbe8ddbd792 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.831966 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd98e16-2fe0-438f-a075-ebbe8ddbd792 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.831966 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd98e16-2fe0-438f-a075-ebbe8ddbd792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.854479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-8dd98e16-2fe0-438f-a075-ebbe8ddbd792 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:46.855763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8dd98e16-2fe0-438f-a075-ebbe8ddbd792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:46.888977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.908079 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 177/351] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:46.909030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65daf4b5-91a8-4889-82e7-81530c56adea None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.950198 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 175/352] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:46.951546 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e510e-8a83-4e1a-8657-c5a06541ffdf None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.951902 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e510e-8a83-4e1a-8657-c5a06541ffdf None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.952171 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e510e-8a83-4e1a-8657-c5a06541ffdf None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.953572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 176/353] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:46.954116 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e510e-8a83-4e1a-8657-c5a06541ffdf None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.080470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e510e-8a83-4e1a-8657-c5a06541ffdf None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.097265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65daf4b5-91a8-4889-82e7-81530c56adea None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.142088 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63563326-a020-4035-bc53-ec258608ad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.142287 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563326-a020-4035-bc53-ec258608ad47 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.142532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563326-a020-4035-bc53-ec258608ad47 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.142772 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563326-a020-4035-bc53-ec258608ad47 None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.143592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2e918-9cfd-4d5c-819a-e2e0f59a0ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.144351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2e918-9cfd-4d5c-819a-e2e0f59a0ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.144619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2e918-9cfd-4d5c-819a-e2e0f59a0ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.145026 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2e918-9cfd-4d5c-819a-e2e0f59a0ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.145703 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2e918-9cfd-4d5c-819a-e2e0f59a0ae1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:47.151787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2e918-9cfd-4d5c-819a-e2e0f59a0ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:47.151787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2e918-9cfd-4d5c-819a-e2e0f59a0ae1 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:47.151969 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63563326-a020-4035-bc53-ec258608ad47 None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:47.151969 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63563326-a020-4035-bc53-ec258608ad47 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:47.152499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 177/354] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:47.153472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2454c72-4793-4713-9613-b76b289795c3 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.153801 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2454c72-4793-4713-9613-b76b289795c3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.154013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2454c72-4793-4713-9613-b76b289795c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.157682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:47.167869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 178/355] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:47.169016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2e918-9cfd-4d5c-819a-e2e0f59a0ae1 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.196798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c2454c72-4793-4713-9613-b76b289795c3 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:47.198048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c2454c72-4793-4713-9613-b76b289795c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:47.264922 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:47.287281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2e918-9cfd-4d5c-819a-e2e0f59a0ae1 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.325273 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ee1e9-4288-452c-a5e4-faef444d3736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.325911 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ee1e9-4288-452c-a5e4-faef444d3736 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.326183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ee1e9-4288-452c-a5e4-faef444d3736 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.326451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ee1e9-4288-452c-a5e4-faef444d3736 None admin] PATH_INFO: `/v3/groups/9e3213e97d924a658f48ac3993e8243a` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.328530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ee1e9-4288-452c-a5e4-faef444d3736 None admin] RBAC: Authorizing `identity:get_group(group_id=9e3213e97d924a658f48ac3993e8243a)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:47.330015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 178/356] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:47.330121 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ee1e9-4288-452c-a5e4-faef444d3736 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:47.330925 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2454c72-4793-4713-9613-b76b289795c3 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.331733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 179/357] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/groups/9e3213e97d924a658f48ac3993e8243a => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:47.337783 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ee1e9-4288-452c-a5e4-faef444d3736 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.433261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:47.466872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2454c72-4793-4713-9613-b76b289795c3 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.488656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ee1e9-4288-452c-a5e4-faef444d3736 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.504312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e343d-81ce-46f6-8786-3ae0ff5c660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.504961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e343d-81ce-46f6-8786-3ae0ff5c660c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.505242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e343d-81ce-46f6-8786-3ae0ff5c660c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.505517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e343d-81ce-46f6-8786-3ae0ff5c660c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.526254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be28b7-9b48-46f9-b906-c705d501febe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.527195 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be28b7-9b48-46f9-b906-c705d501febe None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.527744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be28b7-9b48-46f9-b906-c705d501febe None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.528183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be28b7-9b48-46f9-b906-c705d501febe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.529086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be28b7-9b48-46f9-b906-c705d501febe None admin] RBAC: Adding query filter params (group.id=9e3213e97d924a658f48ac3993e8243a, role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1, scope.project.id=1221b9ee938248cf926034ec51adb9cf) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:47.529655 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be28b7-9b48-46f9-b906-c705d501febe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:47.531320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be28b7-9b48-46f9-b906-c705d501febe None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:47.538173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 180/358] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/role_assignments?group.id=9e3213e97d924a658f48ac3993e8243a&scope.project.id=1221b9ee938248cf926034ec51adb9cf&role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:47.539445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:47.540090 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be28b7-9b48-46f9-b906-c705d501febe None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.587567 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e343d-81ce-46f6-8786-3ae0ff5c660c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:47.589188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e343d-81ce-46f6-8786-3ae0ff5c660c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:47.657401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be28b7-9b48-46f9-b906-c705d501febe None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.696368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:47.707260 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 179/359] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:47.709612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54152988-e13d-4de0-9a44-97c08226abdf None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.709885 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54152988-e13d-4de0-9a44-97c08226abdf None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.711644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54152988-e13d-4de0-9a44-97c08226abdf None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.711644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 180/360] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:47.714660 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54152988-e13d-4de0-9a44-97c08226abdf None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.717524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f5154-099a-45b3-8466-97d456851f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.718209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f5154-099a-45b3-8466-97d456851f00 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.718532 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f5154-099a-45b3-8466-97d456851f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.718752 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f5154-099a-45b3-8466-97d456851f00 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.735760 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f5154-099a-45b3-8466-97d456851f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-968f5154-099a-45b3-8466-97d456851f00 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:47.743552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:47.744723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:47.745644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:47.745644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:47.745644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:47.745644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:47.745644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:47.745644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:47.745644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:47.745644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:47.745644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:47.745644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:47.745644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:07:47.745644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:47.749216 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 181/361] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:47.751582 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e89be-3502-47e0-b25f-e2e39a4cdf3e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.752113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e89be-3502-47e0-b25f-e2e39a4cdf3e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.752575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e89be-3502-47e0-b25f-e2e39a4cdf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.772653 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-363e89be-3502-47e0-b25f-e2e39a4cdf3e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:47.774312 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-363e89be-3502-47e0-b25f-e2e39a4cdf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:47.800719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:47.844371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54152988-e13d-4de0-9a44-97c08226abdf None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.871571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 182/362] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:47.872799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e89be-3502-47e0-b25f-e2e39a4cdf3e None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.894792 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d67f3f-edc8-44ac-9e0e-6be317bbede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.895446 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d67f3f-edc8-44ac-9e0e-6be317bbede4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.895760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d67f3f-edc8-44ac-9e0e-6be317bbede4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.896039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d67f3f-edc8-44ac-9e0e-6be317bbede4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.912822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d67f3f-edc8-44ac-9e0e-6be317bbede4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-51d67f3f-edc8-44ac-9e0e-6be317bbede4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:47.917681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:47.918754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:47.919583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:47.919583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:47.919583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:47.919583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:47.919583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:47.919583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:47.919583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:47.919583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:47.919583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:47.919583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:47.919583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:47.919583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:47.919583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 181/363] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:47.928735 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d67f3f-edc8-44ac-9e0e-6be317bbede4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.986251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e89be-3502-47e0-b25f-e2e39a4cdf3e None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.005484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:48.025128 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78532f3-cdd9-424f-95eb-79fc67a8ba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.026058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78532f3-cdd9-424f-95eb-79fc67a8ba1f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.026475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78532f3-cdd9-424f-95eb-79fc67a8ba1f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.026880 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78532f3-cdd9-424f-95eb-79fc67a8ba1f None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.028497 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78532f3-cdd9-424f-95eb-79fc67a8ba1f None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:48.030122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78532f3-cdd9-424f-95eb-79fc67a8ba1f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:48.031977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 183/364] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:48.032887 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78532f3-cdd9-424f-95eb-79fc67a8ba1f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.066917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d67f3f-edc8-44ac-9e0e-6be317bbede4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.099137 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:48.110641 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee059892-4b3f-4a3f-b2be-0a9af66c4370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.111414 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee059892-4b3f-4a3f-b2be-0a9af66c4370 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.111840 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee059892-4b3f-4a3f-b2be-0a9af66c4370 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.112125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee059892-4b3f-4a3f-b2be-0a9af66c4370 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.112819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee059892-4b3f-4a3f-b2be-0a9af66c4370 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:48.113121 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee059892-4b3f-4a3f-b2be-0a9af66c4370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:48.114523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee059892-4b3f-4a3f-b2be-0a9af66c4370 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:48.126515 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 182/365] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:48.127127 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee059892-4b3f-4a3f-b2be-0a9af66c4370 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.159479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78532f3-cdd9-424f-95eb-79fc67a8ba1f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.204620 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d2309-0097-4343-a83b-b951a9cf78df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.205499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d2309-0097-4343-a83b-b951a9cf78df None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.205907 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d2309-0097-4343-a83b-b951a9cf78df None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.206313 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d2309-0097-4343-a83b-b951a9cf78df None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.207254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d2309-0097-4343-a83b-b951a9cf78df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:48.208414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d2309-0097-4343-a83b-b951a9cf78df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:48.210942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d2309-0097-4343-a83b-b951a9cf78df None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:48.220298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 184/366] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:48.221447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d2309-0097-4343-a83b-b951a9cf78df None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.258670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee059892-4b3f-4a3f-b2be-0a9af66c4370 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.288984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:48.298080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bb9ae-2f2a-48c3-b06f-41db05b48c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.298986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bb9ae-2f2a-48c3-b06f-41db05b48c18 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.299268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bb9ae-2f2a-48c3-b06f-41db05b48c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.299545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bb9ae-2f2a-48c3-b06f-41db05b48c18 None admin] PATH_INFO: `/v3/groups/9e3213e97d924a658f48ac3993e8243a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.300866 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bb9ae-2f2a-48c3-b06f-41db05b48c18 None admin] RBAC: Authorizing `identity:get_group(group_id=9e3213e97d924a658f48ac3993e8243a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:48.303769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bb9ae-2f2a-48c3-b06f-41db05b48c18 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:48.304607 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 183/367] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/groups/9e3213e97d924a658f48ac3993e8243a => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:48.307739 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bb9ae-2f2a-48c3-b06f-41db05b48c18 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.372157 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:48.415846 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d2309-0097-4343-a83b-b951a9cf78df None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.425031 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bb9ae-2f2a-48c3-b06f-41db05b48c18 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.461225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe9b7a-2ffc-4b6a-bf45-e6a6b824a943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.461880 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe9b7a-2ffc-4b6a-bf45-e6a6b824a943 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.462155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe9b7a-2ffc-4b6a-bf45-e6a6b824a943 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.462436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe9b7a-2ffc-4b6a-bf45-e6a6b824a943 None admin] PATH_INFO: `/v3/users/bcdc557d540c49218011f11c5e6ae4b4` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.463596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe9b7a-2ffc-4b6a-bf45-e6a6b824a943 None admin] RBAC: Authorizing `identity:get_user(user_id=bcdc557d540c49218011f11c5e6ae4b4)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:48.465235 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe9b7a-2ffc-4b6a-bf45-e6a6b824a943 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:48.467147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 185/368] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/users/bcdc557d540c49218011f11c5e6ae4b4 => generated 293 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:48.468402 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe9b7a-2ffc-4b6a-bf45-e6a6b824a943 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.471729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ff950-dc69-4306-83d1-5a5d86802fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.473255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff950-dc69-4306-83d1-5a5d86802fec None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.473544 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff950-dc69-4306-83d1-5a5d86802fec None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.473824 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff950-dc69-4306-83d1-5a5d86802fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.559591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ff950-dc69-4306-83d1-5a5d86802fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:48.561925 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ff950-dc69-4306-83d1-5a5d86802fec None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:48.581848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe9b7a-2ffc-4b6a-bf45-e6a6b824a943 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.599988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:48.624915 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b126b1d-4ad8-40f7-a20a-2a2f5c228f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.625445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b126b1d-4ad8-40f7-a20a-2a2f5c228f36 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.625722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b126b1d-4ad8-40f7-a20a-2a2f5c228f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.626091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b126b1d-4ad8-40f7-a20a-2a2f5c228f36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.626974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b126b1d-4ad8-40f7-a20a-2a2f5c228f36 None admin] RBAC: Adding query filter params (group.id=9e3213e97d924a658f48ac3993e8243a, role.id=8615852d81aa46c39661d01a0372d8e8, scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:48.627285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b126b1d-4ad8-40f7-a20a-2a2f5c228f36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:48.628758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b126b1d-4ad8-40f7-a20a-2a2f5c228f36 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:48.632541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:48.635570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 186/369] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/role_assignments?group.id=9e3213e97d924a658f48ac3993e8243a&scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e&role.id=8615852d81aa46c39661d01a0372d8e8 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:48.637133 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b126b1d-4ad8-40f7-a20a-2a2f5c228f36 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.686083 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 184/370] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:48.686941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ff950-dc69-4306-83d1-5a5d86802fec None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.763561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b126b1d-4ad8-40f7-a20a-2a2f5c228f36 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.794643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ff950-dc69-4306-83d1-5a5d86802fec None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.802079 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e1142-86f6-40c7-872b-74b1e7d2923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.802722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e1142-86f6-40c7-872b-74b1e7d2923e None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.803103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e1142-86f6-40c7-872b-74b1e7d2923e None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.803380 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e1142-86f6-40c7-872b-74b1e7d2923e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.817103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e1142-86f6-40c7-872b-74b1e7d2923e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-893e1142-86f6-40c7-872b-74b1e7d2923e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:48.822903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:48.823829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:48.824691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:48.824691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:48.824691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:48.824691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:48.824691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:48.824691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:48.824691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:48.824691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:48.824691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:48.824691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:48.824691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:48.824691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:48.824691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 187/371] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:48.826261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e1142-86f6-40c7-872b-74b1e7d2923e None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.838853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a098a-7975-4460-97e1-f7b09ceb9861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.839478 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a098a-7975-4460-97e1-f7b09ceb9861 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.839761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a098a-7975-4460-97e1-f7b09ceb9861 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.840039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a098a-7975-4460-97e1-f7b09ceb9861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.840825 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a098a-7975-4460-97e1-f7b09ceb9861 None admin] RBAC: Adding query filter params (role.id=f23c33107fdc4e839449e5bdf255e364, user.id=bcdc557d540c49218011f11c5e6ae4b4, scope.system=all) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:48.841134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a098a-7975-4460-97e1-f7b09ceb9861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:48.842907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a098a-7975-4460-97e1-f7b09ceb9861 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:48.857928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 185/372] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/role_assignments?user.id=bcdc557d540c49218011f11c5e6ae4b4&scope.system=all&role.id=f23c33107fdc4e839449e5bdf255e364 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:48.858801 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a098a-7975-4460-97e1-f7b09ceb9861 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.875776 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:48.879461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:48.971581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a098a-7975-4460-97e1-f7b09ceb9861 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.993111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e1142-86f6-40c7-872b-74b1e7d2923e None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.025410 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124f3bc-c24a-49e1-ada6-eb0a0d1cd549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.026041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f3bc-c24a-49e1-ada6-eb0a0d1cd549 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.026322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f3bc-c24a-49e1-ada6-eb0a0d1cd549 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.026597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f3bc-c24a-49e1-ada6-eb0a0d1cd549 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.027277 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124f3bc-c24a-49e1-ada6-eb0a0d1cd549 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:49.027582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124f3bc-c24a-49e1-ada6-eb0a0d1cd549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.030145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124f3bc-c24a-49e1-ada6-eb0a0d1cd549 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.039024 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 186/373] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:49.045595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124f3bc-c24a-49e1-ada6-eb0a0d1cd549 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.050964 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272a5dd-19b5-481b-bec4-625c23a4aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.051729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272a5dd-19b5-481b-bec4-625c23a4aeea None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.052019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272a5dd-19b5-481b-bec4-625c23a4aeea None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.052292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272a5dd-19b5-481b-bec4-625c23a4aeea None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.056331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272a5dd-19b5-481b-bec4-625c23a4aeea None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.057861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272a5dd-19b5-481b-bec4-625c23a4aeea None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.060364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 188/374] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:49.066104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272a5dd-19b5-481b-bec4-625c23a4aeea None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.126433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:49.156926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124f3bc-c24a-49e1-ada6-eb0a0d1cd549 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.195954 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bae63-fb24-4949-a1c1-83de92d8e9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.196577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bae63-fb24-4949-a1c1-83de92d8e9ae None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.196857 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bae63-fb24-4949-a1c1-83de92d8e9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.197133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bae63-fb24-4949-a1c1-83de92d8e9ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.208525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272a5dd-19b5-481b-bec4-625c23a4aeea None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.222637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:49.264610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809fd03-bb7f-4bee-8620-2f03844f11fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.265256 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809fd03-bb7f-4bee-8620-2f03844f11fe None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.265538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809fd03-bb7f-4bee-8620-2f03844f11fe None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.265810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809fd03-bb7f-4bee-8620-2f03844f11fe None admin] PATH_INFO: `/v3/groups/9e3213e97d924a658f48ac3993e8243a` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.272221 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809fd03-bb7f-4bee-8620-2f03844f11fe None admin] RBAC: Authorizing `identity:get_group(group_id=9e3213e97d924a658f48ac3993e8243a)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.272407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bae63-fb24-4949-a1c1-83de92d8e9ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.273712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bae63-fb24-4949-a1c1-83de92d8e9ae None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.273816 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809fd03-bb7f-4bee-8620-2f03844f11fe None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.275853 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 189/375] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/groups/9e3213e97d924a658f48ac3993e8243a => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:49.282104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809fd03-bb7f-4bee-8620-2f03844f11fe None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.355473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:49.384395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 187/376] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:49.390545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bae63-fb24-4949-a1c1-83de92d8e9ae None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.485138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809fd03-bb7f-4bee-8620-2f03844f11fe None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.524336 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bae63-fb24-4949-a1c1-83de92d8e9ae None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.545213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e4d5e-1d53-46ec-990f-4a35795789b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.546167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e4d5e-1d53-46ec-990f-4a35795789b5 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.546665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e4d5e-1d53-46ec-990f-4a35795789b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.547122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e4d5e-1d53-46ec-990f-4a35795789b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.548084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e4d5e-1d53-46ec-990f-4a35795789b5 None admin] RBAC: Adding query filter params (group.id=9e3213e97d924a658f48ac3993e8243a, role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1, scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:49.548578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e4d5e-1d53-46ec-990f-4a35795789b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.550236 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e4d5e-1d53-46ec-990f-4a35795789b5 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.565790 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 190/377] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/role_assignments?group.id=9e3213e97d924a658f48ac3993e8243a&scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e&role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:49.582945 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00d271-c0eb-44c3-8410-9a57c5468dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.584012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00d271-c0eb-44c3-8410-9a57c5468dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.584483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00d271-c0eb-44c3-8410-9a57c5468dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.584968 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00d271-c0eb-44c3-8410-9a57c5468dd1 None admin] PATH_INFO: `/v3/projects/8ead22b3b4a34507bccadbdf3ec17342` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.586434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00d271-c0eb-44c3-8410-9a57c5468dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=8ead22b3b4a34507bccadbdf3ec17342)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.588132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00d271-c0eb-44c3-8410-9a57c5468dd1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.590361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 188/378] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/projects/8ead22b3b4a34507bccadbdf3ec17342 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:49.595950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e4d5e-1d53-46ec-990f-4a35795789b5 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.645648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:49.726734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e4d5e-1d53-46ec-990f-4a35795789b5 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.728834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f630c-896e-41aa-962b-5e6ff8adf5d5 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.729109 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f630c-896e-41aa-962b-5e6ff8adf5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.729377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f630c-896e-41aa-962b-5e6ff8adf5d5 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.730711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 189/379] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:49.736699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd344b-5791-45cc-94fe-325b45c2286d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.736999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd344b-5791-45cc-94fe-325b45c2286d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.737243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd344b-5791-45cc-94fe-325b45c2286d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.769087 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a4dd344b-5791-45cc-94fe-325b45c2286d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:49.770411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a4dd344b-5791-45cc-94fe-325b45c2286d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:49.824413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e2826-c84f-4be7-94a5-d120ea83ca67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.825157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e2826-c84f-4be7-94a5-d120ea83ca67 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.825381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e2826-c84f-4be7-94a5-d120ea83ca67 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.825623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e2826-c84f-4be7-94a5-d120ea83ca67 None admin] PATH_INFO: `/v3/groups/517a68222ce44886bc53b6f20350b99e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.837447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e2826-c84f-4be7-94a5-d120ea83ca67 None admin] RBAC: Authorizing `identity:get_group(group_id=517a68222ce44886bc53b6f20350b99e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.838907 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e2826-c84f-4be7-94a5-d120ea83ca67 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.841296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 191/380] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/groups/517a68222ce44886bc53b6f20350b99e => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:49.851421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e2826-c84f-4be7-94a5-d120ea83ca67 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.856184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:49.912693 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 190/381] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:49.968576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e2826-c84f-4be7-94a5-d120ea83ca67 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.970910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:49.974956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecf2df-c628-4e22-8922-19a0217c20fa None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.975503 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecf2df-c628-4e22-8922-19a0217c20fa None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.975996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecf2df-c628-4e22-8922-19a0217c20fa None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.978641 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 191/382] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:49.986739 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c8c67-abee-4eec-a339-1e2668f50683 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.987248 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c8c67-abee-4eec-a339-1e2668f50683 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.987755 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c8c67-abee-4eec-a339-1e2668f50683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.004643 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a388ab-d1c1-4b71-ac75-944bbeb81f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:50.005252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a388ab-d1c1-4b71-ac75-944bbeb81f9e None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.005528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a388ab-d1c1-4b71-ac75-944bbeb81f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.005797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a388ab-d1c1-4b71-ac75-944bbeb81f9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.006519 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a388ab-d1c1-4b71-ac75-944bbeb81f9e None admin] RBAC: Adding query filter params (group.id=517a68222ce44886bc53b6f20350b99e, role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=8ead22b3b4a34507bccadbdf3ec17342) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:50.006841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a388ab-d1c1-4b71-ac75-944bbeb81f9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:50.014175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a388ab-d1c1-4b71-ac75-944bbeb81f9e None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:50.014449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 192/383] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/role_assignments?group.id=517a68222ce44886bc53b6f20350b99e&scope.project.id=8ead22b3b4a34507bccadbdf3ec17342&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:50.029045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-793c8c67-abee-4eec-a339-1e2668f50683 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:50.030511 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-793c8c67-abee-4eec-a339-1e2668f50683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:50.129577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 192/384] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:50.225955 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a388ab-d1c1-4b71-ac75-944bbeb81f9e None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:50.353368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a388ab-d1c1-4b71-ac75-944bbeb81f9e None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:50.393542 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a7f6a-ef1f-4b4d-a656-41310024f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:50.394177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a7f6a-ef1f-4b4d-a656-41310024f647 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.394455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a7f6a-ef1f-4b4d-a656-41310024f647 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.394728 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a7f6a-ef1f-4b4d-a656-41310024f647 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.408936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a7f6a-ef1f-4b4d-a656-41310024f647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-410a7f6a-ef1f-4b4d-a656-41310024f647 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:50.414224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:50.415179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:50.416025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:50.416025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:50.416025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:50.416025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:50.416025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:50.416025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:50.416025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:50.416025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:50.416025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:50.416025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:50.416025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:50.416025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:50.416025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 193/385] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:50.421566 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c8c67-abee-4eec-a339-1e2668f50683 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:50.552348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c8c67-abee-4eec-a339-1e2668f50683 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:50.554298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:50.591927 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad708c1-a8e5-4f38-a137-578f17d20685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:50.592545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad708c1-a8e5-4f38-a137-578f17d20685 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.592825 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad708c1-a8e5-4f38-a137-578f17d20685 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.593097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad708c1-a8e5-4f38-a137-578f17d20685 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.593770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad708c1-a8e5-4f38-a137-578f17d20685 None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:50.594073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad708c1-a8e5-4f38-a137-578f17d20685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:50.595463 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad708c1-a8e5-4f38-a137-578f17d20685 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:50.604618 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 193/386] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:50.605362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a7f6a-ef1f-4b4d-a656-41310024f647 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:50.614559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad708c1-a8e5-4f38-a137-578f17d20685 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:50.672823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:50.750173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad708c1-a8e5-4f38-a137-578f17d20685 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:50.790967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a7f6a-ef1f-4b4d-a656-41310024f647 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:50.801350 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15b564-aad2-43dd-bfba-0527973323a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:50.802311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b564-aad2-43dd-bfba-0527973323a0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.802765 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b564-aad2-43dd-bfba-0527973323a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.803211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b564-aad2-43dd-bfba-0527973323a0 None admin] PATH_INFO: `/v3/groups/9e3213e97d924a658f48ac3993e8243a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.804654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15b564-aad2-43dd-bfba-0527973323a0 None admin] RBAC: Authorizing `identity:get_group(group_id=9e3213e97d924a658f48ac3993e8243a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:50.806456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15b564-aad2-43dd-bfba-0527973323a0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:50.808314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 194/387] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:50 2022] GET /identity/v3/groups/9e3213e97d924a658f48ac3993e8243a => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:50.816447 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15b564-aad2-43dd-bfba-0527973323a0 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:50.839388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc64f6-896d-4c45-821c-6a92618884a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:50.840157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc64f6-896d-4c45-821c-6a92618884a6 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.840534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc64f6-896d-4c45-821c-6a92618884a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.840894 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc64f6-896d-4c45-821c-6a92618884a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.857296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:50.857842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc64f6-896d-4c45-821c-6a92618884a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-4abc64f6-896d-4c45-821c-6a92618884a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:50.866506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:50.867479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:50.868372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:50.868372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:50.868372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:50.868372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:50.868372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:50.868372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:50.868372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:50.868372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:50.868372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:50.868372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:50.868372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:50.868372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:50.868372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 194/388] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:50.873695 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc64f6-896d-4c45-821c-6a92618884a6 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:50.936103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15b564-aad2-43dd-bfba-0527973323a0 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:50.972213 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2356c9f-e3b4-4829-8ff9-34ff4409a4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:50.973200 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2356c9f-e3b4-4829-8ff9-34ff4409a4db None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.973730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2356c9f-e3b4-4829-8ff9-34ff4409a4db None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.974178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2356c9f-e3b4-4829-8ff9-34ff4409a4db None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.975615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2356c9f-e3b4-4829-8ff9-34ff4409a4db None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:50.977301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2356c9f-e3b4-4829-8ff9-34ff4409a4db None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:50.979663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 195/389] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:50 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:50.985067 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2356c9f-e3b4-4829-8ff9-34ff4409a4db None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.050392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:51.070284 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc64f6-896d-4c45-821c-6a92618884a6 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.096104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:51.100978 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2356c9f-e3b4-4829-8ff9-34ff4409a4db None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.143213 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918e425-c98a-46e4-b86e-e239c4cbbced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.144361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918e425-c98a-46e4-b86e-e239c4cbbced None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.144845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918e425-c98a-46e4-b86e-e239c4cbbced None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.145581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918e425-c98a-46e4-b86e-e239c4cbbced None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf/groups/9e3213e97d924a658f48ac3993e8243a/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.147811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918e425-c98a-46e4-b86e-e239c4cbbced None admin] RBAC: Authorizing `identity:create_grant(project_id=1221b9ee938248cf926034ec51adb9cf, group_id=9e3213e97d924a658f48ac3993e8243a, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:51.149667 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918e425-c98a-46e4-b86e-e239c4cbbced None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:51.162718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ab139-562b-4932-aba3-0538ee0c7272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.162718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ab139-562b-4932-aba3-0538ee0c7272 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.162718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ab139-562b-4932-aba3-0538ee0c7272 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.162718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ab139-562b-4932-aba3-0538ee0c7272 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.165049 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ab139-562b-4932-aba3-0538ee0c7272 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:51.165049 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ab139-562b-4932-aba3-0538ee0c7272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:51.166439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ab139-562b-4932-aba3-0538ee0c7272 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:51.172429 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 196/390] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Aug 31 00:07:50 2022] PUT /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf/groups/9e3213e97d924a658f48ac3993e8243a/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:07:51.194232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 195/391] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:51.200179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918e425-c98a-46e4-b86e-e239c4cbbced None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.332105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918e425-c98a-46e4-b86e-e239c4cbbced None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.371909 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1338d-2096-4118-bbe4-4cf77fcb528f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.373032 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1338d-2096-4118-bbe4-4cf77fcb528f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.373524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1338d-2096-4118-bbe4-4cf77fcb528f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.374004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1338d-2096-4118-bbe4-4cf77fcb528f None admin] PATH_INFO: `/v3/groups/9e3213e97d924a658f48ac3993e8243a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.375576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1338d-2096-4118-bbe4-4cf77fcb528f None admin] RBAC: Authorizing `identity:get_group(group_id=9e3213e97d924a658f48ac3993e8243a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:51.377329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1338d-2096-4118-bbe4-4cf77fcb528f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:51.381105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 197/392] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:51 2022] GET /identity/v3/groups/9e3213e97d924a658f48ac3993e8243a => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:51.385074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ab139-562b-4932-aba3-0538ee0c7272 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.470084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa901aca-bb3e-47bd-987c-2572baa72f31 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.471148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa901aca-bb3e-47bd-987c-2572baa72f31 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.471626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa901aca-bb3e-47bd-987c-2572baa72f31 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.473247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 198/393] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:51.479034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2ec15-bacd-4d78-90d0-c63c418235eb None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.479322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2ec15-bacd-4d78-90d0-c63c418235eb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.479923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2ec15-bacd-4d78-90d0-c63c418235eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.507070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2cc2ec15-bacd-4d78-90d0-c63c418235eb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:51.508740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2cc2ec15-bacd-4d78-90d0-c63c418235eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:51.542023 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:51.562558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ab139-562b-4932-aba3-0538ee0c7272 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.603734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 199/394] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:51.605840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c7a74-1629-4772-b17a-cff1d896a8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.606754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c7a74-1629-4772-b17a-cff1d896a8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.607037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c7a74-1629-4772-b17a-cff1d896a8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.607311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c7a74-1629-4772-b17a-cff1d896a8c1 None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.608508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c7a74-1629-4772-b17a-cff1d896a8c1 None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:51.610071 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c7a74-1629-4772-b17a-cff1d896a8c1 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:51.612063 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 196/395] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:51 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:51.618218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2ec15-bacd-4d78-90d0-c63c418235eb None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.739831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2ec15-bacd-4d78-90d0-c63c418235eb None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.785382 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be152949-c160-4016-be32-427d0b7ae0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.786078 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152949-c160-4016-be32-427d0b7ae0bc None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.786354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152949-c160-4016-be32-427d0b7ae0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.786628 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152949-c160-4016-be32-427d0b7ae0bc None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf/groups/9e3213e97d924a658f48ac3993e8243a/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.788909 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be152949-c160-4016-be32-427d0b7ae0bc None admin] RBAC: Authorizing `identity:create_grant(project_id=1221b9ee938248cf926034ec51adb9cf, group_id=9e3213e97d924a658f48ac3993e8243a, role_id=f9b0f326bcf6425d9e2aa62dc35ddbc1)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:51.790400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be152949-c160-4016-be32-427d0b7ae0bc None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:51.810195 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 200/396] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Aug 31 00:07:51 2022] PUT /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf/groups/9e3213e97d924a658f48ac3993e8243a/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:51.904580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c7a74-1629-4772-b17a-cff1d896a8c1 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.928975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:52.017146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c7a74-1629-4772-b17a-cff1d896a8c1 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.053472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a25b9-3678-438b-a362-967a5ddca6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.054148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a25b9-3678-438b-a362-967a5ddca6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.054432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a25b9-3678-438b-a362-967a5ddca6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.054704 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a25b9-3678-438b-a362-967a5ddca6c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.067294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a25b9-3678-438b-a362-967a5ddca6c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-3e8a25b9-3678-438b-a362-967a5ddca6c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:52.072857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:52.073744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:52.075030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:52.075030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:52.075030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:52.075030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:52.075030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:52.075030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:52.075030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:52.075030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:52.075030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:52.075030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:52.075030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:52.075030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:52.075030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 197/397] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:52.080457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be152949-c160-4016-be32-427d0b7ae0bc None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:52.121153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:52.225829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be152949-c160-4016-be32-427d0b7ae0bc None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.268077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3ed7e-9f96-489e-9bd0-37a4866b716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.268923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3ed7e-9f96-489e-9bd0-37a4866b716b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.269345 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3ed7e-9f96-489e-9bd0-37a4866b716b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.269771 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3ed7e-9f96-489e-9bd0-37a4866b716b None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.270602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3ed7e-9f96-489e-9bd0-37a4866b716b None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:52.271043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3ed7e-9f96-489e-9bd0-37a4866b716b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:52.272619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3ed7e-9f96-489e-9bd0-37a4866b716b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:52.288135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 201/398] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:52.291480 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473953c-8ca5-4492-ac98-0d17f65c6639 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.291948 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473953c-8ca5-4492-ac98-0d17f65c6639 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.292365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473953c-8ca5-4492-ac98-0d17f65c6639 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.293969 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 198/399] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:52.295472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3ed7e-9f96-489e-9bd0-37a4866b716b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:52.302575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579f8a9-5c9c-4a28-9831-9e22ee955f69 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.302861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579f8a9-5c9c-4a28-9831-9e22ee955f69 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.303133 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579f8a9-5c9c-4a28-9831-9e22ee955f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.332500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-6579f8a9-5c9c-4a28-9831-9e22ee955f69 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:52.333757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6579f8a9-5c9c-4a28-9831-9e22ee955f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:52.420103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:52.437928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3ed7e-9f96-489e-9bd0-37a4866b716b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.474930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ae04e-5e2d-4415-addc-3e2b990fa305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.475576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ae04e-5e2d-4415-addc-3e2b990fa305 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.475890 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ae04e-5e2d-4415-addc-3e2b990fa305 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.476164 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ae04e-5e2d-4415-addc-3e2b990fa305 None admin] PATH_INFO: `/v3/groups/9e3213e97d924a658f48ac3993e8243a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.477376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ae04e-5e2d-4415-addc-3e2b990fa305 None admin] RBAC: Authorizing `identity:get_group(group_id=9e3213e97d924a658f48ac3993e8243a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:52.478901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ae04e-5e2d-4415-addc-3e2b990fa305 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:52.481901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 202/400] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:52 2022] GET /identity/v3/groups/9e3213e97d924a658f48ac3993e8243a => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:52.489047 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ae04e-5e2d-4415-addc-3e2b990fa305 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:52.493964 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 199/401] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:52.603941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ae04e-5e2d-4415-addc-3e2b990fa305 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.645072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23542734-d534-463d-9e3d-def824684b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.645803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23542734-d534-463d-9e3d-def824684b6b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.646122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23542734-d534-463d-9e3d-def824684b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.646799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23542734-d534-463d-9e3d-def824684b6b None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.647545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23542734-d534-463d-9e3d-def824684b6b None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:52.648963 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23542734-d534-463d-9e3d-def824684b6b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:52.650971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 203/402] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:52 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:52.656738 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579f8a9-5c9c-4a28-9831-9e22ee955f69 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:52.673835 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:52.789124 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579f8a9-5c9c-4a28-9831-9e22ee955f69 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.825943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23542734-d534-463d-9e3d-def824684b6b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:52.830285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2df88-98ec-49ae-baab-a0dfa0830272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.831013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2df88-98ec-49ae-baab-a0dfa0830272 None admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.831301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2df88-98ec-49ae-baab-a0dfa0830272 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.831575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2df88-98ec-49ae-baab-a0dfa0830272 None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e/groups/9e3213e97d924a658f48ac3993e8243a/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.837037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2df88-98ec-49ae-baab-a0dfa0830272 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d0c329e56b34ee385eebcfa74a51f6e, group_id=9e3213e97d924a658f48ac3993e8243a, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:52.838509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2df88-98ec-49ae-baab-a0dfa0830272 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:52.848537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:52.861250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 200/403] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Aug 31 00:07:52 2022] PUT /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e/groups/9e3213e97d924a658f48ac3993e8243a/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:52.886558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b047ff-db1b-40ee-b168-32ebe79df002 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.886956 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b047ff-db1b-40ee-b168-32ebe79df002 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.887135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b047ff-db1b-40ee-b168-32ebe79df002 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.889082 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 201/404] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:52.894745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81071d5b-b07d-438b-8f6c-590d1a98a4ac None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.895035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81071d5b-b07d-438b-8f6c-590d1a98a4ac None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.895307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81071d5b-b07d-438b-8f6c-590d1a98a4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.936877 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-81071d5b-b07d-438b-8f6c-590d1a98a4ac None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:52.938121 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-81071d5b-b07d-438b-8f6c-590d1a98a4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:52.951749 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23542734-d534-463d-9e3d-def824684b6b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.991542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09b6d4-4842-490d-9ed2-decfb540c35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.992267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09b6d4-4842-490d-9ed2-decfb540c35f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.992622 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09b6d4-4842-490d-9ed2-decfb540c35f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.992900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09b6d4-4842-490d-9ed2-decfb540c35f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:53.005210 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09b6d4-4842-490d-9ed2-decfb540c35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-6c09b6d4-4842-490d-9ed2-decfb540c35f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:53.011572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:53.012646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:53.013467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:53.013467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:53.013467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:53.013467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:53.013467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:53.013467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:53.013467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:53.013467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:53.013467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:53.013467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:53.013467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:53.013467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:53.013467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 204/405] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:53.023826 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09b6d4-4842-490d-9ed2-decfb540c35f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:53.102511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:53.110393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 202/406] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:53.132116 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:53.143589 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09b6d4-4842-490d-9ed2-decfb540c35f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:53.187513 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86efa81-29f5-41c9-ac79-2450109911c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:53.188174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86efa81-29f5-41c9-ac79-2450109911c8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:53.188510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86efa81-29f5-41c9-ac79-2450109911c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:53.188793 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86efa81-29f5-41c9-ac79-2450109911c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:53.189481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86efa81-29f5-41c9-ac79-2450109911c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:53.189788 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86efa81-29f5-41c9-ac79-2450109911c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:53.191178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86efa81-29f5-41c9-ac79-2450109911c8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:53.200291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 205/407] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:53.205734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81071d5b-b07d-438b-8f6c-590d1a98a4ac None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:53.347300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81071d5b-b07d-438b-8f6c-590d1a98a4ac None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:53.399262 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b4c78-65df-4aae-a99f-217b49d860ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:53.400343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4c78-65df-4aae-a99f-217b49d860ad None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:53.400853 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4c78-65df-4aae-a99f-217b49d860ad None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:53.401325 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4c78-65df-4aae-a99f-217b49d860ad None admin] PATH_INFO: `/v3/groups/9e3213e97d924a658f48ac3993e8243a` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:53.402659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b4c78-65df-4aae-a99f-217b49d860ad None admin] RBAC: Authorizing `identity:get_group(group_id=9e3213e97d924a658f48ac3993e8243a)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:53.404478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b4c78-65df-4aae-a99f-217b49d860ad None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:53.406664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 203/408] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:53 2022] GET /identity/v3/groups/9e3213e97d924a658f48ac3993e8243a => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:53.416811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86efa81-29f5-41c9-ac79-2450109911c8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:53.550332 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86efa81-29f5-41c9-ac79-2450109911c8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:53.572811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b4c78-65df-4aae-a99f-217b49d860ad None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:53.587369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d24f6-57dd-4def-a37c-4338a69db5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:53.590397 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d24f6-57dd-4def-a37c-4338a69db5ee None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:53.590755 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d24f6-57dd-4def-a37c-4338a69db5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:53.591036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d24f6-57dd-4def-a37c-4338a69db5ee None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:53.593150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d24f6-57dd-4def-a37c-4338a69db5ee None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:53.593780 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d24f6-57dd-4def-a37c-4338a69db5ee None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:53.600351 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 206/409] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:53 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:53.601163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d24f6-57dd-4def-a37c-4338a69db5ee None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:53.623575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:53.699268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:53.762369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d24f6-57dd-4def-a37c-4338a69db5ee None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:53.770011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b4c78-65df-4aae-a99f-217b49d860ad None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:53.817090 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35a4d-b4dd-45f2-8066-7fec231e1b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:53.817757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35a4d-b4dd-45f2-8066-7fec231e1b0c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:53.818040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35a4d-b4dd-45f2-8066-7fec231e1b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:53.818309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35a4d-b4dd-45f2-8066-7fec231e1b0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:53.839687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fff986-b0c9-478a-975d-a68366f1afdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:53.839687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fff986-b0c9-478a-975d-a68366f1afdc None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:53.839687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fff986-b0c9-478a-975d-a68366f1afdc None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:53.839687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fff986-b0c9-478a-975d-a68366f1afdc None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e/groups/9e3213e97d924a658f48ac3993e8243a/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:53.840522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e35a4d-b4dd-45f2-8066-7fec231e1b0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-62e35a4d-b4dd-45f2-8066-7fec231e1b0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:53.844030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:53.846496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:53.850859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:53.850859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:53.850859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:53.850859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:53.850859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:53.850859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:53.850859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:53.850859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:53.850859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:53.850859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:53.850859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:53.850859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:53.850859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 204/410] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:53.853045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fff986-b0c9-478a-975d-a68366f1afdc None admin] RBAC: Authorizing `identity:create_grant(project_id=0d0c329e56b34ee385eebcfa74a51f6e, group_id=9e3213e97d924a658f48ac3993e8243a, role_id=f9b0f326bcf6425d9e2aa62dc35ddbc1)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:53.855719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fff986-b0c9-478a-975d-a68366f1afdc None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:53.859452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35a4d-b4dd-45f2-8066-7fec231e1b0c None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:53.878099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 207/411] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Aug 31 00:07:53 2022] PUT /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e/groups/9e3213e97d924a658f48ac3993e8243a/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:07:54.016345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35a4d-b4dd-45f2-8066-7fec231e1b0c None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:54.049334 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c016f-7359-4cf0-8497-15d3c4c1f2cf None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.049718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c016f-7359-4cf0-8497-15d3c4c1f2cf None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.049913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c016f-7359-4cf0-8497-15d3c4c1f2cf None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.051272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 208/412] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:54.057080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69772a0b-3a1b-4805-9666-6c688fccec10 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.057382 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69772a0b-3a1b-4805-9666-6c688fccec10 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.057626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69772a0b-3a1b-4805-9666-6c688fccec10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.060048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:54.066676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72c7e8-7f06-4dab-9f35-dd1cbd49c58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:54.067365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72c7e8-7f06-4dab-9f35-dd1cbd49c58a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.067659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72c7e8-7f06-4dab-9f35-dd1cbd49c58a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.067963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72c7e8-7f06-4dab-9f35-dd1cbd49c58a None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.068656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72c7e8-7f06-4dab-9f35-dd1cbd49c58a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:54.069008 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72c7e8-7f06-4dab-9f35-dd1cbd49c58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:54.070567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72c7e8-7f06-4dab-9f35-dd1cbd49c58a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:54.080629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 205/413] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:54.086429 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72c7e8-7f06-4dab-9f35-dd1cbd49c58a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:54.111964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-69772a0b-3a1b-4805-9666-6c688fccec10 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:54.113205 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-69772a0b-3a1b-4805-9666-6c688fccec10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:54.205461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72c7e8-7f06-4dab-9f35-dd1cbd49c58a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:54.242704 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d46f79-a0f8-4e18-a14a-3f7734ee1048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:54.243430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d46f79-a0f8-4e18-a14a-3f7734ee1048 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.243733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d46f79-a0f8-4e18-a14a-3f7734ee1048 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.244093 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d46f79-a0f8-4e18-a14a-3f7734ee1048 None admin] PATH_INFO: `/v3/groups/517a68222ce44886bc53b6f20350b99e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.245239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d46f79-a0f8-4e18-a14a-3f7734ee1048 None admin] RBAC: Authorizing `identity:get_group(group_id=517a68222ce44886bc53b6f20350b99e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:54.246699 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d46f79-a0f8-4e18-a14a-3f7734ee1048 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:54.248401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 206/414] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:54 2022] GET /identity/v3/groups/517a68222ce44886bc53b6f20350b99e => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:54.253980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d46f79-a0f8-4e18-a14a-3f7734ee1048 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:54.259069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:54.272733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 209/415] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:54.314479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:54.361775 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d46f79-a0f8-4e18-a14a-3f7734ee1048 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:54.396116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aca226-7ce5-4c70-ac2b-8e2553d832fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:54.396755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aca226-7ce5-4c70-ac2b-8e2553d832fd None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.397033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aca226-7ce5-4c70-ac2b-8e2553d832fd None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.397305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aca226-7ce5-4c70-ac2b-8e2553d832fd None admin] PATH_INFO: `/v3/projects/8ead22b3b4a34507bccadbdf3ec17342` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.398450 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aca226-7ce5-4c70-ac2b-8e2553d832fd None admin] RBAC: Authorizing `identity:get_project(project_id=8ead22b3b4a34507bccadbdf3ec17342)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:54.399958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aca226-7ce5-4c70-ac2b-8e2553d832fd None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:54.401932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 207/416] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:54 2022] GET /identity/v3/projects/8ead22b3b4a34507bccadbdf3ec17342 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:54.407786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69772a0b-3a1b-4805-9666-6c688fccec10 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:54.449009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e452cd-0cba-4f4d-9f86-edab413edc44 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.449354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e452cd-0cba-4f4d-9f86-edab413edc44 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.449556 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e452cd-0cba-4f4d-9f86-edab413edc44 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.451234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 208/417] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:54.456058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96ab5f-4dc4-4944-8eda-8d3737c94c0a None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.456347 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96ab5f-4dc4-4944-8eda-8d3737c94c0a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.456627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96ab5f-4dc4-4944-8eda-8d3737c94c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.481303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7d96ab5f-4dc4-4944-8eda-8d3737c94c0a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:54.482499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7d96ab5f-4dc4-4944-8eda-8d3737c94c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:54.551807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69772a0b-3a1b-4805-9666-6c688fccec10 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:54.571891 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 209/418] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:54.611209 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277596-5cc3-46f6-852a-5858439685f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:54.612274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277596-5cc3-46f6-852a-5858439685f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.612768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277596-5cc3-46f6-852a-5858439685f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.613249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277596-5cc3-46f6-852a-5858439685f6 None admin] PATH_INFO: `/v3/projects/8ead22b3b4a34507bccadbdf3ec17342/groups/517a68222ce44886bc53b6f20350b99e/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.620974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41277596-5cc3-46f6-852a-5858439685f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ead22b3b4a34507bccadbdf3ec17342, group_id=517a68222ce44886bc53b6f20350b99e, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:54.622711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41277596-5cc3-46f6-852a-5858439685f6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:54.641017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 210/419] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Aug 31 00:07:54 2022] PUT /identity/v3/projects/8ead22b3b4a34507bccadbdf3ec17342/groups/517a68222ce44886bc53b6f20350b99e/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:54.668075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96ab5f-4dc4-4944-8eda-8d3737c94c0a None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:54.746571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:54.808623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96ab5f-4dc4-4944-8eda-8d3737c94c0a None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:54.846060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277596-5cc3-46f6-852a-5858439685f6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:54.846530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abdbb9-12f4-428c-8fd9-0afea516d549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:54.847265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abdbb9-12f4-428c-8fd9-0afea516d549 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.847548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abdbb9-12f4-428c-8fd9-0afea516d549 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.847852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abdbb9-12f4-428c-8fd9-0afea516d549 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.866069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abdbb9-12f4-428c-8fd9-0afea516d549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-08abdbb9-12f4-428c-8fd9-0afea516d549 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:54.871150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:54.872150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:54.873019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:54.873019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:54.873019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:54.873019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:54.873019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:54.873019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:54.873019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:54.873019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:54.873019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:54.873019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:54.873019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:54.873019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:54.873019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 210/420] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:54.883652 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abdbb9-12f4-428c-8fd9-0afea516d549 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:54.924242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:54.972046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277596-5cc3-46f6-852a-5858439685f6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.008709 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb582da1-975d-4156-90d4-a35909a148b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.009737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb582da1-975d-4156-90d4-a35909a148b6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.010221 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb582da1-975d-4156-90d4-a35909a148b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.010679 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb582da1-975d-4156-90d4-a35909a148b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.016337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abdbb9-12f4-428c-8fd9-0afea516d549 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.029122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb582da1-975d-4156-90d4-a35909a148b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-eb582da1-975d-4156-90d4-a35909a148b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:55.035813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:55.036716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:55.037564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:55.037564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:55.037564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:55.037564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:55.037564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:55.037564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:55.037564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:55.037564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:55.037564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:55.037564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:55.037564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:55.037564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:55.041474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 211/421] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:55.047737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.048671 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb582da1-975d-4156-90d4-a35909a148b6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.102595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aee677-0118-4968-b4d0-a0050354b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.103170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aee677-0118-4968-b4d0-a0050354b3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.103449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aee677-0118-4968-b4d0-a0050354b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.103798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aee677-0118-4968-b4d0-a0050354b3b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.104478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aee677-0118-4968-b4d0-a0050354b3b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:55.104778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aee677-0118-4968-b4d0-a0050354b3b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.106188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aee677-0118-4968-b4d0-a0050354b3b3 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.121119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 211/422] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:55.128214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aee677-0118-4968-b4d0-a0050354b3b3 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.200970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb582da1-975d-4156-90d4-a35909a148b6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.219321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.257386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31984ea5-d33b-4b0c-aba9-4d65b89c9c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.258022 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31984ea5-d33b-4b0c-aba9-4d65b89c9c5b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.258302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31984ea5-d33b-4b0c-aba9-4d65b89c9c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.258577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31984ea5-d33b-4b0c-aba9-4d65b89c9c5b None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.259244 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31984ea5-d33b-4b0c-aba9-4d65b89c9c5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:55.259811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31984ea5-d33b-4b0c-aba9-4d65b89c9c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.260985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31984ea5-d33b-4b0c-aba9-4d65b89c9c5b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.275417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 212/423] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:55.281361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31984ea5-d33b-4b0c-aba9-4d65b89c9c5b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.339463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aee677-0118-4968-b4d0-a0050354b3b3 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.381267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f8b9a-686c-4618-b02b-efc468f92d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.382174 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f8b9a-686c-4618-b02b-efc468f92d47 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.382453 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f8b9a-686c-4618-b02b-efc468f92d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.382727 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f8b9a-686c-4618-b02b-efc468f92d47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.423180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31984ea5-d33b-4b0c-aba9-4d65b89c9c5b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.443350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.461460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7d89c-7799-45a6-93a2-42e0ff05ad96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.462089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7d89c-7799-45a6-93a2-42e0ff05ad96 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.462371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7d89c-7799-45a6-93a2-42e0ff05ad96 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.462646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7d89c-7799-45a6-93a2-42e0ff05ad96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.471488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f8b9a-686c-4618-b02b-efc468f92d47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.473735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f8b9a-686c-4618-b02b-efc468f92d47 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.510261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.532643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7d89c-7799-45a6-93a2-42e0ff05ad96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.534118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7d89c-7799-45a6-93a2-42e0ff05ad96 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.583795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 212/424] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:55.585364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b777b-710f-422b-9a56-265bff63c964 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.585887 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b777b-710f-422b-9a56-265bff63c964 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.586313 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b777b-710f-422b-9a56-265bff63c964 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.587737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 213/425] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:55.592779 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b777b-710f-422b-9a56-265bff63c964 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.634204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 213/426] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:55.635523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19776b4-1fb5-403b-b5c1-549415a42cce None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.635839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19776b4-1fb5-403b-b5c1-549415a42cce None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.636117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19776b4-1fb5-403b-b5c1-549415a42cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.654456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c19776b4-1fb5-403b-b5c1-549415a42cce None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:55.655789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c19776b4-1fb5-403b-b5c1-549415a42cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:55.677410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.705265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b777b-710f-422b-9a56-265bff63c964 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.731723 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 214/427] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:55.731723 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19776b4-1fb5-403b-b5c1-549415a42cce None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.737245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.768845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949fbaa-ff84-4feb-b291-803e04763c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.770251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949fbaa-ff84-4feb-b291-803e04763c3e None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.771123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949fbaa-ff84-4feb-b291-803e04763c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.771840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949fbaa-ff84-4feb-b291-803e04763c3e None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.777005 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949fbaa-ff84-4feb-b291-803e04763c3e None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.780062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949fbaa-ff84-4feb-b291-803e04763c3e None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.782541 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 214/428] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:55.787764 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949fbaa-ff84-4feb-b291-803e04763c3e None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.843320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19776b4-1fb5-403b-b5c1-549415a42cce None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.880129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644b421-ac97-43c2-a84c-b57491507725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.880814 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644b421-ac97-43c2-a84c-b57491507725 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.881099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644b421-ac97-43c2-a84c-b57491507725 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.881375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644b421-ac97-43c2-a84c-b57491507725 None admin] PATH_INFO: `/v3/projects/1221b9ee938248cf926034ec51adb9cf` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.882526 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644b421-ac97-43c2-a84c-b57491507725 None admin] RBAC: Authorizing `identity:get_project(project_id=1221b9ee938248cf926034ec51adb9cf)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.887809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644b421-ac97-43c2-a84c-b57491507725 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.887809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 215/429] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/projects/1221b9ee938248cf926034ec51adb9cf => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:55.891241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644b421-ac97-43c2-a84c-b57491507725 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.966830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949fbaa-ff84-4feb-b291-803e04763c3e None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.037863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b0c04-a3c6-4a23-91a1-1b1f606e8a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.038412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b0c04-a3c6-4a23-91a1-1b1f606e8a10 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.038688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b0c04-a3c6-4a23-91a1-1b1f606e8a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.038952 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b0c04-a3c6-4a23-91a1-1b1f606e8a10 None admin] PATH_INFO: `/v3/groups/9e3213e97d924a658f48ac3993e8243a` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.040528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:56.041610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b0c04-a3c6-4a23-91a1-1b1f606e8a10 None admin] RBAC: Authorizing `identity:get_group(group_id=9e3213e97d924a658f48ac3993e8243a)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:56.043321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b0c04-a3c6-4a23-91a1-1b1f606e8a10 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:56.050509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 215/430] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/groups/9e3213e97d924a658f48ac3993e8243a => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:56.056019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b0c04-a3c6-4a23-91a1-1b1f606e8a10 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:56.065936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644b421-ac97-43c2-a84c-b57491507725 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.076001 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:56.116820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcd24b-c9e1-4acb-8734-a3b79d531886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.117747 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcd24b-c9e1-4acb-8734-a3b79d531886 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.118178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcd24b-c9e1-4acb-8734-a3b79d531886 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.118609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcd24b-c9e1-4acb-8734-a3b79d531886 None admin] PATH_INFO: `/v3/groups/9e3213e97d924a658f48ac3993e8243a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.120677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcd24b-c9e1-4acb-8734-a3b79d531886 None admin] RBAC: Authorizing `identity:get_group(group_id=9e3213e97d924a658f48ac3993e8243a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:56.125075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcd24b-c9e1-4acb-8734-a3b79d531886 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:56.128174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 216/431] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/groups/9e3213e97d924a658f48ac3993e8243a => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:56.133371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcd24b-c9e1-4acb-8734-a3b79d531886 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:56.209395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b0c04-a3c6-4a23-91a1-1b1f606e8a10 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.242647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcd24b-c9e1-4acb-8734-a3b79d531886 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.246577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7b490-8623-4560-ba83-132de8558b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.248346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7b490-8623-4560-ba83-132de8558b8a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.248787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7b490-8623-4560-ba83-132de8558b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.249257 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7b490-8623-4560-ba83-132de8558b8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.250313 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7b490-8623-4560-ba83-132de8558b8a None admin] RBAC: Adding query filter params (group.id=9e3213e97d924a658f48ac3993e8243a, role.id=8615852d81aa46c39661d01a0372d8e8, scope.project.id=1221b9ee938248cf926034ec51adb9cf) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:56.250820 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7b490-8623-4560-ba83-132de8558b8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:56.252552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7b490-8623-4560-ba83-132de8558b8a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:56.260908 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 216/432] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 31 00:07:56 2022] GET /identity/v3/role_assignments?group.id=9e3213e97d924a658f48ac3993e8243a&scope.project.id=1221b9ee938248cf926034ec51adb9cf&role.id=8615852d81aa46c39661d01a0372d8e8 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:56.262076 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7b490-8623-4560-ba83-132de8558b8a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:56.280855 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f7904-560a-4975-92fd-fff382963900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.281528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f7904-560a-4975-92fd-fff382963900 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.281780 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f7904-560a-4975-92fd-fff382963900 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.282063 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f7904-560a-4975-92fd-fff382963900 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.282824 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f7904-560a-4975-92fd-fff382963900 None admin] RBAC: Adding query filter params (group.id=9e3213e97d924a658f48ac3993e8243a, role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1, scope.project.id=1221b9ee938248cf926034ec51adb9cf) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:56.283141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f7904-560a-4975-92fd-fff382963900 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:56.284692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f7904-560a-4975-92fd-fff382963900 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:56.291671 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 217/433] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 31 00:07:56 2022] GET /identity/v3/role_assignments?group.id=9e3213e97d924a658f48ac3993e8243a&scope.project.id=1221b9ee938248cf926034ec51adb9cf&role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:56.331802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b62c6-a9aa-464b-a735-1a85d9842c14 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.332177 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b62c6-a9aa-464b-a735-1a85d9842c14 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.332347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b62c6-a9aa-464b-a735-1a85d9842c14 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.333736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 218/434] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:56.343219 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470af705-2070-49aa-97c3-de1c90ea37ec None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.343450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470af705-2070-49aa-97c3-de1c90ea37ec None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.343651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470af705-2070-49aa-97c3-de1c90ea37ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.361446 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:56.381668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-470af705-2070-49aa-97c3-de1c90ea37ec None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:56.383620 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-470af705-2070-49aa-97c3-de1c90ea37ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:56.389599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:56.408318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7b490-8623-4560-ba83-132de8558b8a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.482695 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae27efb-391d-4fa6-884b-de2da2510914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.483730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27efb-391d-4fa6-884b-de2da2510914 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.484294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27efb-391d-4fa6-884b-de2da2510914 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.484754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27efb-391d-4fa6-884b-de2da2510914 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.498684 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae27efb-391d-4fa6-884b-de2da2510914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-3ae27efb-391d-4fa6-884b-de2da2510914 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:56.505106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:56.506045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:56.506854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:56.506854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:56.506854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:56.506854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:56.506854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:56.506854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:56.506854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:56.506854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:56.506854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:56.506854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:56.506854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:07:56.506854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:56.509514 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 217/435] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:56.511495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 219/436] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:56.516163 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae27efb-391d-4fa6-884b-de2da2510914 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:56.624953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae27efb-391d-4fa6-884b-de2da2510914 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.659386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432bfbc-5bf1-4e84-8ced-f7ffb409a648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.660025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432bfbc-5bf1-4e84-8ced-f7ffb409a648 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.660299 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432bfbc-5bf1-4e84-8ced-f7ffb409a648 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.660686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432bfbc-5bf1-4e84-8ced-f7ffb409a648 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.661454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432bfbc-5bf1-4e84-8ced-f7ffb409a648 None admin] RBAC: Adding query filter params (name=member) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:56.661755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432bfbc-5bf1-4e84-8ced-f7ffb409a648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:56.663197 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432bfbc-5bf1-4e84-8ced-f7ffb409a648 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:56.665520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:56.673927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 218/437] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:07:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:56.680021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470af705-2070-49aa-97c3-de1c90ea37ec None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:56.786946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470af705-2070-49aa-97c3-de1c90ea37ec None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.806785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432bfbc-5bf1-4e84-8ced-f7ffb409a648 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:56.824784 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a1a8b-cd87-4c97-99c8-4f090ee71b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.825488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a1a8b-cd87-4c97-99c8-4f090ee71b55 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.825769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a1a8b-cd87-4c97-99c8-4f090ee71b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.826045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a1a8b-cd87-4c97-99c8-4f090ee71b55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.834864 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:56.903862 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a1a8b-cd87-4c97-99c8-4f090ee71b55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:56.905583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a1a8b-cd87-4c97-99c8-4f090ee71b55 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:56.938775 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432bfbc-5bf1-4e84-8ced-f7ffb409a648 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.982654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9347cb-0942-4c83-a874-8e5fa70d4a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.982654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9347cb-0942-4c83-a874-8e5fa70d4a56 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.982654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9347cb-0942-4c83-a874-8e5fa70d4a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.982654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9347cb-0942-4c83-a874-8e5fa70d4a56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.993875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9347cb-0942-4c83-a874-8e5fa70d4a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-ed9347cb-0942-4c83-a874-8e5fa70d4a56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:56.999383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:57.000373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:57.001205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:57.001205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:57.001205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:57.001205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:57.001205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:57.001205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:57.001205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:57.001205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:57.001205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:57.001205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:57.001205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:57.001205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:07:57.001834 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 219/438] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:57.002987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b362e5-7d8a-49cf-ab8a-5c090140665c None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.003274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b362e5-7d8a-49cf-ab8a-5c090140665c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.003577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b362e5-7d8a-49cf-ab8a-5c090140665c None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.004969 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 220/439] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:57.008500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b362e5-7d8a-49cf-ab8a-5c090140665c None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.023171 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 220/440] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:57.027759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa87248-ac8f-4a18-9fa6-a10f689d66b2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.027759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa87248-ac8f-4a18-9fa6-a10f689d66b2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.027759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa87248-ac8f-4a18-9fa6-a10f689d66b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.045489 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-5aa87248-ac8f-4a18-9fa6-a10f689d66b2 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:57.046608 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5aa87248-ac8f-4a18-9fa6-a10f689d66b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:57.073549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:57.077617 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:57.113971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 221/441] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:57.114821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa87248-ac8f-4a18-9fa6-a10f689d66b2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.118423 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b362e5-7d8a-49cf-ab8a-5c090140665c None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.155500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d632b7-ab98-48ed-ac9b-d0e656a09587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.156143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d632b7-ab98-48ed-ac9b-d0e656a09587 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.156424 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d632b7-ab98-48ed-ac9b-d0e656a09587 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.156717 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d632b7-ab98-48ed-ac9b-d0e656a09587 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.157380 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d632b7-ab98-48ed-ac9b-d0e656a09587 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:57.157776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d632b7-ab98-48ed-ac9b-d0e656a09587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:57.159179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d632b7-ab98-48ed-ac9b-d0e656a09587 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:57.171861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 221/442] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:57.173786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d632b7-ab98-48ed-ac9b-d0e656a09587 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.227974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa87248-ac8f-4a18-9fa6-a10f689d66b2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.263867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37196b4-21a2-46eb-842b-f240056968a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.264537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37196b4-21a2-46eb-842b-f240056968a4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.264809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37196b4-21a2-46eb-842b-f240056968a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.265080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37196b4-21a2-46eb-842b-f240056968a4 None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.266242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37196b4-21a2-46eb-842b-f240056968a4 None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:57.267720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37196b4-21a2-46eb-842b-f240056968a4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:57.269394 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 222/443] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:57.274848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37196b4-21a2-46eb-842b-f240056968a4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.281846 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d632b7-ab98-48ed-ac9b-d0e656a09587 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.306530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:57.315949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:57.323485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e8a53-08f6-4c0c-ac50-5c0c7a39f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.324131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e8a53-08f6-4c0c-ac50-5c0c7a39f5ac None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.324434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e8a53-08f6-4c0c-ac50-5c0c7a39f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.325039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e8a53-08f6-4c0c-ac50-5c0c7a39f5ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.386506 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37196b4-21a2-46eb-842b-f240056968a4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.394293 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e8a53-08f6-4c0c-ac50-5c0c7a39f5ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:57.395820 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e8a53-08f6-4c0c-ac50-5c0c7a39f5ac None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:57.420918 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2b6e6-5161-4c0d-8cf1-11df936fe057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.421548 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2b6e6-5161-4c0d-8cf1-11df936fe057 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.421820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2b6e6-5161-4c0d-8cf1-11df936fe057 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.422068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2b6e6-5161-4c0d-8cf1-11df936fe057 None admin] PATH_INFO: `/v3/groups/9e3213e97d924a658f48ac3993e8243a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.423244 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2b6e6-5161-4c0d-8cf1-11df936fe057 None admin] RBAC: Authorizing `identity:get_group(group_id=9e3213e97d924a658f48ac3993e8243a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:57.424717 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2b6e6-5161-4c0d-8cf1-11df936fe057 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:57.426400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 223/444] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/groups/9e3213e97d924a658f48ac3993e8243a => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:57.427143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2b6e6-5161-4c0d-8cf1-11df936fe057 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.497007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 222/445] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:07:57.498233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e8a53-08f6-4c0c-ac50-5c0c7a39f5ac None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.520406 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:57.527823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2b6e6-5161-4c0d-8cf1-11df936fe057 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.530149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:57.562193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459342f7-f13f-49c0-a128-3f50e2b1dc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.562766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459342f7-f13f-49c0-a128-3f50e2b1dc01 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.563064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459342f7-f13f-49c0-a128-3f50e2b1dc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.563316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459342f7-f13f-49c0-a128-3f50e2b1dc01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.573552 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459342f7-f13f-49c0-a128-3f50e2b1dc01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-459342f7-f13f-49c0-a128-3f50e2b1dc01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:57.578433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:57.579347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:57.580214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:57.580214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:57.580214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:57.580214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:57.580214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:57.580214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:57.580214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:57.580214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:57.580214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:57.580214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:57.580214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:57.580214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:07:57.580214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 224/446] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:57.580896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459342f7-f13f-49c0-a128-3f50e2b1dc01 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.602540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e8a53-08f6-4c0c-ac50-5c0c7a39f5ac None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.635343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480abee-d278-4ad0-a229-9e9c3c268f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.635985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480abee-d278-4ad0-a229-9e9c3c268f41 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.636274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480abee-d278-4ad0-a229-9e9c3c268f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.636520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480abee-d278-4ad0-a229-9e9c3c268f41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.637244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480abee-d278-4ad0-a229-9e9c3c268f41 None admin] RBAC: Adding query filter params (group.id=9e3213e97d924a658f48ac3993e8243a, role.id=8615852d81aa46c39661d01a0372d8e8, scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:57.637546 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480abee-d278-4ad0-a229-9e9c3c268f41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:57.639075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480abee-d278-4ad0-a229-9e9c3c268f41 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:57.644826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 223/447] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/role_assignments?group.id=9e3213e97d924a658f48ac3993e8243a&scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e&role.id=8615852d81aa46c39661d01a0372d8e8 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:57.645611 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480abee-d278-4ad0-a229-9e9c3c268f41 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.692841 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459342f7-f13f-49c0-a128-3f50e2b1dc01 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.733453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cb509-5a57-4344-88a8-046248d30e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.734112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cb509-5a57-4344-88a8-046248d30e3a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.734392 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cb509-5a57-4344-88a8-046248d30e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.735269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cb509-5a57-4344-88a8-046248d30e3a None admin] PATH_INFO: `/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.736536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cb509-5a57-4344-88a8-046248d30e3a None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c329e56b34ee385eebcfa74a51f6e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:57.738766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cb509-5a57-4344-88a8-046248d30e3a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:57.740770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 225/448] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/projects/0d0c329e56b34ee385eebcfa74a51f6e => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:57.745501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:57.746395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cb509-5a57-4344-88a8-046248d30e3a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.763604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480abee-d278-4ad0-a229-9e9c3c268f41 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.783303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:57.805842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079614ab-ff36-4044-a550-a3282065fc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.807316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079614ab-ff36-4044-a550-a3282065fc6d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.807316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079614ab-ff36-4044-a550-a3282065fc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.807316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079614ab-ff36-4044-a550-a3282065fc6d None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.807953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079614ab-ff36-4044-a550-a3282065fc6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:57.807953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079614ab-ff36-4044-a550-a3282065fc6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:57.809385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079614ab-ff36-4044-a550-a3282065fc6d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:57.821635 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 224/449] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:57.828571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079614ab-ff36-4044-a550-a3282065fc6d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.870156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cb509-5a57-4344-88a8-046248d30e3a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.909863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3cbf5-8aae-46e8-899f-2bb2d0a3ccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.910519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3cbf5-8aae-46e8-899f-2bb2d0a3ccd4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.910812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3cbf5-8aae-46e8-899f-2bb2d0a3ccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.911062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3cbf5-8aae-46e8-899f-2bb2d0a3ccd4 None admin] PATH_INFO: `/v3/groups/9e3213e97d924a658f48ac3993e8243a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.912348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3cbf5-8aae-46e8-899f-2bb2d0a3ccd4 None admin] RBAC: Authorizing `identity:get_group(group_id=9e3213e97d924a658f48ac3993e8243a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:57.913845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3cbf5-8aae-46e8-899f-2bb2d0a3ccd4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:57.915439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 226/450] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/groups/9e3213e97d924a658f48ac3993e8243a => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:57.921670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3cbf5-8aae-46e8-899f-2bb2d0a3ccd4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.947455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079614ab-ff36-4044-a550-a3282065fc6d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.988218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51bc55-250e-4854-afca-95956b38d322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.988960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bc55-250e-4854-afca-95956b38d322 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.989148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bc55-250e-4854-afca-95956b38d322 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.989410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bc55-250e-4854-afca-95956b38d322 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.006906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:58.040889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:58.043936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3cbf5-8aae-46e8-899f-2bb2d0a3ccd4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:58.063301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51bc55-250e-4854-afca-95956b38d322 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.064827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51bc55-250e-4854-afca-95956b38d322 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:58.079913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eeba6-69cf-4bad-b1a7-076e1a7f0613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:58.080468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eeba6-69cf-4bad-b1a7-076e1a7f0613 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.080750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eeba6-69cf-4bad-b1a7-076e1a7f0613 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.081022 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eeba6-69cf-4bad-b1a7-076e1a7f0613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.081752 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eeba6-69cf-4bad-b1a7-076e1a7f0613 None admin] RBAC: Adding query filter params (group.id=9e3213e97d924a658f48ac3993e8243a, role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1, scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:58.082060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eeba6-69cf-4bad-b1a7-076e1a7f0613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.083470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eeba6-69cf-4bad-b1a7-076e1a7f0613 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:58.089370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 227/451] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/role_assignments?group.id=9e3213e97d924a658f48ac3993e8243a&scope.project.id=0d0c329e56b34ee385eebcfa74a51f6e&role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:58.171230 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 225/452] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:58.177392 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eeba6-69cf-4bad-b1a7-076e1a7f0613 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:58.285475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eeba6-69cf-4bad-b1a7-076e1a7f0613 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:58.320952 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bea379-8d8b-4caf-98de-91a941d483fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:58.321595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bea379-8d8b-4caf-98de-91a941d483fa None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.321879 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bea379-8d8b-4caf-98de-91a941d483fa None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.322162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bea379-8d8b-4caf-98de-91a941d483fa None admin] PATH_INFO: `/v3/projects/8ead22b3b4a34507bccadbdf3ec17342` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.323362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bea379-8d8b-4caf-98de-91a941d483fa None admin] RBAC: Authorizing `identity:get_project(project_id=8ead22b3b4a34507bccadbdf3ec17342)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.324861 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bea379-8d8b-4caf-98de-91a941d483fa None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:58.326592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 228/453] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:07:58 2022] GET /identity/v3/projects/8ead22b3b4a34507bccadbdf3ec17342 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:58.332716 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51bc55-250e-4854-afca-95956b38d322 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:58.382098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:58.436472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51bc55-250e-4854-afca-95956b38d322 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:58.470987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8086db-34d4-45bf-ab53-5b8132681722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:58.471623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8086db-34d4-45bf-ab53-5b8132681722 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.471937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8086db-34d4-45bf-ab53-5b8132681722 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.472209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8086db-34d4-45bf-ab53-5b8132681722 None admin] PATH_INFO: `/v3/groups/517a68222ce44886bc53b6f20350b99e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.473486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8086db-34d4-45bf-ab53-5b8132681722 None admin] RBAC: Authorizing `identity:get_group(group_id=517a68222ce44886bc53b6f20350b99e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.474957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8086db-34d4-45bf-ab53-5b8132681722 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:58.476619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 226/454] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Aug 31 00:07:58 2022] GET /identity/v3/groups/517a68222ce44886bc53b6f20350b99e => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:58.482829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bea379-8d8b-4caf-98de-91a941d483fa None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:58.516183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:58.590019 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bea379-8d8b-4caf-98de-91a941d483fa None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:58.624948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fa39c-2d65-4086-85c8-a0b71f9646a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:58.625559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fa39c-2d65-4086-85c8-a0b71f9646a0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.625837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fa39c-2d65-4086-85c8-a0b71f9646a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.626103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fa39c-2d65-4086-85c8-a0b71f9646a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.626828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fa39c-2d65-4086-85c8-a0b71f9646a0 None admin] RBAC: Adding query filter params (group.id=517a68222ce44886bc53b6f20350b99e, role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=8ead22b3b4a34507bccadbdf3ec17342) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:58.627144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fa39c-2d65-4086-85c8-a0b71f9646a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.628619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fa39c-2d65-4086-85c8-a0b71f9646a0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:58.634577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 229/455] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Aug 31 00:07:58 2022] GET /identity/v3/role_assignments?group.id=517a68222ce44886bc53b6f20350b99e&scope.project.id=8ead22b3b4a34507bccadbdf3ec17342&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:00.871708 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fb233-df67-4aac-9f06-a1f29356e5ad None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:00.872249 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fb233-df67-4aac-9f06-a1f29356e5ad None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:00.872249 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fb233-df67-4aac-9f06-a1f29356e5ad None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:00.873671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 227/456] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:00.885251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d53db-72b9-4bdc-a4d4-486f009fdbc4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:00.886113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d53db-72b9-4bdc-a4d4-486f009fdbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:00.886580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d53db-72b9-4bdc-a4d4-486f009fdbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:00.917024 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-495d53db-72b9-4bdc-a4d4-486f009fdbc4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:00.918591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-495d53db-72b9-4bdc-a4d4-486f009fdbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:01.006269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 230/457] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:01.149297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564bd01-0fb9-49b5-989c-cd18357fd272 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.149474 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564bd01-0fb9-49b5-989c-cd18357fd272 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.149747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564bd01-0fb9-49b5-989c-cd18357fd272 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.151250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 228/458] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:01.156757 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa721-b1a6-4b8f-a92b-ce7163c26ff1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.157293 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa721-b1a6-4b8f-a92b-ce7163c26ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.157772 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa721-b1a6-4b8f-a92b-ce7163c26ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.190445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9bdfa721-b1a6-4b8f-a92b-ce7163c26ff1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:01.191653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9bdfa721-b1a6-4b8f-a92b-ce7163c26ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:01.211975 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.275593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 231/459] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:08:01.361398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564bd01-0fb9-49b5-989c-cd18357fd272 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.513556 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564bd01-0fb9-49b5-989c-cd18357fd272 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:01.532870 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.561865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05ef16-424f-4020-af09-b03eaa7a9940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:01.562910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05ef16-424f-4020-af09-b03eaa7a9940 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.563454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05ef16-424f-4020-af09-b03eaa7a9940 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.563933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05ef16-424f-4020-af09-b03eaa7a9940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.565003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e92aea-1621-4c1a-bf3d-2bd1b08cd610 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.565295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e92aea-1621-4c1a-bf3d-2bd1b08cd610 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.565572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e92aea-1621-4c1a-bf3d-2bd1b08cd610 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.567163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 232/460] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:01.572097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea2dfc-10cd-4861-9554-d3656fab2a13 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.572380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea2dfc-10cd-4861-9554-d3656fab2a13 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.572657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea2dfc-10cd-4861-9554-d3656fab2a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.579736 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05ef16-424f-4020-af09-b03eaa7a9940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:01.582269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05ef16-424f-4020-af09-b03eaa7a9940 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:01.591174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-75ea2dfc-10cd-4861-9554-d3656fab2a13 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:01.592431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-75ea2dfc-10cd-4861-9554-d3656fab2a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-2f05ef16-424f-4020-af09-b03eaa7a9940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:01.607445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:01.608465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:01.609329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:01.609329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:01.609329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:01.611210 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 229/461] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:01.616519 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05ef16-424f-4020-af09-b03eaa7a9940 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.715801 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 233/462] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:08:01.757179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea2dfc-10cd-4861-9554-d3656fab2a13 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.783518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05ef16-424f-4020-af09-b03eaa7a9940 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:01.827819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41def95c-60d0-4a6f-8312-84f933f30fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:01.828918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41def95c-60d0-4a6f-8312-84f933f30fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.829430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41def95c-60d0-4a6f-8312-84f933f30fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.829916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41def95c-60d0-4a6f-8312-84f933f30fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.830745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41def95c-60d0-4a6f-8312-84f933f30fe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:01.831328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41def95c-60d0-4a6f-8312-84f933f30fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:01.833158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41def95c-60d0-4a6f-8312-84f933f30fe1 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:01.851500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 230/463] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:01.853242 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28f386-6e57-4a7c-b664-d22ca0d92856 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.853764 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28f386-6e57-4a7c-b664-d22ca0d92856 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.854309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28f386-6e57-4a7c-b664-d22ca0d92856 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.856152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 231/464] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:01.857127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28f386-6e57-4a7c-b664-d22ca0d92856 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.858729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.879403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea2dfc-10cd-4861-9554-d3656fab2a13 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:01.897047 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.914611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd287cb-0274-4c69-a1c4-d7f601353d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:01.915873 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd287cb-0274-4c69-a1c4-d7f601353d99 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.916357 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd287cb-0274-4c69-a1c4-d7f601353d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.916810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd287cb-0274-4c69-a1c4-d7f601353d99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.927919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd287cb-0274-4c69-a1c4-d7f601353d99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:01.929680 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd287cb-0274-4c69-a1c4-d7f601353d99 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-1dd287cb-0274-4c69-a1c4-d7f601353d99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:01.946141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:01.947094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:01.947988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:01.947988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:01.947988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:01.950187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 234/465] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:01.951736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407b4b6-6a27-4faa-85bb-8b7d18852d8a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.952184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407b4b6-6a27-4faa-85bb-8b7d18852d8a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.952612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407b4b6-6a27-4faa-85bb-8b7d18852d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.972263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c407b4b6-6a27-4faa-85bb-8b7d18852d8a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:01.974098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c407b4b6-6a27-4faa-85bb-8b7d18852d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:01.984793 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28f386-6e57-4a7c-b664-d22ca0d92856 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.021546 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8199b3-570a-4b7c-9206-7fbfaf923e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.022399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8199b3-570a-4b7c-9206-7fbfaf923e7f None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.022840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8199b3-570a-4b7c-9206-7fbfaf923e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.023261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8199b3-570a-4b7c-9206-7fbfaf923e7f None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.023945 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8199b3-570a-4b7c-9206-7fbfaf923e7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.025497 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8199b3-570a-4b7c-9206-7fbfaf923e7f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.044586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 235/466] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:02.045664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407b4b6-6a27-4faa-85bb-8b7d18852d8a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.059746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 232/467] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:08:01 2022] POST /identity/v3/users => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:02.059746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8199b3-570a-4b7c-9206-7fbfaf923e7f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.143530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:02.205838 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407b4b6-6a27-4faa-85bb-8b7d18852d8a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.264629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:02.268957 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa155e7-1d05-41cf-99fb-c2ec12d2b7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.269905 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa155e7-1d05-41cf-99fb-c2ec12d2b7cc None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.270193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa155e7-1d05-41cf-99fb-c2ec12d2b7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.270464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa155e7-1d05-41cf-99fb-c2ec12d2b7cc None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.271131 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa155e7-1d05-41cf-99fb-c2ec12d2b7cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:02.271435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa155e7-1d05-41cf-99fb-c2ec12d2b7cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.272902 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa155e7-1d05-41cf-99fb-c2ec12d2b7cc None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.289595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8199b3-570a-4b7c-9206-7fbfaf923e7f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.289774 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 236/468] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:02.296841 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa155e7-1d05-41cf-99fb-c2ec12d2b7cc None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.345882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9b77d-e33e-4953-8ee3-c57066eaf080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.346889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9b77d-e33e-4953-8ee3-c57066eaf080 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.347510 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9b77d-e33e-4953-8ee3-c57066eaf080 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.347812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9b77d-e33e-4953-8ee3-c57066eaf080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.364029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9b77d-e33e-4953-8ee3-c57066eaf080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.366020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9b77d-e33e-4953-8ee3-c57066eaf080 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-8fd9b77d-e33e-4953-8ee3-c57066eaf080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:02.383077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:02.384166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:02.385041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:02.385041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:02.385041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:02.385041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 233/469] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:02.385800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9b77d-e33e-4953-8ee3-c57066eaf080 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.429002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa155e7-1d05-41cf-99fb-c2ec12d2b7cc None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.464836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:02.474744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91306fd7-9856-4af5-96f9-739e2ad3027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.475369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91306fd7-9856-4af5-96f9-739e2ad3027d None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.475655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91306fd7-9856-4af5-96f9-739e2ad3027d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.476013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91306fd7-9856-4af5-96f9-739e2ad3027d None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.476698 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91306fd7-9856-4af5-96f9-739e2ad3027d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.478611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91306fd7-9856-4af5-96f9-739e2ad3027d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.501299 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9b77d-e33e-4953-8ee3-c57066eaf080 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.503133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 237/470] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:08:02 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:02.503849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91306fd7-9856-4af5-96f9-739e2ad3027d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.558828 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33dd7d-2b50-4f49-866f-8cbf0ebea63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.560139 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33dd7d-2b50-4f49-866f-8cbf0ebea63c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.561077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33dd7d-2b50-4f49-866f-8cbf0ebea63c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.561900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33dd7d-2b50-4f49-866f-8cbf0ebea63c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.565189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:02.581193 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33dd7d-2b50-4f49-866f-8cbf0ebea63c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.583440 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33dd7d-2b50-4f49-866f-8cbf0ebea63c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-3a33dd7d-2b50-4f49-866f-8cbf0ebea63c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:02.604734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:02.605778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:02.606720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:02.606720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:02.606720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:02.609442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 234/471] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:02.611133 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b585a19-1f83-4555-89e7-ba8f42ac1f6d None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.611988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b585a19-1f83-4555-89e7-ba8f42ac1f6d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.612324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b585a19-1f83-4555-89e7-ba8f42ac1f6d None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.613750 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 235/472] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:02.619564 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b585a19-1f83-4555-89e7-ba8f42ac1f6d None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.627535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91306fd7-9856-4af5-96f9-739e2ad3027d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.680021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8050a-0826-4d44-a8f5-c1eb5517e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.681482 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8050a-0826-4d44-a8f5-c1eb5517e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.681482 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8050a-0826-4d44-a8f5-c1eb5517e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.681650 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8050a-0826-4d44-a8f5-c1eb5517e2b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.682599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8050a-0826-4d44-a8f5-c1eb5517e2b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:02.682914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8050a-0826-4d44-a8f5-c1eb5517e2b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.684369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8050a-0826-4d44-a8f5-c1eb5517e2b0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.701698 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 238/473] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:02.703348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801936f-1225-48fd-9be5-b997393fa5d4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.703769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801936f-1225-48fd-9be5-b997393fa5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.704110 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801936f-1225-48fd-9be5-b997393fa5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.723190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a801936f-1225-48fd-9be5-b997393fa5d4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:02.724451 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a801936f-1225-48fd-9be5-b997393fa5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:02.749622 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b585a19-1f83-4555-89e7-ba8f42ac1f6d None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.767862 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:02.795170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cebd3-9c1e-4632-ab14-907ceb27932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.796214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cebd3-9c1e-4632-ab14-907ceb27932e None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.796788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cebd3-9c1e-4632-ab14-907ceb27932e None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.797199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cebd3-9c1e-4632-ab14-907ceb27932e None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.798121 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cebd3-9c1e-4632-ab14-907ceb27932e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:02.798578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cebd3-9c1e-4632-ab14-907ceb27932e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.798930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 239/474] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:02.799903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801936f-1225-48fd-9be5-b997393fa5d4 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.800610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cebd3-9c1e-4632-ab14-907ceb27932e None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.815030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 236/475] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:02.821417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cebd3-9c1e-4632-ab14-907ceb27932e None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.875223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:02.916154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801936f-1225-48fd-9be5-b997393fa5d4 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.966450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6b078-7f63-4798-84d3-422afb0f831d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.967347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6b078-7f63-4798-84d3-422afb0f831d None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.967789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6b078-7f63-4798-84d3-422afb0f831d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.968202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6b078-7f63-4798-84d3-422afb0f831d None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.969467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6b078-7f63-4798-84d3-422afb0f831d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.971084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6b078-7f63-4798-84d3-422afb0f831d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.974542 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cebd3-9c1e-4632-ab14-907ceb27932e None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:03.010048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 240/476] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:08:02 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:03.057681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859ca61-d617-4fb1-b29c-70b5f7e6b1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:03.058323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859ca61-d617-4fb1-b29c-70b5f7e6b1c3 None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:03.058605 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859ca61-d617-4fb1-b29c-70b5f7e6b1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:03.058981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859ca61-d617-4fb1-b29c-70b5f7e6b1c3 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:03.059832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859ca61-d617-4fb1-b29c-70b5f7e6b1c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:03.061867 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859ca61-d617-4fb1-b29c-70b5f7e6b1c3 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:03.100489 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 237/477] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:08:02 2022] POST /identity/v3/users => generated 249 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:08:03.155316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6b078-7f63-4798-84d3-422afb0f831d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:03.210372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:03.317325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6b078-7f63-4798-84d3-422afb0f831d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:03.356026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff248a6-af57-496a-85f7-8ddee76706b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:03.356558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff248a6-af57-496a-85f7-8ddee76706b7 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:03.356831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff248a6-af57-496a-85f7-8ddee76706b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:03.357156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff248a6-af57-496a-85f7-8ddee76706b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:03.357849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff248a6-af57-496a-85f7-8ddee76706b7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:03.359220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff248a6-af57-496a-85f7-8ddee76706b7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:03.368487 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.sql.core [None req-eff248a6-af57-496a-85f7-8ddee76706b7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:08:03.368487 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 00:08:03.368487 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [parameters: {'id': '64a609f8afaa4f35827664f49830fb0b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 00:08:03.368487 dv-cinder-852210-5-smb devstack@keystone.service[81491]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81491) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-eff248a6-af57-496a-85f7-8ddee76706b7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application result.read() Aug 31 00:08:03.385519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:08:03.386585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application yield resource Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise self.value Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application session.commit() Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:08:03.388056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:08:03.389174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:08:03.390604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application result.read() Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:08:03.392907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [parameters: {'id': '64a609f8afaa4f35827664f49830fb0b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:03.394843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 00:08:03.396778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:03.399081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 241/478] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Aug 31 00:08:03 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:03.399216 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859ca61-d617-4fb1-b29c-70b5f7e6b1c3 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:03.516967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859ca61-d617-4fb1-b29c-70b5f7e6b1c3 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:03.518673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:03.557239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295177eb-2131-4203-a615-30a182ac8707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:03.557882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295177eb-2131-4203-a615-30a182ac8707 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:03.558160 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295177eb-2131-4203-a615-30a182ac8707 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:03.558435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295177eb-2131-4203-a615-30a182ac8707 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:03.569927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295177eb-2131-4203-a615-30a182ac8707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-295177eb-2131-4203-a615-30a182ac8707 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:03.575007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:03.575988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:03.577370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:03.577370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:03.577370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:03.577370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:03.577370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:03.577370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:03.577370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:03.577370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:03.577370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:03.577370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:03.577370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:08:03.577370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:03.577370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 238/479] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:03.582068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff248a6-af57-496a-85f7-8ddee76706b7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:03.711839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:03.722884 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff248a6-af57-496a-85f7-8ddee76706b7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:03.772173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbe599-20ef-4d85-939c-4b61da7ceebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:03.772794 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe599-20ef-4d85-939c-4b61da7ceebb None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:03.773161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe599-20ef-4d85-939c-4b61da7ceebb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:03.773439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe599-20ef-4d85-939c-4b61da7ceebb None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:03.774153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbe599-20ef-4d85-939c-4b61da7ceebb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:03.774461 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbe599-20ef-4d85-939c-4b61da7ceebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:03.775875 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbe599-20ef-4d85-939c-4b61da7ceebb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:03.784690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 242/480] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:04.485898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac419b-0029-4852-a08a-2e2034320466 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:04.486401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac419b-0029-4852-a08a-2e2034320466 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:04.486401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac419b-0029-4852-a08a-2e2034320466 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:04.487917 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 239/481] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:04.493604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ced32-392a-4b56-9669-63057b867409 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:04.494447 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ced32-392a-4b56-9669-63057b867409 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:04.494909 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ced32-392a-4b56-9669-63057b867409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:04.513916 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a43ced32-392a-4b56-9669-63057b867409 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:04.515428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a43ced32-392a-4b56-9669-63057b867409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:04.608354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 243/482] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:04.831319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf020f-d5fb-4854-883b-5875def7dc09 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:04.831985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf020f-d5fb-4854-883b-5875def7dc09 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:04.832480 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf020f-d5fb-4854-883b-5875def7dc09 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:04.834925 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 240/483] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:04.841039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65851bee-da69-4ca1-8782-62a9e3b14825 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:04.841656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65851bee-da69-4ca1-8782-62a9e3b14825 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:04.842116 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65851bee-da69-4ca1-8782-62a9e3b14825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:04.865139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-65851bee-da69-4ca1-8782-62a9e3b14825 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:04.866652 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-65851bee-da69-4ca1-8782-62a9e3b14825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:04.949387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 244/484] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:08:04.972908 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf020f-d5fb-4854-883b-5875def7dc09 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:05.089634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf020f-d5fb-4854-883b-5875def7dc09 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:05.126212 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93522854-449d-4c49-857f-5720942f2459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:05.127224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93522854-449d-4c49-857f-5720942f2459 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.127689 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93522854-449d-4c49-857f-5720942f2459 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.128169 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93522854-449d-4c49-857f-5720942f2459 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.144323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93522854-449d-4c49-857f-5720942f2459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-93522854-449d-4c49-857f-5720942f2459 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:05.149743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:05.150657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:05.151571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:05.151571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:05.151571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:05.151571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:05.151571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:05.151571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:05.151571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:05.151571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:05.151571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:05.151571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:05.151571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:05.151571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:05.153848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 241/485] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:05.162853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65851bee-da69-4ca1-8782-62a9e3b14825 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:05.191218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:05.295124 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65851bee-da69-4ca1-8782-62a9e3b14825 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:05.308230 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93522854-449d-4c49-857f-5720942f2459 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:05.331236 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec0918-499a-4280-a26a-0231564ed13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:05.332086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec0918-499a-4280-a26a-0231564ed13b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.332235 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec0918-499a-4280-a26a-0231564ed13b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.332420 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec0918-499a-4280-a26a-0231564ed13b None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.333096 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec0918-499a-4280-a26a-0231564ed13b None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:05.333399 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec0918-499a-4280-a26a-0231564ed13b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:05.334809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec0918-499a-4280-a26a-0231564ed13b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:05.344182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 245/486] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:05.355010 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec0918-499a-4280-a26a-0231564ed13b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:05.365574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:05.441834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:05.465636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec0918-499a-4280-a26a-0231564ed13b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:05.512145 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93522854-449d-4c49-857f-5720942f2459 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:05.541853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b159dd-a59e-4bda-8da6-e9f228057890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:05.542633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b159dd-a59e-4bda-8da6-e9f228057890 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.542916 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b159dd-a59e-4bda-8da6-e9f228057890 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.543189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b159dd-a59e-4bda-8da6-e9f228057890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.551248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1ada9-1f62-4f91-a7ea-eac2ca2b6b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:05.551940 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1ada9-1f62-4f91-a7ea-eac2ca2b6b58 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.552214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1ada9-1f62-4f91-a7ea-eac2ca2b6b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.552482 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1ada9-1f62-4f91-a7ea-eac2ca2b6b58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.554596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b159dd-a59e-4bda-8da6-e9f228057890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:05.556372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b159dd-a59e-4bda-8da6-e9f228057890 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:05.565773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1ada9-1f62-4f91-a7ea-eac2ca2b6b58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-9de1ada9-1f62-4f91-a7ea-eac2ca2b6b58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:05.570918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:05.571872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:05.573029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:05.573029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:05.573029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:05.573029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:05.573029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:05.573029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:05.573029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:05.573029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:05.573029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:05.573029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:05.573029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:05.573029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e4b159dd-a59e-4bda-8da6-e9f228057890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:05.573802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:05.574938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:05.576193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:05.576193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:05.576193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:05.576385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 242/487] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:05.576385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4413a87-ec45-4206-ac85-0525071b3924 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.576505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 246/488] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:05.576822 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4413a87-ec45-4206-ac85-0525071b3924 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.576822 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4413a87-ec45-4206-ac85-0525071b3924 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.576822 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 243/489] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:05.581081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916b14d-14f4-45f8-9a63-98aabbf7d93c None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.581362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916b14d-14f4-45f8-9a63-98aabbf7d93c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.581627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916b14d-14f4-45f8-9a63-98aabbf7d93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.584426 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b159dd-a59e-4bda-8da6-e9f228057890 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:05.600707 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7916b14d-14f4-45f8-9a63-98aabbf7d93c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:05.601843 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7916b14d-14f4-45f8-9a63-98aabbf7d93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:05.686434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 244/490] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:05.688780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916b14d-14f4-45f8-9a63-98aabbf7d93c None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:05.711740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:05.730370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b159dd-a59e-4bda-8da6-e9f228057890 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:05.787786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:05.796121 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0f924-a24c-431a-b2f1-79dc33ddfa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:05.797829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0f924-a24c-431a-b2f1-79dc33ddfa87 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.798113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0f924-a24c-431a-b2f1-79dc33ddfa87 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.798387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0f924-a24c-431a-b2f1-79dc33ddfa87 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.799048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0f924-a24c-431a-b2f1-79dc33ddfa87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:05.799354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0f924-a24c-431a-b2f1-79dc33ddfa87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:05.800794 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0f924-a24c-431a-b2f1-79dc33ddfa87 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:05.816092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 247/491] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:05.817385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bdacd-a8bd-4cfd-8fea-e58b60829d56 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.817671 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bdacd-a8bd-4cfd-8fea-e58b60829d56 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.817955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bdacd-a8bd-4cfd-8fea-e58b60829d56 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.819392 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 248/492] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:05.820956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bdacd-a8bd-4cfd-8fea-e58b60829d56 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:05.862126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916b14d-14f4-45f8-9a63-98aabbf7d93c None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:05.898671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18db5c-905f-46d0-9cd1-b7dec64016ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:05.899382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18db5c-905f-46d0-9cd1-b7dec64016ba None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.899804 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18db5c-905f-46d0-9cd1-b7dec64016ba None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.900086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18db5c-905f-46d0-9cd1-b7dec64016ba None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.900835 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18db5c-905f-46d0-9cd1-b7dec64016ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:05.901142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18db5c-905f-46d0-9cd1-b7dec64016ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:05.902591 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18db5c-905f-46d0-9cd1-b7dec64016ba None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:05.913634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 245/493] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:05.915596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69094202-8b42-4090-8452-9bcdabad0173 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.916328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69094202-8b42-4090-8452-9bcdabad0173 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.917004 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69094202-8b42-4090-8452-9bcdabad0173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.938482 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bdacd-a8bd-4cfd-8fea-e58b60829d56 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:05.942728 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-69094202-8b42-4090-8452-9bcdabad0173 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:05.943979 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-69094202-8b42-4090-8452-9bcdabad0173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:05.976294 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9293c-9951-4138-8667-5fb466bf3736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:05.976951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9293c-9951-4138-8667-5fb466bf3736 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.977229 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9293c-9951-4138-8667-5fb466bf3736 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.977500 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9293c-9951-4138-8667-5fb466bf3736 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.985384 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9293c-9951-4138-8667-5fb466bf3736 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:05.986855 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9293c-9951-4138-8667-5fb466bf3736 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-8de9293c-9951-4138-8667-5fb466bf3736 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:06.001348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:06.002288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:06.005406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:06.005406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:06.005406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:06.005406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:06.005406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:06.005406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:06.005406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:06.005406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:06.005406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:06.005406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:06.005406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 249/494] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 31 00:08:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:06.005406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9293c-9951-4138-8667-5fb466bf3736 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.019793 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 246/495] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:06.020996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69094202-8b42-4090-8452-9bcdabad0173 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.028799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.080748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.144987 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9293c-9951-4138-8667-5fb466bf3736 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.153516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69094202-8b42-4090-8452-9bcdabad0173 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.186051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee63069-04bf-4435-ac47-6d9350ffaa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.187811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee63069-04bf-4435-ac47-6d9350ffaa07 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.188641 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee63069-04bf-4435-ac47-6d9350ffaa07 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.189129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee63069-04bf-4435-ac47-6d9350ffaa07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.195835 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa654a09-360a-4706-87dc-45ca7aed7787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.196473 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa654a09-360a-4706-87dc-45ca7aed7787 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.196753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa654a09-360a-4706-87dc-45ca7aed7787 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.197026 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa654a09-360a-4706-87dc-45ca7aed7787 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.202814 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee63069-04bf-4435-ac47-6d9350ffaa07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.204886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee63069-04bf-4435-ac47-6d9350ffaa07 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.210119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa654a09-360a-4706-87dc-45ca7aed7787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-aa654a09-360a-4706-87dc-45ca7aed7787 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:06.217250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:06.218150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:06.218963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:06.218963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:06.218963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:06.218963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:06.218963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:06.218963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:06.218963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:06.218963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:06.218963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:06.218963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:06.218963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:06.218963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:06.223231 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 247/496] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:06.224155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa654a09-360a-4706-87dc-45ca7aed7787 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3ee63069-04bf-4435-ac47-6d9350ffaa07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:06.225303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:06.226167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:06.227039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:06.227039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:06.227039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:06.235230 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 250/497] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:06.236415 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee63069-04bf-4435-ac47-6d9350ffaa07 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.304920 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.344080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa654a09-360a-4706-87dc-45ca7aed7787 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.357641 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee63069-04bf-4435-ac47-6d9350ffaa07 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.359495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.380067 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897a557-59aa-456a-9bd8-6651fec3dd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.380677 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897a557-59aa-456a-9bd8-6651fec3dd11 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.380957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897a557-59aa-456a-9bd8-6651fec3dd11 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.381231 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897a557-59aa-456a-9bd8-6651fec3dd11 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.381955 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897a557-59aa-456a-9bd8-6651fec3dd11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:06.382255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897a557-59aa-456a-9bd8-6651fec3dd11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.383746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897a557-59aa-456a-9bd8-6651fec3dd11 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.393493 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6261e-f090-4179-8380-9e81a81dc01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.394104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6261e-f090-4179-8380-9e81a81dc01b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.394385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6261e-f090-4179-8380-9e81a81dc01b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.394648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6261e-f090-4179-8380-9e81a81dc01b None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.395379 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6261e-f090-4179-8380-9e81a81dc01b None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:06.395614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6261e-f090-4179-8380-9e81a81dc01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.397007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6261e-f090-4179-8380-9e81a81dc01b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.405159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 251/498] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:06.405940 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6261e-f090-4179-8380-9e81a81dc01b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.420198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 248/499] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:06.423070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606eeea7-6de5-4ae5-b096-4c7bc926615f None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.423500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606eeea7-6de5-4ae5-b096-4c7bc926615f None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.423850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606eeea7-6de5-4ae5-b096-4c7bc926615f None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.425238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 249/500] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:06.425934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606eeea7-6de5-4ae5-b096-4c7bc926615f None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.508925 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6261e-f090-4179-8380-9e81a81dc01b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.525992 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606eeea7-6de5-4ae5-b096-4c7bc926615f None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.542832 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead7b15-a98c-4a73-ae47-4ce45a087f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.543436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead7b15-a98c-4a73-ae47-4ce45a087f3d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.543736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead7b15-a98c-4a73-ae47-4ce45a087f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.544018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead7b15-a98c-4a73-ae47-4ce45a087f3d None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.544663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead7b15-a98c-4a73-ae47-4ce45a087f3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:06.545069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead7b15-a98c-4a73-ae47-4ce45a087f3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.546484 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead7b15-a98c-4a73-ae47-4ce45a087f3d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.549093 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.558173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 252/501] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:06.558975 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead7b15-a98c-4a73-ae47-4ce45a087f3d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.561209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc18f0b-5ec9-4b3e-a8eb-9f2a82a52003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.562241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc18f0b-5ec9-4b3e-a8eb-9f2a82a52003 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.562521 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc18f0b-5ec9-4b3e-a8eb-9f2a82a52003 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.562797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc18f0b-5ec9-4b3e-a8eb-9f2a82a52003 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.573355 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc18f0b-5ec9-4b3e-a8eb-9f2a82a52003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-3fc18f0b-5ec9-4b3e-a8eb-9f2a82a52003 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:06.578303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:06.579375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:06.580377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:06.580377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:06.580377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:06.580377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:06.580377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:06.580377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:06.580377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:06.580377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:06.580377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:06.580377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:06.580377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:06.580377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:06.580377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 250/502] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:06.580377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc18f0b-5ec9-4b3e-a8eb-9f2a82a52003 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.588567 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.667537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead7b15-a98c-4a73-ae47-4ce45a087f3d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.680334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc18f0b-5ec9-4b3e-a8eb-9f2a82a52003 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.701971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a8c08-da28-4284-b081-a00b8bc23613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.702616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a8c08-da28-4284-b081-a00b8bc23613 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.702894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a8c08-da28-4284-b081-a00b8bc23613 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.703155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a8c08-da28-4284-b081-a00b8bc23613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.713145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a8c08-da28-4284-b081-a00b8bc23613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.713338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa4e9f-7e19-446a-8711-86631bf0cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.713940 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4e9f-7e19-446a-8711-86631bf0cd6e None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.714216 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4e9f-7e19-446a-8711-86631bf0cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.714484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4e9f-7e19-446a-8711-86631bf0cd6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.714615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a8c08-da28-4284-b081-a00b8bc23613 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-d30a8c08-da28-4284-b081-a00b8bc23613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:06.729799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:06.730703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:06.731554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:06.731554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:06.731554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:06.731554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 253/503] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:06.732045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73000a20-48af-430a-9d56-3a78e3f17180 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.732325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73000a20-48af-430a-9d56-3a78e3f17180 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.732658 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73000a20-48af-430a-9d56-3a78e3f17180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.749974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-73000a20-48af-430a-9d56-3a78e3f17180 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:06.751185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-73000a20-48af-430a-9d56-3a78e3f17180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:06.766420 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.785111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa4e9f-7e19-446a-8711-86631bf0cd6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.786971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa4e9f-7e19-446a-8711-86631bf0cd6e None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.820069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 254/504] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:06.820914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73000a20-48af-430a-9d56-3a78e3f17180 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.828850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.902408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 251/505] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:08:06.903471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa4e9f-7e19-446a-8711-86631bf0cd6e None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.927781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73000a20-48af-430a-9d56-3a78e3f17180 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.962450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992a3d4-3dcf-4613-a14f-64af92d8b025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.963087 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992a3d4-3dcf-4613-a14f-64af92d8b025 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.963366 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992a3d4-3dcf-4613-a14f-64af92d8b025 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.963633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992a3d4-3dcf-4613-a14f-64af92d8b025 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.971370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992a3d4-3dcf-4613-a14f-64af92d8b025 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.972848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992a3d4-3dcf-4613-a14f-64af92d8b025 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7992a3d4-3dcf-4613-a14f-64af92d8b025 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:06.986419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:06.987530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:06.988488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:06.988488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:06.988488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:06.988488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:06.988488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:06.988488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:06.988488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:06.988488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:06.988488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:08:06.988488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:06.988488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 255/506] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:06.988488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992a3d4-3dcf-4613-a14f-64af92d8b025 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.993946 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.015131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa4e9f-7e19-446a-8711-86631bf0cd6e None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.052211 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db46bb-12d9-472a-b08e-9a1d461eebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.053126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db46bb-12d9-472a-b08e-9a1d461eebaf None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.053543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db46bb-12d9-472a-b08e-9a1d461eebaf None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.053952 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db46bb-12d9-472a-b08e-9a1d461eebaf None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.054776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db46bb-12d9-472a-b08e-9a1d461eebaf None admin] RBAC: Adding query filter params (name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:07.055213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db46bb-12d9-472a-b08e-9a1d461eebaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.055938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.058117 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db46bb-12d9-472a-b08e-9a1d461eebaf None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.070883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 252/507] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:07.071935 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db46bb-12d9-472a-b08e-9a1d461eebaf None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.094683 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992a3d4-3dcf-4613-a14f-64af92d8b025 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.131051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9718e-58d4-41c1-9518-677d1ba20746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.131671 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9718e-58d4-41c1-9518-677d1ba20746 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.131976 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9718e-58d4-41c1-9518-677d1ba20746 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.132245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9718e-58d4-41c1-9518-677d1ba20746 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.132886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9718e-58d4-41c1-9518-677d1ba20746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:07.133182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9718e-58d4-41c1-9518-677d1ba20746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.134640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9718e-58d4-41c1-9518-677d1ba20746 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.146936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 256/508] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:07.147901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9718e-58d4-41c1-9518-677d1ba20746 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.175947 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db46bb-12d9-472a-b08e-9a1d461eebaf None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.209562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e47aac-e514-4589-a924-e49d909e1549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.210104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e47aac-e514-4589-a924-e49d909e1549 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.210375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e47aac-e514-4589-a924-e49d909e1549 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.210628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e47aac-e514-4589-a924-e49d909e1549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.220947 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e47aac-e514-4589-a924-e49d909e1549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.222384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e47aac-e514-4589-a924-e49d909e1549 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.225019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-b7e47aac-e514-4589-a924-e49d909e1549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:07.237890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:07.238823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:07.239718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:07.239718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:07.239718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:07.239718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 253/509] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:07.239964 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e47aac-e514-4589-a924-e49d909e1549 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.253323 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9718e-58d4-41c1-9518-677d1ba20746 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.278565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.287770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfae1f6-ac76-4032-b3f4-f9b66d165717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.288381 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfae1f6-ac76-4032-b3f4-f9b66d165717 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.288663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfae1f6-ac76-4032-b3f4-f9b66d165717 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.288939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfae1f6-ac76-4032-b3f4-f9b66d165717 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.289668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfae1f6-ac76-4032-b3f4-f9b66d165717 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:07.289974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfae1f6-ac76-4032-b3f4-f9b66d165717 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.291406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfae1f6-ac76-4032-b3f4-f9b66d165717 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.329179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 257/510] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:07.330024 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfae1f6-ac76-4032-b3f4-f9b66d165717 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.342697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e47aac-e514-4589-a924-e49d909e1549 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.376600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f132f4-990e-492e-904d-4fb68c199a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.377227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f132f4-990e-492e-904d-4fb68c199a82 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.377502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f132f4-990e-492e-904d-4fb68c199a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.377769 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f132f4-990e-492e-904d-4fb68c199a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.389544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f132f4-990e-492e-904d-4fb68c199a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.391003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f132f4-990e-492e-904d-4fb68c199a82 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-c7f132f4-990e-492e-904d-4fb68c199a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:07.405944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:07.407097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:07.408569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:07.408569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:07.408569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:07.408569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 254/511] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:07.408569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f132f4-990e-492e-904d-4fb68c199a82 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.433723 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfae1f6-ac76-4032-b3f4-f9b66d165717 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.458279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.467792 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7587c1-fe7a-4c47-b7de-feedb65b0e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.468366 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7587c1-fe7a-4c47-b7de-feedb65b0e1b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.468635 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7587c1-fe7a-4c47-b7de-feedb65b0e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.468906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7587c1-fe7a-4c47-b7de-feedb65b0e1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.479037 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7587c1-fe7a-4c47-b7de-feedb65b0e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.480586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7587c1-fe7a-4c47-b7de-feedb65b0e1b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2d7587c1-fe7a-4c47-b7de-feedb65b0e1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:07.495596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:07.496865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:07.497799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:07.497799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:07.497799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:07.499857 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 258/512] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:07.500940 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7587c1-fe7a-4c47-b7de-feedb65b0e1b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.510626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f132f4-990e-492e-904d-4fb68c199a82 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.538085 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.545089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198b903-e1fa-4bda-897f-dc60221470ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.545723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198b903-e1fa-4bda-897f-dc60221470ae None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.546002 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198b903-e1fa-4bda-897f-dc60221470ae None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.546266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198b903-e1fa-4bda-897f-dc60221470ae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.553964 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198b903-e1fa-4bda-897f-dc60221470ae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.555459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198b903-e1fa-4bda-897f-dc60221470ae None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-4198b903-e1fa-4bda-897f-dc60221470ae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:07.569308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:07.570524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:07.571436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:07.571436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:07.571436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:07.571436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:07.571436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:07.571436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:07.571436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:07.571436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:07.571436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:08:07.571436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:07.571436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 255/513] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:07.571436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198b903-e1fa-4bda-897f-dc60221470ae None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.609791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7587c1-fe7a-4c47-b7de-feedb65b0e1b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.647986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852cd9a-5ac5-4e11-a40f-f8feaadf0639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.648607 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852cd9a-5ac5-4e11-a40f-f8feaadf0639 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.648890 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852cd9a-5ac5-4e11-a40f-f8feaadf0639 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.649169 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852cd9a-5ac5-4e11-a40f-f8feaadf0639 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.649808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852cd9a-5ac5-4e11-a40f-f8feaadf0639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:07.650135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852cd9a-5ac5-4e11-a40f-f8feaadf0639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.651589 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852cd9a-5ac5-4e11-a40f-f8feaadf0639 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.663076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 259/514] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:07.663888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852cd9a-5ac5-4e11-a40f-f8feaadf0639 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.674593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198b903-e1fa-4bda-897f-dc60221470ae None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.684287 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.714323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4661aa6-4806-4e47-9f17-0e1b1270958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.714927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4661aa6-4806-4e47-9f17-0e1b1270958e None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.715206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4661aa6-4806-4e47-9f17-0e1b1270958e None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.715487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4661aa6-4806-4e47-9f17-0e1b1270958e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.770660 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.780705 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852cd9a-5ac5-4e11-a40f-f8feaadf0639 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.792205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4661aa6-4806-4e47-9f17-0e1b1270958e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.793708 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4661aa6-4806-4e47-9f17-0e1b1270958e None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.816652 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813a689-e93b-4c81-8330-edf01f0c1760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.817265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813a689-e93b-4c81-8330-edf01f0c1760 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.817543 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813a689-e93b-4c81-8330-edf01f0c1760 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.817819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813a689-e93b-4c81-8330-edf01f0c1760 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.818459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813a689-e93b-4c81-8330-edf01f0c1760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:07.819053 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813a689-e93b-4c81-8330-edf01f0c1760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.820237 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813a689-e93b-4c81-8330-edf01f0c1760 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.832689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 260/515] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:07.833518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813a689-e93b-4c81-8330-edf01f0c1760 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.898372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 256/516] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:08:07.899544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4661aa6-4806-4e47-9f17-0e1b1270958e None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.909549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.942938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813a689-e93b-4c81-8330-edf01f0c1760 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.977939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31542595-16f9-4fa5-8d6a-d7edcbf3554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.978551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31542595-16f9-4fa5-8d6a-d7edcbf3554f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.978831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31542595-16f9-4fa5-8d6a-d7edcbf3554f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.979104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31542595-16f9-4fa5-8d6a-d7edcbf3554f None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.979778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31542595-16f9-4fa5-8d6a-d7edcbf3554f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:07.980084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31542595-16f9-4fa5-8d6a-d7edcbf3554f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.981518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31542595-16f9-4fa5-8d6a-d7edcbf3554f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.993553 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 261/517] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:07.994352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31542595-16f9-4fa5-8d6a-d7edcbf3554f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.007491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4661aa6-4806-4e47-9f17-0e1b1270958e None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.015129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:08.041447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b789651-dedb-4412-87f9-7465b001feab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.041974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789651-dedb-4412-87f9-7465b001feab None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.042253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789651-dedb-4412-87f9-7465b001feab None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.042525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789651-dedb-4412-87f9-7465b001feab None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.043256 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b789651-dedb-4412-87f9-7465b001feab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:08.043562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b789651-dedb-4412-87f9-7465b001feab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.045056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b789651-dedb-4412-87f9-7465b001feab None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.062368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 257/518] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:08.063176 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b789651-dedb-4412-87f9-7465b001feab None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.100637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31542595-16f9-4fa5-8d6a-d7edcbf3554f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.128568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:08.141836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14874e2f-46c1-448e-a437-a82e07eef88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.141836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14874e2f-46c1-448e-a437-a82e07eef88a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.141836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14874e2f-46c1-448e-a437-a82e07eef88a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.141836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14874e2f-46c1-448e-a437-a82e07eef88a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.148512 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14874e2f-46c1-448e-a437-a82e07eef88a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.149959 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14874e2f-46c1-448e-a437-a82e07eef88a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-14874e2f-46c1-448e-a437-a82e07eef88a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:08.161728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:08.162782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:08.163767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:08.163767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:08.163767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:08.163767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:08.163767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:08.163767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:08.163767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:08.163767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:08.163767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 262/519] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:08.163767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14874e2f-46c1-448e-a437-a82e07eef88a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.167685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b789651-dedb-4412-87f9-7465b001feab None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.203101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3bbbd-f2e2-4be5-bea2-349078d01f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.203752 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3bbbd-f2e2-4be5-bea2-349078d01f52 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.204038 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3bbbd-f2e2-4be5-bea2-349078d01f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.204309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3bbbd-f2e2-4be5-bea2-349078d01f52 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.211393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3bbbd-f2e2-4be5-bea2-349078d01f52 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.213028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3bbbd-f2e2-4be5-bea2-349078d01f52 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-8ba3bbbd-f2e2-4be5-bea2-349078d01f52 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:08.225074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:08.226015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:08.226974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:08.226974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:08.226974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:08.226974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:08.226974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:08.226974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:08.226974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:08.226974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:08.226974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:08:08.226974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:08.226974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 258/520] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:08.226974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3bbbd-f2e2-4be5-bea2-349078d01f52 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.247158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:08.269958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14874e2f-46c1-448e-a437-a82e07eef88a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.303380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602eaf6-8c86-43ec-90ba-fc6f7f081844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.304016 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602eaf6-8c86-43ec-90ba-fc6f7f081844 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.304300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602eaf6-8c86-43ec-90ba-fc6f7f081844 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.304578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602eaf6-8c86-43ec-90ba-fc6f7f081844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.315844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602eaf6-8c86-43ec-90ba-fc6f7f081844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.317292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602eaf6-8c86-43ec-90ba-fc6f7f081844 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.330527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3bbbd-f2e2-4be5-bea2-349078d01f52 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9602eaf6-8c86-43ec-90ba-fc6f7f081844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:08.331748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:08.332649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:08.333504 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:08.333504 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:08.333504 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:08.333504 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 263/521] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:08.333732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602eaf6-8c86-43ec-90ba-fc6f7f081844 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.356859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:08.366093 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded6fcc-b5a8-41fc-8664-e07736a18588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.366697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6fcc-b5a8-41fc-8664-e07736a18588 None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.366972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6fcc-b5a8-41fc-8664-e07736a18588 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.367243 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6fcc-b5a8-41fc-8664-e07736a18588 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.367930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded6fcc-b5a8-41fc-8664-e07736a18588 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.369366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded6fcc-b5a8-41fc-8664-e07736a18588 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.390718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 259/522] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:08:08 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:08.391506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded6fcc-b5a8-41fc-8664-e07736a18588 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.449481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602eaf6-8c86-43ec-90ba-fc6f7f081844 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.482147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:08.492254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803f2fc-a71c-416c-8225-74e33a8e621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.492987 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803f2fc-a71c-416c-8225-74e33a8e621d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.493299 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803f2fc-a71c-416c-8225-74e33a8e621d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.493668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803f2fc-a71c-416c-8225-74e33a8e621d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.509215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded6fcc-b5a8-41fc-8664-e07736a18588 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.554897 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacfb07-4d60-4e04-bd40-1aba6d1c8977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.555494 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacfb07-4d60-4e04-bd40-1aba6d1c8977 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.555826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacfb07-4d60-4e04-bd40-1aba6d1c8977 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.557437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacfb07-4d60-4e04-bd40-1aba6d1c8977 None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.557681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacfb07-4d60-4e04-bd40-1aba6d1c8977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:08.558054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacfb07-4d60-4e04-bd40-1aba6d1c8977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.559574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacfb07-4d60-4e04-bd40-1aba6d1c8977 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.580126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 260/523] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:08.581338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacfb07-4d60-4e04-bd40-1aba6d1c8977 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.591384 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803f2fc-a71c-416c-8225-74e33a8e621d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.593089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803f2fc-a71c-416c-8225-74e33a8e621d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.638463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:08.712039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacfb07-4d60-4e04-bd40-1aba6d1c8977 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.719807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 264/524] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:08:08.720802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803f2fc-a71c-416c-8225-74e33a8e621d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.755138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:08.760685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2b9da-cfe8-4706-8383-113213339736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.761307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2b9da-cfe8-4706-8383-113213339736 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.761583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2b9da-cfe8-4706-8383-113213339736 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.761852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2b9da-cfe8-4706-8383-113213339736 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.762576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2b9da-cfe8-4706-8383-113213339736 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:08.762882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2b9da-cfe8-4706-8383-113213339736 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.764403 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2b9da-cfe8-4706-8383-113213339736 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.786125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 261/525] 10.222.0.50 () {56 vars in 1139 bytes} [Wed Aug 31 00:08:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:08.787723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2b9da-cfe8-4706-8383-113213339736 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.855364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803f2fc-a71c-416c-8225-74e33a8e621d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.907139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730eea0d-ee2b-4799-86e7-22c1b7e60680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.907874 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eea0d-ee2b-4799-86e7-22c1b7e60680 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.908123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eea0d-ee2b-4799-86e7-22c1b7e60680 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.908393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eea0d-ee2b-4799-86e7-22c1b7e60680 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.909086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730eea0d-ee2b-4799-86e7-22c1b7e60680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:08.909388 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730eea0d-ee2b-4799-86e7-22c1b7e60680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.910831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730eea0d-ee2b-4799-86e7-22c1b7e60680 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.916045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:08.920222 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2b9da-cfe8-4706-8383-113213339736 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.924199 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 265/526] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:08.924956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730eea0d-ee2b-4799-86e7-22c1b7e60680 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.962430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce9950-124c-4b92-ab3a-373132c1fb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.963056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce9950-124c-4b92-ab3a-373132c1fb12 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.963322 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce9950-124c-4b92-ab3a-373132c1fb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.963596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce9950-124c-4b92-ab3a-373132c1fb12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.964363 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce9950-124c-4b92-ab3a-373132c1fb12 None admin] RBAC: Adding query filter params (role.id=bf66c83a5d0f41039e44947c9fb18d3c, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=cb9ef38ec3b448828826de5f76a552d8) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:08.964671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce9950-124c-4b92-ab3a-373132c1fb12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.966342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce9950-124c-4b92-ab3a-373132c1fb12 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.979963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 262/527] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:08 2022] GET /identity/v3/role_assignments?user.id=cb9ef38ec3b448828826de5f76a552d8&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=bf66c83a5d0f41039e44947c9fb18d3c => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:08.979963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce9950-124c-4b92-ab3a-373132c1fb12 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.053596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:09.071813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730eea0d-ee2b-4799-86e7-22c1b7e60680 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.100458 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce9950-124c-4b92-ab3a-373132c1fb12 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.117231 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f350d-492c-42f5-9ddc-0dac4ce7a909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.118187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f350d-492c-42f5-9ddc-0dac4ce7a909 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.118644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f350d-492c-42f5-9ddc-0dac4ce7a909 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.119097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f350d-492c-42f5-9ddc-0dac4ce7a909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.131595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f350d-492c-42f5-9ddc-0dac4ce7a909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.133373 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f350d-492c-42f5-9ddc-0dac4ce7a909 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.146860 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ebee8-b0a0-4c15-9713-09ffc80243fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.147470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ebee8-b0a0-4c15-9713-09ffc80243fe None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.147784 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ebee8-b0a0-4c15-9713-09ffc80243fe None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.148059 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ebee8-b0a0-4c15-9713-09ffc80243fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e83f350d-492c-42f5-9ddc-0dac4ce7a909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:09.156706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:09.157655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:09.158537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:09.158537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:09.158537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:09.163319 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 266/528] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:09.164430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f350d-492c-42f5-9ddc-0dac4ce7a909 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.183375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:09.224956 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ebee8-b0a0-4c15-9713-09ffc80243fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.227066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ebee8-b0a0-4c15-9713-09ffc80243fe None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.280535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f350d-492c-42f5-9ddc-0dac4ce7a909 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.318899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2dbe6e-4832-48a4-8166-04b3578dd7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.320024 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dbe6e-4832-48a4-8166-04b3578dd7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.320604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dbe6e-4832-48a4-8166-04b3578dd7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.321098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dbe6e-4832-48a4-8166-04b3578dd7b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.328821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2dbe6e-4832-48a4-8166-04b3578dd7b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.330720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2dbe6e-4832-48a4-8166-04b3578dd7b9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.333634 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:09.340382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 263/529] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:08:09.341296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ebee8-b0a0-4c15-9713-09ffc80243fe None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3b2dbe6e-4832-48a4-8166-04b3578dd7b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:09.345564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:09.346407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:09.347302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:09.347302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:09.347302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:09.347302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:09.347302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:09.347302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:09.347302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:09.347302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:09.349471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 267/530] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:09.350455 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2dbe6e-4832-48a4-8166-04b3578dd7b9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.403333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:09.446657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ebee8-b0a0-4c15-9713-09ffc80243fe None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.462381 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2dbe6e-4832-48a4-8166-04b3578dd7b9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.482425 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707f025-4a51-44d2-afde-6ac4afcb4763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.483070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707f025-4a51-44d2-afde-6ac4afcb4763 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.483346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707f025-4a51-44d2-afde-6ac4afcb4763 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.483615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707f025-4a51-44d2-afde-6ac4afcb4763 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.484308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707f025-4a51-44d2-afde-6ac4afcb4763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:09.484606 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707f025-4a51-44d2-afde-6ac4afcb4763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.486070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707f025-4a51-44d2-afde-6ac4afcb4763 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.499283 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 264/531] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:09.500168 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707f025-4a51-44d2-afde-6ac4afcb4763 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.502822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b72f4-fc3e-485d-97fb-5c47d41258a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.504049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b72f4-fc3e-485d-97fb-5c47d41258a4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.504533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b72f4-fc3e-485d-97fb-5c47d41258a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.504999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b72f4-fc3e-485d-97fb-5c47d41258a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.517704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b72f4-fc3e-485d-97fb-5c47d41258a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.519690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b72f4-fc3e-485d-97fb-5c47d41258a4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-b93b72f4-fc3e-485d-97fb-5c47d41258a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:09.536258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:09.537263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:09.538128 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:09.538128 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:09.538128 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:09.540430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 268/532] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:09.541542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b72f4-fc3e-485d-97fb-5c47d41258a4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.599172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:09.608848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707f025-4a51-44d2-afde-6ac4afcb4763 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.633412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:09.645105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f162bf0-10d3-4c26-b647-60b4e884ac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.645720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f162bf0-10d3-4c26-b647-60b4e884ac41 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.645998 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f162bf0-10d3-4c26-b647-60b4e884ac41 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.646271 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f162bf0-10d3-4c26-b647-60b4e884ac41 None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.647056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f162bf0-10d3-4c26-b647-60b4e884ac41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:09.647366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f162bf0-10d3-4c26-b647-60b4e884ac41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.649086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f162bf0-10d3-4c26-b647-60b4e884ac41 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.654295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b72f4-fc3e-485d-97fb-5c47d41258a4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.667063 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 265/533] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:09.667979 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f162bf0-10d3-4c26-b647-60b4e884ac41 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.691356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd1940-7d30-46ea-8107-392dd0e510cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.692442 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd1940-7d30-46ea-8107-392dd0e510cc None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.692946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd1940-7d30-46ea-8107-392dd0e510cc None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.693413 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd1940-7d30-46ea-8107-392dd0e510cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.701045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd1940-7d30-46ea-8107-392dd0e510cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.702870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd1940-7d30-46ea-8107-392dd0e510cc None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-37fd1940-7d30-46ea-8107-392dd0e510cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:09.715894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:09.716823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:09.717758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:09.717758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:09.717758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:09.717758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:09.717758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:09.717758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:09.717758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:09.717758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:09.720236 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 269/534] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:09.721866 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd1940-7d30-46ea-8107-392dd0e510cc None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.772499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f162bf0-10d3-4c26-b647-60b4e884ac41 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.808436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497dd8f-fd6c-44b6-9d54-07ed8d8bc6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.809061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497dd8f-fd6c-44b6-9d54-07ed8d8bc6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.809338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497dd8f-fd6c-44b6-9d54-07ed8d8bc6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.809615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497dd8f-fd6c-44b6-9d54-07ed8d8bc6a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.810470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497dd8f-fd6c-44b6-9d54-07ed8d8bc6a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:09.810645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497dd8f-fd6c-44b6-9d54-07ed8d8bc6a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.812499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497dd8f-fd6c-44b6-9d54-07ed8d8bc6a4 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.827928 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 266/535] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:09.828889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497dd8f-fd6c-44b6-9d54-07ed8d8bc6a4 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.830930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd1940-7d30-46ea-8107-392dd0e510cc None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.845172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:09.868253 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f01194-27ee-4cd2-b6ed-3f5f83fd6434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.869274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f01194-27ee-4cd2-b6ed-3f5f83fd6434 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.869787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f01194-27ee-4cd2-b6ed-3f5f83fd6434 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.870272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f01194-27ee-4cd2-b6ed-3f5f83fd6434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.871245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f01194-27ee-4cd2-b6ed-3f5f83fd6434 None admin] RBAC: Adding query filter params (role.id=bf66c83a5d0f41039e44947c9fb18d3c, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=f886be277ef84ec28a290380980c6f06) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:09.871776 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f01194-27ee-4cd2-b6ed-3f5f83fd6434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.873571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f01194-27ee-4cd2-b6ed-3f5f83fd6434 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.878761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:09.881369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 270/536] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:09 2022] GET /identity/v3/role_assignments?user.id=f886be277ef84ec28a290380980c6f06&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=bf66c83a5d0f41039e44947c9fb18d3c => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:09.882417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f01194-27ee-4cd2-b6ed-3f5f83fd6434 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.963811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497dd8f-fd6c-44b6-9d54-07ed8d8bc6a4 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:10.003323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e115c-2126-4a6a-a3f2-38a8abcddaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:10.004033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e115c-2126-4a6a-a3f2-38a8abcddaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:10.004310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e115c-2126-4a6a-a3f2-38a8abcddaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:10.004577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e115c-2126-4a6a-a3f2-38a8abcddaa6 None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:10.005303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e115c-2126-4a6a-a3f2-38a8abcddaa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:10.005608 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e115c-2126-4a6a-a3f2-38a8abcddaa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:10.007167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e115c-2126-4a6a-a3f2-38a8abcddaa6 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:10.037177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 267/537] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:10.041982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e115c-2126-4a6a-a3f2-38a8abcddaa6 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:10.065123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f01194-27ee-4cd2-b6ed-3f5f83fd6434 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:10.175616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c482292-fbc8-48c1-aaa0-0be5db928183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:10.176338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482292-fbc8-48c1-aaa0-0be5db928183 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:10.176618 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482292-fbc8-48c1-aaa0-0be5db928183 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:10.176890 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482292-fbc8-48c1-aaa0-0be5db928183 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:10.180318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e115c-2126-4a6a-a3f2-38a8abcddaa6 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:10.183570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:10.191074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c482292-fbc8-48c1-aaa0-0be5db928183 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:10.192647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c482292-fbc8-48c1-aaa0-0be5db928183 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-5c482292-fbc8-48c1-aaa0-0be5db928183 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:10.211261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:10.212297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:10.213165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:10.213165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:10.213165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:10.213165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:10.213165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:10.213165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:10.213165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:10.213165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:10.214082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 271/538] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:10.222069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c482292-fbc8-48c1-aaa0-0be5db928183 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:10.243313 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dd03c-278b-4bfa-a712-d83b74f7f15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:10.243957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dd03c-278b-4bfa-a712-d83b74f7f15a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:10.244230 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dd03c-278b-4bfa-a712-d83b74f7f15a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:10.244494 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dd03c-278b-4bfa-a712-d83b74f7f15a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:10.245216 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0dd03c-278b-4bfa-a712-d83b74f7f15a None admin] RBAC: Adding query filter params (role.id=bf66c83a5d0f41039e44947c9fb18d3c, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=fbc36c937503477e8542cbef7c5f5db8) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:10.245518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0dd03c-278b-4bfa-a712-d83b74f7f15a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:10.246976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0dd03c-278b-4bfa-a712-d83b74f7f15a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:10.265016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 268/539] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:10 2022] GET /identity/v3/role_assignments?user.id=fbc36c937503477e8542cbef7c5f5db8&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=bf66c83a5d0f41039e44947c9fb18d3c => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:10.296322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:10.401328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c482292-fbc8-48c1-aaa0-0be5db928183 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:10.444443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be671be3-ebff-43fa-9489-9d0261efa3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:10.445241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be671be3-ebff-43fa-9489-9d0261efa3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:10.445530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be671be3-ebff-43fa-9489-9d0261efa3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:10.445813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be671be3-ebff-43fa-9489-9d0261efa3f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:10.446525 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be671be3-ebff-43fa-9489-9d0261efa3f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:10.446837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be671be3-ebff-43fa-9489-9d0261efa3f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:10.448318 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be671be3-ebff-43fa-9489-9d0261efa3f9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:10.468038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 272/540] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:10.473654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dd03c-278b-4bfa-a712-d83b74f7f15a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:10.499246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1327b-8e7e-4a4c-862c-ede3200bd893 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:10.499587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1327b-8e7e-4a4c-862c-ede3200bd893 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:10.499854 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1327b-8e7e-4a4c-862c-ede3200bd893 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:10.501323 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 273/541] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:10.506820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fe052-da68-4245-ba25-c15a7c5fe7d8 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:10.507107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fe052-da68-4245-ba25-c15a7c5fe7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:10.507382 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fe052-da68-4245-ba25-c15a7c5fe7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:10.527487 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ae3fe052-da68-4245-ba25-c15a7c5fe7d8 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:10.528767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ae3fe052-da68-4245-ba25-c15a7c5fe7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:10.604140 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 274/542] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:08:10.653016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dd03c-278b-4bfa-a712-d83b74f7f15a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:10.688576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a2aa5-ce65-4689-a711-7f4e94703c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:10.689250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a2aa5-ce65-4689-a711-7f4e94703c2d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:10.689529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a2aa5-ce65-4689-a711-7f4e94703c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:10.689850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a2aa5-ce65-4689-a711-7f4e94703c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:10.690582 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a2aa5-ce65-4689-a711-7f4e94703c2d None admin] RBAC: Adding query filter params (role.id=bf66c83a5d0f41039e44947c9fb18d3c, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=5bde943833bb43e78879748c49ce3332) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:10.690888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a2aa5-ce65-4689-a711-7f4e94703c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:10.692378 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a2aa5-ce65-4689-a711-7f4e94703c2d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:10.698083 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 269/543] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:10 2022] GET /identity/v3/role_assignments?user.id=5bde943833bb43e78879748c49ce3332&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=bf66c83a5d0f41039e44947c9fb18d3c => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:10.956738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fe052-da68-4245-ba25-c15a7c5fe7d8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:10.995173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.079730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fe052-da68-4245-ba25-c15a7c5fe7d8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.115425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58db7c4-5c67-4816-bed4-b3e9e6689c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.116147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58db7c4-5c67-4816-bed4-b3e9e6689c47 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.116432 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58db7c4-5c67-4816-bed4-b3e9e6689c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.116701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58db7c4-5c67-4816-bed4-b3e9e6689c47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.127597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58db7c4-5c67-4816-bed4-b3e9e6689c47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-a58db7c4-5c67-4816-bed4-b3e9e6689c47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:11.132470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:11.133374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:11.134181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:11.134181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:11.134181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:11.134181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:11.134181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:11.134181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:11.134181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:11.134181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:11.134181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:11.134181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:11.134181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:11.134181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:11.134181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 275/544] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:11.142792 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a2aa5-ce65-4689-a711-7f4e94703c2d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.144169 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ecb93-f679-46bb-b561-2653d603f111 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.144520 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ecb93-f679-46bb-b561-2653d603f111 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.144803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ecb93-f679-46bb-b561-2653d603f111 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.146259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 276/545] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:11.154114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa5037-1b67-40a4-bf71-63d85d39ec30 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.154406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa5037-1b67-40a4-bf71-63d85d39ec30 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.154710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa5037-1b67-40a4-bf71-63d85d39ec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.174877 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-29fa5037-1b67-40a4-bf71-63d85d39ec30 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:11.176138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-29fa5037-1b67-40a4-bf71-63d85d39ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:11.251931 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 277/546] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:08:11.256909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.358455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a2aa5-ce65-4689-a711-7f4e94703c2d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.400804 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca76590-6117-490e-8ee1-251aa9c1a5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.401437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca76590-6117-490e-8ee1-251aa9c1a5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.401716 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca76590-6117-490e-8ee1-251aa9c1a5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.401988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca76590-6117-490e-8ee1-251aa9c1a5b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.402659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca76590-6117-490e-8ee1-251aa9c1a5b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:11.402959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca76590-6117-490e-8ee1-251aa9c1a5b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:11.404370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca76590-6117-490e-8ee1-251aa9c1a5b0 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:11.413345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 270/547] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:11.421099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa5037-1b67-40a4-bf71-63d85d39ec30 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.447349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.541456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa5037-1b67-40a4-bf71-63d85d39ec30 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.556652 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca76590-6117-490e-8ee1-251aa9c1a5b0 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.578502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775825eb-9c59-4eb1-afc7-9630aa0a2726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.579250 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775825eb-9c59-4eb1-afc7-9630aa0a2726 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.579598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775825eb-9c59-4eb1-afc7-9630aa0a2726 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.579912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775825eb-9c59-4eb1-afc7-9630aa0a2726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.591324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775825eb-9c59-4eb1-afc7-9630aa0a2726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:11.592936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775825eb-9c59-4eb1-afc7-9630aa0a2726 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-775825eb-9c59-4eb1-afc7-9630aa0a2726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:11.610602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:11.611541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:11.612429 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:11.612429 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:11.612429 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:11.613035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 278/548] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:11.622119 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775825eb-9c59-4eb1-afc7-9630aa0a2726 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.678908 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca76590-6117-490e-8ee1-251aa9c1a5b0 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.716103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.720374 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f316b50-1014-4b6c-85fb-ad6f1680a6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.720962 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316b50-1014-4b6c-85fb-ad6f1680a6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.721248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316b50-1014-4b6c-85fb-ad6f1680a6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.721545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316b50-1014-4b6c-85fb-ad6f1680a6e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.734037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f316b50-1014-4b6c-85fb-ad6f1680a6e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-4f316b50-1014-4b6c-85fb-ad6f1680a6e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:11.739470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:11.740383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:11.741803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:11.741803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:11.741803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:11.741803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:11.741803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:11.741803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:11.741803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:11.741803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:11.741803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:11.741803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:11.741803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:11.741803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:11.741803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 271/549] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:11.746762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f316b50-1014-4b6c-85fb-ad6f1680a6e4 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.785182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.850537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f316b50-1014-4b6c-85fb-ad6f1680a6e4 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.873882 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775825eb-9c59-4eb1-afc7-9630aa0a2726 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.885839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da728f-f161-4af1-b432-bceec393961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.886457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da728f-f161-4af1-b432-bceec393961d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.886736 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da728f-f161-4af1-b432-bceec393961d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.887007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da728f-f161-4af1-b432-bceec393961d None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.887676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da728f-f161-4af1-b432-bceec393961d None admin] RBAC: Adding query filter params (name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:11.888004 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da728f-f161-4af1-b432-bceec393961d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:11.889578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da728f-f161-4af1-b432-bceec393961d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:11.898442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 272/550] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:11.903916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da728f-f161-4af1-b432-bceec393961d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.923425 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.964406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f92011-ee1e-4252-8f6f-ca3ca337e2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.965118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f92011-ee1e-4252-8f6f-ca3ca337e2fd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.965325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f92011-ee1e-4252-8f6f-ca3ca337e2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.965565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f92011-ee1e-4252-8f6f-ca3ca337e2fd None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.966229 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f92011-ee1e-4252-8f6f-ca3ca337e2fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:11.966536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f92011-ee1e-4252-8f6f-ca3ca337e2fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:11.967999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f92011-ee1e-4252-8f6f-ca3ca337e2fd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:11.997921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 279/551] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:12.003420 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f92011-ee1e-4252-8f6f-ca3ca337e2fd None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.021804 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da728f-f161-4af1-b432-bceec393961d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.085235 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4e03d-be59-4768-b5ed-b5aaa0a9282d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.085883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4e03d-be59-4768-b5ed-b5aaa0a9282d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.086163 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4e03d-be59-4768-b5ed-b5aaa0a9282d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.086434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4e03d-be59-4768-b5ed-b5aaa0a9282d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.109593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4e03d-be59-4768-b5ed-b5aaa0a9282d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.111028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4e03d-be59-4768-b5ed-b5aaa0a9282d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-3ee4e03d-be59-4768-b5ed-b5aaa0a9282d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:12.136675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:12.137782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:12.138819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:12.138819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:12.138819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:12.138819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 273/552] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:12.150557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4e03d-be59-4768-b5ed-b5aaa0a9282d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.174702 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f92011-ee1e-4252-8f6f-ca3ca337e2fd None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.205349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.216491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75547a-e1d9-49f7-b85a-2725ce115528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.217446 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75547a-e1d9-49f7-b85a-2725ce115528 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.217735 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75547a-e1d9-49f7-b85a-2725ce115528 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.218007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75547a-e1d9-49f7-b85a-2725ce115528 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.227450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75547a-e1d9-49f7-b85a-2725ce115528 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.228979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75547a-e1d9-49f7-b85a-2725ce115528 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7f75547a-e1d9-49f7-b85a-2725ce115528 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:12.244098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:12.245135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:12.246071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:12.246071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:12.246071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:12.246071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:12.246071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:12.246071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:12.246071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:12.246071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:12.246071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:08:12.246071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:12.246071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 280/553] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:12.251543 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75547a-e1d9-49f7-b85a-2725ce115528 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.312689 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.366098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75547a-e1d9-49f7-b85a-2725ce115528 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.376842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4e03d-be59-4768-b5ed-b5aaa0a9282d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.403942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e29396-0890-4c98-bc47-4ea94084fac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.404699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29396-0890-4c98-bc47-4ea94084fac3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.405041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29396-0890-4c98-bc47-4ea94084fac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.405685 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29396-0890-4c98-bc47-4ea94084fac3 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.406687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e29396-0890-4c98-bc47-4ea94084fac3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:12.407003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e29396-0890-4c98-bc47-4ea94084fac3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.408627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e29396-0890-4c98-bc47-4ea94084fac3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.429432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670eb639-b5e5-4e19-800f-0d90df9e79e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.430123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 281/554] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:12.430341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eb639-b5e5-4e19-800f-0d90df9e79e8 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.430718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eb639-b5e5-4e19-800f-0d90df9e79e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.431088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eb639-b5e5-4e19-800f-0d90df9e79e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.431345 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504f5a-3ecd-489b-89b6-d98f8085360d None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.431630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504f5a-3ecd-489b-89b6-d98f8085360d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.432032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670eb639-b5e5-4e19-800f-0d90df9e79e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:12.432426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670eb639-b5e5-4e19-800f-0d90df9e79e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.433957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670eb639-b5e5-4e19-800f-0d90df9e79e8 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.436061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504f5a-3ecd-489b-89b6-d98f8085360d None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.437764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 282/555] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:12.438485 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3504f5a-3ecd-489b-89b6-d98f8085360d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.452061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 274/556] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:12.453416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ce662-257d-4607-ae59-a33db2114ab9 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.456062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ce662-257d-4607-ae59-a33db2114ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.456342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ce662-257d-4607-ae59-a33db2114ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.479673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-362ce662-257d-4607-ae59-a33db2114ab9 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:12.481598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-362ce662-257d-4607-ae59-a33db2114ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:12.506334 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.563439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 275/557] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:12.564696 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ce662-257d-4607-ae59-a33db2114ab9 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.575975 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3504f5a-3ecd-489b-89b6-d98f8085360d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.622944 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f063b-8b36-4bdb-9124-9082f0909681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.624405 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f063b-8b36-4bdb-9124-9082f0909681 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.625242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f063b-8b36-4bdb-9124-9082f0909681 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.625694 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f063b-8b36-4bdb-9124-9082f0909681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.629573 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.677439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ce662-257d-4607-ae59-a33db2114ab9 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.721069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f063b-8b36-4bdb-9124-9082f0909681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.721265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84b3b8-dc4a-47e4-a39a-7c1a44034d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.721838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84b3b8-dc4a-47e4-a39a-7c1a44034d6a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.722241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84b3b8-dc4a-47e4-a39a-7c1a44034d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.722739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84b3b8-dc4a-47e4-a39a-7c1a44034d6a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.724741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f063b-8b36-4bdb-9124-9082f0909681 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.730326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84b3b8-dc4a-47e4-a39a-7c1a44034d6a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.731917 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84b3b8-dc4a-47e4-a39a-7c1a44034d6a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-2f84b3b8-dc4a-47e4-a39a-7c1a44034d6a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:12.744483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:12.745548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:12.746550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:12.746550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:12.746550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:12.746550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:12.746550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:12.746550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:12.746550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:12.746550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:12.746550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:12.746550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:12.750686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 276/558] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:12.752138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb72ae-9dc9-425b-b75f-dbbd0f028763 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.752506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb72ae-9dc9-425b-b75f-dbbd0f028763 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.752855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb72ae-9dc9-425b-b75f-dbbd0f028763 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.754525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 277/559] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:12.755248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb72ae-9dc9-425b-b75f-dbbd0f028763 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.789477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.856628 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 283/560] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:08:12.858299 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2773a-77cf-4c56-8163-87a1a2d0c5ef None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.858769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2773a-77cf-4c56-8163-87a1a2d0c5ef None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.859222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2773a-77cf-4c56-8163-87a1a2d0c5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.877544 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4cd2773a-77cf-4c56-8163-87a1a2d0c5ef None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:12.879070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4cd2773a-77cf-4c56-8163-87a1a2d0c5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:12.879179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb72ae-9dc9-425b-b75f-dbbd0f028763 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.898527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.917117 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf904eba-3b00-4603-81ca-72a39aa6bd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.917742 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf904eba-3b00-4603-81ca-72a39aa6bd57 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.918017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf904eba-3b00-4603-81ca-72a39aa6bd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.918287 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf904eba-3b00-4603-81ca-72a39aa6bd57 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.919032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf904eba-3b00-4603-81ca-72a39aa6bd57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:12.919334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf904eba-3b00-4603-81ca-72a39aa6bd57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.920855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf904eba-3b00-4603-81ca-72a39aa6bd57 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.944861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 278/561] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:12.944861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf904eba-3b00-4603-81ca-72a39aa6bd57 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.956325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 284/562] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:12.957195 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2773a-77cf-4c56-8163-87a1a2d0c5ef None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.044004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:13.072644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2773a-77cf-4c56-8163-87a1a2d0c5ef None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.080469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf904eba-3b00-4603-81ca-72a39aa6bd57 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.109737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd67c9-ca94-4180-9d95-06a6c5999598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.110377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd67c9-ca94-4180-9d95-06a6c5999598 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.110651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd67c9-ca94-4180-9d95-06a6c5999598 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.110919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd67c9-ca94-4180-9d95-06a6c5999598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.116201 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d085398-08b7-4d5d-98fb-e4d2dfe16195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.116912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d085398-08b7-4d5d-98fb-e4d2dfe16195 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.117191 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d085398-08b7-4d5d-98fb-e4d2dfe16195 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.117461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d085398-08b7-4d5d-98fb-e4d2dfe16195 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.121571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd67c9-ca94-4180-9d95-06a6c5999598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.123061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd67c9-ca94-4180-9d95-06a6c5999598 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.128045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d085398-08b7-4d5d-98fb-e4d2dfe16195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-6d085398-08b7-4d5d-98fb-e4d2dfe16195 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:13.133136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:13.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:13.135132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:13.135132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:13.135132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:13.135132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:13.135132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:13.135132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:13.135132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:13.135132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:13.135132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:13.135132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:13.135132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:13.135132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:13.135132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 279/563] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:13.135132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d085398-08b7-4d5d-98fb-e4d2dfe16195 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e6bd67c9-ca94-4180-9d95-06a6c5999598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:13.144629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:13.145636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:13.151907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:13.151907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:13.151907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:13.151907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 285/564] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:13.151907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33f097-9a47-46ef-83a4-f708b6cc574c None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.151907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33f097-9a47-46ef-83a4-f708b6cc574c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.151907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33f097-9a47-46ef-83a4-f708b6cc574c None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.153575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 286/565] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:13.154357 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33f097-9a47-46ef-83a4-f708b6cc574c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.186262 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:13.258756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d085398-08b7-4d5d-98fb-e4d2dfe16195 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.260172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33f097-9a47-46ef-83a4-f708b6cc574c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.285389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:13.291412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe0d12-f624-4ac2-878e-37aaf3f4e108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.292162 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0d12-f624-4ac2-878e-37aaf3f4e108 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.292509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0d12-f624-4ac2-878e-37aaf3f4e108 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.292848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0d12-f624-4ac2-878e-37aaf3f4e108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.293802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b79f9d-b45a-419d-a00a-a6cee2373cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.294410 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b79f9d-b45a-419d-a00a-a6cee2373cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.294689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b79f9d-b45a-419d-a00a-a6cee2373cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.294961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b79f9d-b45a-419d-a00a-a6cee2373cc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.295684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b79f9d-b45a-419d-a00a-a6cee2373cc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:13.296006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b79f9d-b45a-419d-a00a-a6cee2373cc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.297375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b79f9d-b45a-419d-a00a-a6cee2373cc9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.303785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe0d12-f624-4ac2-878e-37aaf3f4e108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.305281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe0d12-f624-4ac2-878e-37aaf3f4e108 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.306064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 287/566] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:13.306884 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b79f9d-b45a-419d-a00a-a6cee2373cc9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-23fe0d12-f624-4ac2-878e-37aaf3f4e108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:13.323859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:13.325061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:13.326200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:13.326200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:13.326200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:13.326200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 280/567] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:13.326200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7601d-e7d6-4f7c-92ce-66ffa92afe1e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.326570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7601d-e7d6-4f7c-92ce-66ffa92afe1e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.326653 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7601d-e7d6-4f7c-92ce-66ffa92afe1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.343672 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-77a7601d-e7d6-4f7c-92ce-66ffa92afe1e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:13.344874 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-77a7601d-e7d6-4f7c-92ce-66ffa92afe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:13.405178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b79f9d-b45a-419d-a00a-a6cee2373cc9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.407957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 281/568] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:13.408771 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7601d-e7d6-4f7c-92ce-66ffa92afe1e None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.433887 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:13.441799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcefe4d-a5d0-4e9c-97ee-aef50b6e5af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.442423 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcefe4d-a5d0-4e9c-97ee-aef50b6e5af0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.442708 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcefe4d-a5d0-4e9c-97ee-aef50b6e5af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.442987 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcefe4d-a5d0-4e9c-97ee-aef50b6e5af0 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.443644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcefe4d-a5d0-4e9c-97ee-aef50b6e5af0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:13.443993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcefe4d-a5d0-4e9c-97ee-aef50b6e5af0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.445385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcefe4d-a5d0-4e9c-97ee-aef50b6e5af0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.456930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 288/569] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:13.457723 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcefe4d-a5d0-4e9c-97ee-aef50b6e5af0 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.514151 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:13.526151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7601d-e7d6-4f7c-92ce-66ffa92afe1e None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.562219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a26d-7e10-451d-a78b-155656231f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.563182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a26d-7e10-451d-a78b-155656231f35 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.563461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a26d-7e10-451d-a78b-155656231f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.563654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcefe4d-a5d0-4e9c-97ee-aef50b6e5af0 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.563824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a26d-7e10-451d-a78b-155656231f35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.574717 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454a26d-7e10-451d-a78b-155656231f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-a454a26d-7e10-451d-a78b-155656231f35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:13.580027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:13.580991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:13.581882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:13.581882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:13.581882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:13.581882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:13.581882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:13.581882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:13.581882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:13.581882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:13.581882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:13.581882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:13.581882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:13.581882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:13.581882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 282/570] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:13.582594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a26d-7e10-451d-a78b-155656231f35 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.604699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fdcdc-d73b-4b6a-9b02-65af8525cf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.605347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fdcdc-d73b-4b6a-9b02-65af8525cf9a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.605602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fdcdc-d73b-4b6a-9b02-65af8525cf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.605899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fdcdc-d73b-4b6a-9b02-65af8525cf9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.617144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fdcdc-d73b-4b6a-9b02-65af8525cf9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.618590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fdcdc-d73b-4b6a-9b02-65af8525cf9a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-ba6fdcdc-d73b-4b6a-9b02-65af8525cf9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:13.633257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:13.634441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:13.635383 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:13.635383 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:13.635383 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:13.635383 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 289/571] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:13.635651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fdcdc-d73b-4b6a-9b02-65af8525cf9a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.678227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:13.701044 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a26d-7e10-451d-a78b-155656231f35 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.735542 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a1552-1db6-4164-9a18-5734d9276e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.736222 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a1552-1db6-4164-9a18-5734d9276e3b None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.736438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a1552-1db6-4164-9a18-5734d9276e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.736704 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a1552-1db6-4164-9a18-5734d9276e3b None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.737352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a1552-1db6-4164-9a18-5734d9276e3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:13.737651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a1552-1db6-4164-9a18-5734d9276e3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.739040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a1552-1db6-4164-9a18-5734d9276e3b None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.741169 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fdcdc-d73b-4b6a-9b02-65af8525cf9a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.742737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:13.751199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 283/572] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:13.752668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a1552-1db6-4164-9a18-5734d9276e3b None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.778550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86906fd0-bf42-481a-beb6-21298a0e3e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.779232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86906fd0-bf42-481a-beb6-21298a0e3e86 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.779510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86906fd0-bf42-481a-beb6-21298a0e3e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.779805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86906fd0-bf42-481a-beb6-21298a0e3e86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.786613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86906fd0-bf42-481a-beb6-21298a0e3e86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.788142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86906fd0-bf42-481a-beb6-21298a0e3e86 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-86906fd0-bf42-481a-beb6-21298a0e3e86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:13.799274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:13.800407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:13.801521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:13.801521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:13.801521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:13.801521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:13.801521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:13.801521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:13.801521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:13.801521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:13.801521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 290/573] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:13.801521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86906fd0-bf42-481a-beb6-21298a0e3e86 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.856627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a1552-1db6-4164-9a18-5734d9276e3b None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.890121 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bedb6-03c0-4725-bdff-aa5ad1260d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.890723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bedb6-03c0-4725-bdff-aa5ad1260d9b None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.890999 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bedb6-03c0-4725-bdff-aa5ad1260d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.891267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bedb6-03c0-4725-bdff-aa5ad1260d9b None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.891959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306bedb6-03c0-4725-bdff-aa5ad1260d9b None admin] RBAC: Adding query filter params (name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:13.892255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306bedb6-03c0-4725-bdff-aa5ad1260d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.893619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306bedb6-03c0-4725-bdff-aa5ad1260d9b None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.898447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:13.902207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 284/574] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:13.903165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bedb6-03c0-4725-bdff-aa5ad1260d9b None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.903438 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86906fd0-bf42-481a-beb6-21298a0e3e86 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.938182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ba95a-811e-4c0e-a106-0dd784c4fa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.938835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ba95a-811e-4c0e-a106-0dd784c4fa4e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.939114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ba95a-811e-4c0e-a106-0dd784c4fa4e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.939386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ba95a-811e-4c0e-a106-0dd784c4fa4e None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.940090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ba95a-811e-4c0e-a106-0dd784c4fa4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:13.940393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ba95a-811e-4c0e-a106-0dd784c4fa4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.941789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ba95a-811e-4c0e-a106-0dd784c4fa4e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.953310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 291/575] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:13.954101 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ba95a-811e-4c0e-a106-0dd784c4fa4e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.977349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:14.009831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bedb6-03c0-4725-bdff-aa5ad1260d9b None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.049080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670e95f-29a0-4325-b00c-6e1f21b1bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.049736 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670e95f-29a0-4325-b00c-6e1f21b1bb55 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.050017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670e95f-29a0-4325-b00c-6e1f21b1bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.050288 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670e95f-29a0-4325-b00c-6e1f21b1bb55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.060772 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670e95f-29a0-4325-b00c-6e1f21b1bb55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:14.062686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ba95a-811e-4c0e-a106-0dd784c4fa4e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-6670e95f-29a0-4325-b00c-6e1f21b1bb55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:14.065878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:14.066987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:14.068055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:14.068055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:14.068055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:14.068055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:14.068055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:14.068055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:14.068055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:14.068055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:14.068055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:14.068055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:14.068055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:14.068055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:14.072072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 285/576] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:14.072911 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670e95f-29a0-4325-b00c-6e1f21b1bb55 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.098759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85603a73-3a01-426f-aaaf-4b83edd2c6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.099396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85603a73-3a01-426f-aaaf-4b83edd2c6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.099656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85603a73-3a01-426f-aaaf-4b83edd2c6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.099968 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85603a73-3a01-426f-aaaf-4b83edd2c6c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.106692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85603a73-3a01-426f-aaaf-4b83edd2c6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:14.108259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85603a73-3a01-426f-aaaf-4b83edd2c6c4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-85603a73-3a01-426f-aaaf-4b83edd2c6c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:14.119142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:14.120241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:14.121586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:14.121586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:14.121586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:14.121586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:14.121586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:14.121586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:14.121586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:14.121586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:14.123877 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 292/577] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:14.125006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85603a73-3a01-426f-aaaf-4b83edd2c6c4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.133208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:14.176961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670e95f-29a0-4325-b00c-6e1f21b1bb55 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.209817 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:14.210560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d4a35-5b5b-47fd-9a70-64ac0111714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.211303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d4a35-5b5b-47fd-9a70-64ac0111714f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.211628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d4a35-5b5b-47fd-9a70-64ac0111714f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.211869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d4a35-5b5b-47fd-9a70-64ac0111714f None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.212556 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d4a35-5b5b-47fd-9a70-64ac0111714f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:14.212844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d4a35-5b5b-47fd-9a70-64ac0111714f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:14.214309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d4a35-5b5b-47fd-9a70-64ac0111714f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:14.230719 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 286/578] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:14.230719 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d4a35-5b5b-47fd-9a70-64ac0111714f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.230979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85603a73-3a01-426f-aaaf-4b83edd2c6c4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.260245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfd0b8-6638-4723-a233-064b925ac055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.260897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfd0b8-6638-4723-a233-064b925ac055 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.261182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfd0b8-6638-4723-a233-064b925ac055 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.261458 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfd0b8-6638-4723-a233-064b925ac055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.271870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfd0b8-6638-4723-a233-064b925ac055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:14.273356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfd0b8-6638-4723-a233-064b925ac055 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-bebfd0b8-6638-4723-a233-064b925ac055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:14.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:14.288254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:14.289270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:14.289270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:14.289270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:14.289270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 293/579] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:14.289270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfd0b8-6638-4723-a233-064b925ac055 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.331625 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d4a35-5b5b-47fd-9a70-64ac0111714f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.350301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:14.363807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb56382-3fd8-4a51-9e4a-4e72fcd57a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.364433 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb56382-3fd8-4a51-9e4a-4e72fcd57a01 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.364707 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb56382-3fd8-4a51-9e4a-4e72fcd57a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.364977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb56382-3fd8-4a51-9e4a-4e72fcd57a01 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.372208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb56382-3fd8-4a51-9e4a-4e72fcd57a01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:14.373662 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb56382-3fd8-4a51-9e4a-4e72fcd57a01 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-beb56382-3fd8-4a51-9e4a-4e72fcd57a01 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:14.384671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:14.385806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:14.386937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:14.386937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:14.386937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:14.386937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:14.386937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:14.386937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:14.386937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:14.386937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:14.386937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:08:14.386937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:14.386937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 287/580] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:14.386937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb56382-3fd8-4a51-9e4a-4e72fcd57a01 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.397516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfd0b8-6638-4723-a233-064b925ac055 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.431691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ae10-30c2-4d02-aab6-3c20cdf92ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.432439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ae10-30c2-4d02-aab6-3c20cdf92ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.432712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ae10-30c2-4d02-aab6-3c20cdf92ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.432977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ae10-30c2-4d02-aab6-3c20cdf92ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.433633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456ae10-30c2-4d02-aab6-3c20cdf92ca3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:14.433930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456ae10-30c2-4d02-aab6-3c20cdf92ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:14.435329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456ae10-30c2-4d02-aab6-3c20cdf92ca3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:14.436708 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:14.444712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 294/581] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:14.445767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ae10-30c2-4d02-aab6-3c20cdf92ca3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.484031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb56382-3fd8-4a51-9e4a-4e72fcd57a01 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.517491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f36c1-bf96-4864-aaa9-58c88ecae874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.518095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f36c1-bf96-4864-aaa9-58c88ecae874 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.518368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f36c1-bf96-4864-aaa9-58c88ecae874 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.518658 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f36c1-bf96-4864-aaa9-58c88ecae874 None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.519342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f36c1-bf96-4864-aaa9-58c88ecae874 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:14.519644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f36c1-bf96-4864-aaa9-58c88ecae874 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:14.521102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f36c1-bf96-4864-aaa9-58c88ecae874 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:14.532829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 288/582] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:14.533606 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f36c1-bf96-4864-aaa9-58c88ecae874 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.553028 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ae10-30c2-4d02-aab6-3c20cdf92ca3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.574420 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:14.586939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773160a-9f2d-4fbc-a33f-e55e0e18cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.587570 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773160a-9f2d-4fbc-a33f-e55e0e18cc30 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.587887 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773160a-9f2d-4fbc-a33f-e55e0e18cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.588161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773160a-9f2d-4fbc-a33f-e55e0e18cc30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.588905 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773160a-9f2d-4fbc-a33f-e55e0e18cc30 None admin] RBAC: Adding query filter params (role.id=bf66c83a5d0f41039e44947c9fb18d3c, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=ac02a26fe2a44b7db623003d1a96ed36) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:14.589219 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773160a-9f2d-4fbc-a33f-e55e0e18cc30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:14.590669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773160a-9f2d-4fbc-a33f-e55e0e18cc30 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:14.596476 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 295/583] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/role_assignments?user.id=ac02a26fe2a44b7db623003d1a96ed36&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=bf66c83a5d0f41039e44947c9fb18d3c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:14.597452 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773160a-9f2d-4fbc-a33f-e55e0e18cc30 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.655554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f36c1-bf96-4864-aaa9-58c88ecae874 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.665903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:14.699539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190afafd-b7e7-412c-8c98-b01dfb84fdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.700198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190afafd-b7e7-412c-8c98-b01dfb84fdc4 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.700467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190afafd-b7e7-412c-8c98-b01dfb84fdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.700750 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190afafd-b7e7-412c-8c98-b01dfb84fdc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.701391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190afafd-b7e7-412c-8c98-b01dfb84fdc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:14.701689 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190afafd-b7e7-412c-8c98-b01dfb84fdc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:14.703178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190afafd-b7e7-412c-8c98-b01dfb84fdc4 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:14.716416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 289/584] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:14.717327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190afafd-b7e7-412c-8c98-b01dfb84fdc4 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.724275 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773160a-9f2d-4fbc-a33f-e55e0e18cc30 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.762680 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1c18c-0291-449a-9c1a-4a8d11888893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.763217 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1c18c-0291-449a-9c1a-4a8d11888893 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.763498 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1c18c-0291-449a-9c1a-4a8d11888893 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.763809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1c18c-0291-449a-9c1a-4a8d11888893 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.764614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1c18c-0291-449a-9c1a-4a8d11888893 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:14.765013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1c18c-0291-449a-9c1a-4a8d11888893 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:14.766517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1c18c-0291-449a-9c1a-4a8d11888893 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:14.790739 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 296/585] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:14.790739 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1c18c-0291-449a-9c1a-4a8d11888893 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.826708 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:14.830406 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190afafd-b7e7-412c-8c98-b01dfb84fdc4 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.872341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8575c4-8e5b-4801-a816-dbc43748eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.872996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8575c4-8e5b-4801-a816-dbc43748eb86 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.873276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8575c4-8e5b-4801-a816-dbc43748eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.873885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8575c4-8e5b-4801-a816-dbc43748eb86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.885014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8575c4-8e5b-4801-a816-dbc43748eb86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:14.886472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8575c4-8e5b-4801-a816-dbc43748eb86 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:14.896410 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1c18c-0291-449a-9c1a-4a8d11888893 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-6d8575c4-8e5b-4801-a816-dbc43748eb86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:14.901338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:14.902339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:14.903253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:14.903253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:14.903253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:14.903253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 290/586] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:14.903253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8575c4-8e5b-4801-a816-dbc43748eb86 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.919421 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:14.938613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4396c3-df8e-473f-9494-45c53f63aaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.939388 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4396c3-df8e-473f-9494-45c53f63aaec None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.939805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4396c3-df8e-473f-9494-45c53f63aaec None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.940084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4396c3-df8e-473f-9494-45c53f63aaec None admin] PATH_INFO: `/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/cb9ef38ec3b448828826de5f76a552d8/roles/bf66c83a5d0f41039e44947c9fb18d3c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.955474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4396c3-df8e-473f-9494-45c53f63aaec None admin] RBAC: Authorizing `identity:create_grant(project_id=0864c2a6b50f403db79930d0869f8e23, user_id=cb9ef38ec3b448828826de5f76a552d8, role_id=bf66c83a5d0f41039e44947c9fb18d3c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:14.957090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4396c3-df8e-473f-9494-45c53f63aaec None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:14.983727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 297/587] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:14 2022] PUT /identity/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/cb9ef38ec3b448828826de5f76a552d8/roles/bf66c83a5d0f41039e44947c9fb18d3c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:08:14.983727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4396c3-df8e-473f-9494-45c53f63aaec None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:15.029934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8575c4-8e5b-4801-a816-dbc43748eb86 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.078640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f26abb-5b56-4fc3-a034-c4b9d5bcf5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.079534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f26abb-5b56-4fc3-a034-c4b9d5bcf5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.079869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f26abb-5b56-4fc3-a034-c4b9d5bcf5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.080578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f26abb-5b56-4fc3-a034-c4b9d5bcf5e9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.089471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4396c3-df8e-473f-9494-45c53f63aaec None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.093394 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f26abb-5b56-4fc3-a034-c4b9d5bcf5e9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.094930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f26abb-5b56-4fc3-a034-c4b9d5bcf5e9 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-36f26abb-5b56-4fc3-a034-c4b9d5bcf5e9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:15.112053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:15.113199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:15.114495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:15.114495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:15.114495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:15.114495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:15.114495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:15.114495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:15.114495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:15.114495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:15.114495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:08:15.114495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:15.114495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 291/588] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:15.115088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f26abb-5b56-4fc3-a034-c4b9d5bcf5e9 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:15.134828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859a155-6b39-4439-b6d4-6cdbc56fb9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.135490 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859a155-6b39-4439-b6d4-6cdbc56fb9ac None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.135787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859a155-6b39-4439-b6d4-6cdbc56fb9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.136063 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:15.136164 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859a155-6b39-4439-b6d4-6cdbc56fb9ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.151741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859a155-6b39-4439-b6d4-6cdbc56fb9ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.151741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859a155-6b39-4439-b6d4-6cdbc56fb9ac None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-b859a155-6b39-4439-b6d4-6cdbc56fb9ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:15.174933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:15.175953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:15.176868 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:15.176868 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:15.176868 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:15.181956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 298/589] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:15.181956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859a155-6b39-4439-b6d4-6cdbc56fb9ac None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:15.220293 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:15.245850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f26abb-5b56-4fc3-a034-c4b9d5bcf5e9 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.282936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89370b8-53b7-4979-b142-aa1003c239d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.283926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89370b8-53b7-4979-b142-aa1003c239d4 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.284432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89370b8-53b7-4979-b142-aa1003c239d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.284878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89370b8-53b7-4979-b142-aa1003c239d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.285774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89370b8-53b7-4979-b142-aa1003c239d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:15.286249 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89370b8-53b7-4979-b142-aa1003c239d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.287947 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89370b8-53b7-4979-b142-aa1003c239d4 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.301733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 292/590] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:15.302797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89370b8-53b7-4979-b142-aa1003c239d4 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:15.322028 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859a155-6b39-4439-b6d4-6cdbc56fb9ac None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.366643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180ee89-6f1c-4c47-963d-ae07c8f53d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.367385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180ee89-6f1c-4c47-963d-ae07c8f53d4d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.367753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180ee89-6f1c-4c47-963d-ae07c8f53d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.368101 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180ee89-6f1c-4c47-963d-ae07c8f53d4d None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.369150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180ee89-6f1c-4c47-963d-ae07c8f53d4d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:15.369519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180ee89-6f1c-4c47-963d-ae07c8f53d4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.371676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180ee89-6f1c-4c47-963d-ae07c8f53d4d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.392062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:15.394721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 299/591] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Aug 31 00:08:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:15.395879 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180ee89-6f1c-4c47-963d-ae07c8f53d4d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:15.445968 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89370b8-53b7-4979-b142-aa1003c239d4 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.487314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:15.503974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203495a5-2415-4223-9ee3-9896c28d901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.504979 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203495a5-2415-4223-9ee3-9896c28d901a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.505466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203495a5-2415-4223-9ee3-9896c28d901a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.505926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203495a5-2415-4223-9ee3-9896c28d901a None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.507095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203495a5-2415-4223-9ee3-9896c28d901a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:15.507604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203495a5-2415-4223-9ee3-9896c28d901a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.510125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203495a5-2415-4223-9ee3-9896c28d901a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.514334 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180ee89-6f1c-4c47-963d-ae07c8f53d4d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.531488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 293/592] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:15.533086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203495a5-2415-4223-9ee3-9896c28d901a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:15.551150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac308c-de13-4079-8a06-fd1edf0f5019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.552098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac308c-de13-4079-8a06-fd1edf0f5019 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.552564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac308c-de13-4079-8a06-fd1edf0f5019 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.553050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac308c-de13-4079-8a06-fd1edf0f5019 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.560893 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac308c-de13-4079-8a06-fd1edf0f5019 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.563215 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac308c-de13-4079-8a06-fd1edf0f5019 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-73ac308c-de13-4079-8a06-fd1edf0f5019 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:15.575481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:15.576459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:15.577502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:15.577502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:15.577502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:15.577502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:15.577502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:15.577502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:15.577502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:15.577502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:15.577502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:08:15.577502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:15.579903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 300/593] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:15.580860 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac308c-de13-4079-8a06-fd1edf0f5019 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:15.691036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac308c-de13-4079-8a06-fd1edf0f5019 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.714779 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203495a5-2415-4223-9ee3-9896c28d901a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.736157 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521e5b3-5d90-4122-a8c4-a83392de8e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.737110 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e5b3-5d90-4122-a8c4-a83392de8e48 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.737575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e5b3-5d90-4122-a8c4-a83392de8e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.738064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e5b3-5d90-4122-a8c4-a83392de8e48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.745443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521e5b3-5d90-4122-a8c4-a83392de8e48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.747299 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521e5b3-5d90-4122-a8c4-a83392de8e48 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.749225 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-5521e5b3-5d90-4122-a8c4-a83392de8e48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:15.761609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:15.762601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:15.763540 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:15.763540 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:15.763540 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:15.763540 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:15.763540 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:15.763540 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:15.763540 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:15.763540 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:15.766279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 301/594] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:15.766801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:15.768050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521e5b3-5d90-4122-a8c4-a83392de8e48 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:15.777371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a501b4-d800-4e16-b12b-13771b6887c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.778412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a501b4-d800-4e16-b12b-13771b6887c8 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.778847 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a501b4-d800-4e16-b12b-13771b6887c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.779311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a501b4-d800-4e16-b12b-13771b6887c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.797968 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a501b4-d800-4e16-b12b-13771b6887c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.800619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a501b4-d800-4e16-b12b-13771b6887c8 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-31a501b4-d800-4e16-b12b-13771b6887c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:15.824632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:15.825650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:15.826595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:15.826595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:15.826595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:15.832029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 294/595] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:15.833805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a501b4-d800-4e16-b12b-13771b6887c8 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:15.886351 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521e5b3-5d90-4122-a8c4-a83392de8e48 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.922449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a9cb2-cbf0-4a34-9404-bc0eee61b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.923344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9cb2-cbf0-4a34-9404-bc0eee61b99d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.923809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9cb2-cbf0-4a34-9404-bc0eee61b99d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.924258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9cb2-cbf0-4a34-9404-bc0eee61b99d None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.925242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a9cb2-cbf0-4a34-9404-bc0eee61b99d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:15.925729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a9cb2-cbf0-4a34-9404-bc0eee61b99d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.927532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a9cb2-cbf0-4a34-9404-bc0eee61b99d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.948611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 302/596] 10.222.0.50 () {56 vars in 1139 bytes} [Wed Aug 31 00:08:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:15.949763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a9cb2-cbf0-4a34-9404-bc0eee61b99d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:16.007048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a501b4-d800-4e16-b12b-13771b6887c8 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:16.010275 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:16.059145 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0710d4-fc7c-4dc8-8c4e-78e782283f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:16.059674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0710d4-fc7c-4dc8-8c4e-78e782283f6e None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.059994 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0710d4-fc7c-4dc8-8c4e-78e782283f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.060245 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0710d4-fc7c-4dc8-8c4e-78e782283f6e None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.060940 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0710d4-fc7c-4dc8-8c4e-78e782283f6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:16.061241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0710d4-fc7c-4dc8-8c4e-78e782283f6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:16.063115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0710d4-fc7c-4dc8-8c4e-78e782283f6e None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:16.070128 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a9cb2-cbf0-4a34-9404-bc0eee61b99d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:16.075402 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 295/597] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:16.076339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0710d4-fc7c-4dc8-8c4e-78e782283f6e None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:16.108735 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6d328-2eda-4725-a5dc-752c19a273f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:16.110225 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6d328-2eda-4725-a5dc-752c19a273f4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.110802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6d328-2eda-4725-a5dc-752c19a273f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.111323 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6d328-2eda-4725-a5dc-752c19a273f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.112197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6d328-2eda-4725-a5dc-752c19a273f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:16.112758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6d328-2eda-4725-a5dc-752c19a273f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:16.114386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6d328-2eda-4725-a5dc-752c19a273f4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:16.121553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:16.129946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 303/598] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:16.130998 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6d328-2eda-4725-a5dc-752c19a273f4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:16.181026 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0710d4-fc7c-4dc8-8c4e-78e782283f6e None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:16.219721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06bd13-b325-429a-bdac-7a5a937220f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:16.221345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06bd13-b325-429a-bdac-7a5a937220f3 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.221809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06bd13-b325-429a-bdac-7a5a937220f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.222278 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06bd13-b325-429a-bdac-7a5a937220f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.237520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06bd13-b325-429a-bdac-7a5a937220f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:16.240042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06bd13-b325-429a-bdac-7a5a937220f3 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:16.244663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6d328-2eda-4725-a5dc-752c19a273f4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-ec06bd13-b325-429a-bdac-7a5a937220f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:16.262388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:16.263430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:16.264381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:16.264381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:16.264381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:16.266998 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:16.269703 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 296/599] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:16.270982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06bd13-b325-429a-bdac-7a5a937220f3 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:16.296352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ee9ed-a528-4078-965b-e9f01093bb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:16.297045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ee9ed-a528-4078-965b-e9f01093bb60 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.297327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ee9ed-a528-4078-965b-e9f01093bb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.297606 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ee9ed-a528-4078-965b-e9f01093bb60 None admin] PATH_INFO: `/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/f886be277ef84ec28a290380980c6f06/roles/bf66c83a5d0f41039e44947c9fb18d3c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.322206 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ee9ed-a528-4078-965b-e9f01093bb60 None admin] RBAC: Authorizing `identity:create_grant(project_id=0864c2a6b50f403db79930d0869f8e23, user_id=f886be277ef84ec28a290380980c6f06, role_id=bf66c83a5d0f41039e44947c9fb18d3c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:16.324094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ee9ed-a528-4078-965b-e9f01093bb60 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:16.341897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 304/600] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:16 2022] PUT /identity/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/f886be277ef84ec28a290380980c6f06/roles/bf66c83a5d0f41039e44947c9fb18d3c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:08:16.342926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ee9ed-a528-4078-965b-e9f01093bb60 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:16.391243 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:16.402630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06bd13-b325-429a-bdac-7a5a937220f3 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:16.454155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3db2f-3331-4816-9139-446ed1e410ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:16.455453 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3db2f-3331-4816-9139-446ed1e410ea None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.456366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3db2f-3331-4816-9139-446ed1e410ea None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.456843 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3db2f-3331-4816-9139-446ed1e410ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.467208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3db2f-3331-4816-9139-446ed1e410ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:16.469898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3db2f-3331-4816-9139-446ed1e410ea None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:16.473932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ee9ed-a528-4078-965b-e9f01093bb60 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-8ca3db2f-3331-4816-9139-446ed1e410ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:16.488824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:16.489858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:16.490812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:16.490812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:16.490812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:16.490812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:16.490812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:16.490812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:16.490812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:16.490812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:16.494095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 297/601] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:16.500213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3db2f-3331-4816-9139-446ed1e410ea None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:16.517498 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bab52f-479a-41e0-94fa-de9e1ef96a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:16.518322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bab52f-479a-41e0-94fa-de9e1ef96a38 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.518713 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bab52f-479a-41e0-94fa-de9e1ef96a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.519246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bab52f-479a-41e0-94fa-de9e1ef96a38 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.519929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bab52f-479a-41e0-94fa-de9e1ef96a38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:16.520402 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bab52f-479a-41e0-94fa-de9e1ef96a38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:16.521990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bab52f-479a-41e0-94fa-de9e1ef96a38 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:16.534867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 305/602] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:16.541396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bab52f-479a-41e0-94fa-de9e1ef96a38 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:16.601364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:16.625245 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3db2f-3331-4816-9139-446ed1e410ea None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:16.668638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdff90-1592-4cb4-bc88-a6055d640548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:16.669675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdff90-1592-4cb4-bc88-a6055d640548 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.670054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdff90-1592-4cb4-bc88-a6055d640548 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.670445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdff90-1592-4cb4-bc88-a6055d640548 None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.671278 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdff90-1592-4cb4-bc88-a6055d640548 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:16.671686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdff90-1592-4cb4-bc88-a6055d640548 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:16.673558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdff90-1592-4cb4-bc88-a6055d640548 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:16.688401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 298/603] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:16.694558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdff90-1592-4cb4-bc88-a6055d640548 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:16.700354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bab52f-479a-41e0-94fa-de9e1ef96a38 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:16.714693 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:16.746642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87387460-5dec-4203-8a78-c11f4e1c7d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:16.748076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87387460-5dec-4203-8a78-c11f4e1c7d4f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.748534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87387460-5dec-4203-8a78-c11f4e1c7d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.748989 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87387460-5dec-4203-8a78-c11f4e1c7d4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.757331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87387460-5dec-4203-8a78-c11f4e1c7d4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:16.759204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87387460-5dec-4203-8a78-c11f4e1c7d4f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-87387460-5dec-4203-8a78-c11f4e1c7d4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:16.776178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:16.777364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:16.778536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:16.778536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:16.778536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:16.778536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:16.778536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:16.778536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:16.778536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:16.778536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:16.781058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 306/604] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:16.783126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04017-95b2-49a6-bc8b-c1e055e8d491 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.783561 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04017-95b2-49a6-bc8b-c1e055e8d491 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.784002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04017-95b2-49a6-bc8b-c1e055e8d491 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.785872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 307/605] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:16.786777 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c04017-95b2-49a6-bc8b-c1e055e8d491 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:16.828611 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdff90-1592-4cb4-bc88-a6055d640548 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:16.863533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118704c-2eac-4f02-9fc6-a32aa3f2cf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:16.864180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118704c-2eac-4f02-9fc6-a32aa3f2cf3d None admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.864398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118704c-2eac-4f02-9fc6-a32aa3f2cf3d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.864676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118704c-2eac-4f02-9fc6-a32aa3f2cf3d None admin] PATH_INFO: `/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/fbc36c937503477e8542cbef7c5f5db8/roles/bf66c83a5d0f41039e44947c9fb18d3c` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.882371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118704c-2eac-4f02-9fc6-a32aa3f2cf3d None admin] RBAC: Authorizing `identity:create_grant(project_id=0864c2a6b50f403db79930d0869f8e23, user_id=fbc36c937503477e8542cbef7c5f5db8, role_id=bf66c83a5d0f41039e44947c9fb18d3c)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:16.883946 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118704c-2eac-4f02-9fc6-a32aa3f2cf3d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:16.888226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:16.898690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c04017-95b2-49a6-bc8b-c1e055e8d491 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:16.904113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 299/606] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:16 2022] PUT /identity/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/fbc36c937503477e8542cbef7c5f5db8/roles/bf66c83a5d0f41039e44947c9fb18d3c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:08:16.905959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84454d5-05d9-41c2-aaae-b71dd4929289 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.906403 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84454d5-05d9-41c2-aaae-b71dd4929289 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.906839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84454d5-05d9-41c2-aaae-b71dd4929289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.930178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-b84454d5-05d9-41c2-aaae-b71dd4929289 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:16.931655 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b84454d5-05d9-41c2-aaae-b71dd4929289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:16.961920 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e62f5-3dd7-4237-b8ab-7b294833c4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:16.962550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e62f5-3dd7-4237-b8ab-7b294833c4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.962855 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e62f5-3dd7-4237-b8ab-7b294833c4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.963327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e62f5-3dd7-4237-b8ab-7b294833c4f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.964070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e62f5-3dd7-4237-b8ab-7b294833c4f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:16.964421 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e62f5-3dd7-4237-b8ab-7b294833c4f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:16.965923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e62f5-3dd7-4237-b8ab-7b294833c4f7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:16.995803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 308/607] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:17.002106 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e62f5-3dd7-4237-b8ab-7b294833c4f7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:17.006498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:17.020941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 300/608] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:17.172137 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e62f5-3dd7-4237-b8ab-7b294833c4f7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:17.214595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad7b4b-bd5b-46db-b086-6345ac7138df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:17.215302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad7b4b-bd5b-46db-b086-6345ac7138df None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.215582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad7b4b-bd5b-46db-b086-6345ac7138df None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.215893 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad7b4b-bd5b-46db-b086-6345ac7138df None admin] PATH_INFO: `/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/5bde943833bb43e78879748c49ce3332/roles/bf66c83a5d0f41039e44947c9fb18d3c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.231585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad7b4b-bd5b-46db-b086-6345ac7138df None admin] RBAC: Authorizing `identity:create_grant(project_id=0864c2a6b50f403db79930d0869f8e23, user_id=5bde943833bb43e78879748c49ce3332, role_id=bf66c83a5d0f41039e44947c9fb18d3c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:17.233095 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad7b4b-bd5b-46db-b086-6345ac7138df None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:17.236150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:17.248239 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 309/609] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:17 2022] PUT /identity/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/5bde943833bb43e78879748c49ce3332/roles/bf66c83a5d0f41039e44947c9fb18d3c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:08:17.387496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84454d5-05d9-41c2-aaae-b71dd4929289 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:17.451810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb73b9-46b2-406a-8225-04a91ea7f62b None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.452106 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb73b9-46b2-406a-8225-04a91ea7f62b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.452327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb73b9-46b2-406a-8225-04a91ea7f62b None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.453947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 310/610] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:17.459384 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d4fe3-cdd6-4ff4-b46d-eb2d809666fd None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.459672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d4fe3-cdd6-4ff4-b46d-eb2d809666fd None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.459979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d4fe3-cdd6-4ff4-b46d-eb2d809666fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.488032 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-bd6d4fe3-cdd6-4ff4-b46d-eb2d809666fd None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:17.489237 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bd6d4fe3-cdd6-4ff4-b46d-eb2d809666fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:17.496133 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84454d5-05d9-41c2-aaae-b71dd4929289 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:17.529588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc2d5b-767d-468e-9829-ad3da6b4b55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:17.530226 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc2d5b-767d-468e-9829-ad3da6b4b55e None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.530569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc2d5b-767d-468e-9829-ad3da6b4b55e None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.530850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc2d5b-767d-468e-9829-ad3da6b4b55e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.541470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc2d5b-767d-468e-9829-ad3da6b4b55e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-6adc2d5b-767d-468e-9829-ad3da6b4b55e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:17.546417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:17.547395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:17.548290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:17.548290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:17.548290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:17.548290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:17.548290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:17.548290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:17.548290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:17.548290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:17.548290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:17.548290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:17.548290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:17.548290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:17.548290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 301/611] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:17.564721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc2d5b-767d-468e-9829-ad3da6b4b55e None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:17.592153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 311/612] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:17.664126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:17.724542 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc2d5b-767d-468e-9829-ad3da6b4b55e None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:17.763208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a3b9c-a915-4bfc-8a20-b58fea877c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:17.763852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a3b9c-a915-4bfc-8a20-b58fea877c4f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.764133 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a3b9c-a915-4bfc-8a20-b58fea877c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.764402 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a3b9c-a915-4bfc-8a20-b58fea877c4f None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.765140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a3b9c-a915-4bfc-8a20-b58fea877c4f None admin] RBAC: Adding query filter params (name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:17.765438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a3b9c-a915-4bfc-8a20-b58fea877c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:17.766833 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a3b9c-a915-4bfc-8a20-b58fea877c4f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:17.775845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 302/613] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:17.781652 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d4fe3-cdd6-4ff4-b46d-eb2d809666fd None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:17.890158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d4fe3-cdd6-4ff4-b46d-eb2d809666fd None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:17.917224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:17.924906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a3b9c-a915-4bfc-8a20-b58fea877c4f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:17.928148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0c80c-da63-4608-81ae-f6d7ab52e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:17.928828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0c80c-da63-4608-81ae-f6d7ab52e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.929115 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0c80c-da63-4608-81ae-f6d7ab52e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.929389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0c80c-da63-4608-81ae-f6d7ab52e4f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.941094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0c80c-da63-4608-81ae-f6d7ab52e4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:17.942577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0c80c-da63-4608-81ae-f6d7ab52e4f4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-62f0c80c-da63-4608-81ae-f6d7ab52e4f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:17.958443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:17.960643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:17.962837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:17.962837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:17.962837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:17.962837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 312/614] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:17.969495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0c80c-da63-4608-81ae-f6d7ab52e4f4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.114595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a3b9c-a915-4bfc-8a20-b58fea877c4f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.146179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:18.159299 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0c80c-da63-4608-81ae-f6d7ab52e4f4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.184968 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b536756-1131-4c9b-8a3a-4c745827bc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.185630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b536756-1131-4c9b-8a3a-4c745827bc03 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.185910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b536756-1131-4c9b-8a3a-4c745827bc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.186183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b536756-1131-4c9b-8a3a-4c745827bc03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.214739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b536756-1131-4c9b-8a3a-4c745827bc03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:18.215147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50bf62-e223-4895-807f-3cadbaad9c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.215796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50bf62-e223-4895-807f-3cadbaad9c0d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.216084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50bf62-e223-4895-807f-3cadbaad9c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.216360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50bf62-e223-4895-807f-3cadbaad9c0d None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.217021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50bf62-e223-4895-807f-3cadbaad9c0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:18.217326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50bf62-e223-4895-807f-3cadbaad9c0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.218788 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50bf62-e223-4895-807f-3cadbaad9c0d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-1b536756-1131-4c9b-8a3a-4c745827bc03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:18.220434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:18.222470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:18.224486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:18.224486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:18.224486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:18.224486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:18.224486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:18.224486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:18.224486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:18.224486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:18.224486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:18.224486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:18.224486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:18.224486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:18.228809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 303/615] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:18.231676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 313/616] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:18.233628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b536756-1131-4c9b-8a3a-4c745827bc03 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.237144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50bf62-e223-4895-807f-3cadbaad9c0d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.282067 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:18.355828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50bf62-e223-4895-807f-3cadbaad9c0d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.395794 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7196b-3d96-4520-9795-f2e71cd9acbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.396349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7196b-3d96-4520-9795-f2e71cd9acbf None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.396627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7196b-3d96-4520-9795-f2e71cd9acbf None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.397083 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7196b-3d96-4520-9795-f2e71cd9acbf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.409317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7196b-3d96-4520-9795-f2e71cd9acbf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.410786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7196b-3d96-4520-9795-f2e71cd9acbf None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7eb7196b-3d96-4520-9795-f2e71cd9acbf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:18.430343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:18.434084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:18.436416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:18.436416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:18.436416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:18.436416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:18.436416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:18.436416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:18.436416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:18.436416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:18.436416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:08:18.436416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:18.436416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 314/617] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:18.436416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7196b-3d96-4520-9795-f2e71cd9acbf None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.492074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b536756-1131-4c9b-8a3a-4c745827bc03 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.553055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea79d9-f164-444d-8c63-f2ec48ef0ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.554104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea79d9-f164-444d-8c63-f2ec48ef0ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.555557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea79d9-f164-444d-8c63-f2ec48ef0ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.556053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea79d9-f164-444d-8c63-f2ec48ef0ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.556949 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea79d9-f164-444d-8c63-f2ec48ef0ee1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:18.557619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea79d9-f164-444d-8c63-f2ec48ef0ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.560638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea79d9-f164-444d-8c63-f2ec48ef0ee1 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.578343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 304/618] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:18.584485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea79d9-f164-444d-8c63-f2ec48ef0ee1 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.629323 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:18.634528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7196b-3d96-4520-9795-f2e71cd9acbf None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.638701 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:18.707945 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe490d-d9b0-455c-9f73-9af5bfa35d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.708972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe490d-d9b0-455c-9f73-9af5bfa35d2e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.709471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe490d-d9b0-455c-9f73-9af5bfa35d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.710022 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe490d-d9b0-455c-9f73-9af5bfa35d2e None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.711049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe490d-d9b0-455c-9f73-9af5bfa35d2e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:18.711583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe490d-d9b0-455c-9f73-9af5bfa35d2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.713286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe490d-d9b0-455c-9f73-9af5bfa35d2e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.751080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 315/619] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Aug 31 00:08:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:18.751281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea79d9-f164-444d-8c63-f2ec48ef0ee1 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.753678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe490d-d9b0-455c-9f73-9af5bfa35d2e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.795998 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b8227-2368-424b-bd2f-bd096a48428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.796837 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b8227-2368-424b-bd2f-bd096a48428b None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.797445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b8227-2368-424b-bd2f-bd096a48428b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.797445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b8227-2368-424b-bd2f-bd096a48428b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.809900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b8227-2368-424b-bd2f-bd096a48428b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.811496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b8227-2368-424b-bd2f-bd096a48428b None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-880b8227-2368-424b-bd2f-bd096a48428b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:18.827475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:18.828516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:18.829442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:18.829442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:18.829442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:18.829442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 305/620] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:18.833759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df2bc7-8f7c-4b95-bbb6-af927c66aed3 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.833759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df2bc7-8f7c-4b95-bbb6-af927c66aed3 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.833759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df2bc7-8f7c-4b95-bbb6-af927c66aed3 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.833759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 306/621] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:18.835570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df2bc7-8f7c-4b95-bbb6-af927c66aed3 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.890182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe490d-d9b0-455c-9f73-9af5bfa35d2e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.941818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4711b9f-6a8a-40be-b508-182de8fb3f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.942462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4711b9f-6a8a-40be-b508-182de8fb3f98 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.942735 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4711b9f-6a8a-40be-b508-182de8fb3f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.943004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4711b9f-6a8a-40be-b508-182de8fb3f98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.954099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4711b9f-6a8a-40be-b508-182de8fb3f98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.955711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4711b9f-6a8a-40be-b508-182de8fb3f98 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.956668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:18.968869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df2bc7-8f7c-4b95-bbb6-af927c66aed3 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-d4711b9f-6a8a-40be-b508-182de8fb3f98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:18.971155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:18.972344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:18.973448 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:18.973448 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:18.973448 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:18.977372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 316/622] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:18.978656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc548d-9ca2-4a7d-bd72-371572ae135f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.978940 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc548d-9ca2-4a7d-bd72-371572ae135f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.979258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc548d-9ca2-4a7d-bd72-371572ae135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.998339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-83cc548d-9ca2-4a7d-bd72-371572ae135f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:18.999601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-83cc548d-9ca2-4a7d-bd72-371572ae135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:19.001740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:19.010612 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7ea42-d99c-47b5-96ef-28433fcaa358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:19.011438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7ea42-d99c-47b5-96ef-28433fcaa358 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:19.011912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7ea42-d99c-47b5-96ef-28433fcaa358 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:19.012326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7ea42-d99c-47b5-96ef-28433fcaa358 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:19.013116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7ea42-d99c-47b5-96ef-28433fcaa358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:19.013572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7ea42-d99c-47b5-96ef-28433fcaa358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:19.015139 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7ea42-d99c-47b5-96ef-28433fcaa358 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:19.027899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 307/623] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:19.029031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7ea42-d99c-47b5-96ef-28433fcaa358 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:19.077642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 317/624] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:19.078589 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc548d-9ca2-4a7d-bd72-371572ae135f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:19.134697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7ea42-d99c-47b5-96ef-28433fcaa358 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:19.176906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d18fa1-abfd-4ae1-97d0-ae8a92827ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:19.177780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d18fa1-abfd-4ae1-97d0-ae8a92827ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:19.178232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d18fa1-abfd-4ae1-97d0-ae8a92827ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:19.178740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d18fa1-abfd-4ae1-97d0-ae8a92827ba1 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:19.179617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d18fa1-abfd-4ae1-97d0-ae8a92827ba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:19.180111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d18fa1-abfd-4ae1-97d0-ae8a92827ba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:19.181523 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d18fa1-abfd-4ae1-97d0-ae8a92827ba1 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:19.185830 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc548d-9ca2-4a7d-bd72-371572ae135f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:19.195140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 308/625] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:19.196466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f291b9-8337-43bd-80f2-91efd7ec6b61 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:19.196812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f291b9-8337-43bd-80f2-91efd7ec6b61 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:19.197091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f291b9-8337-43bd-80f2-91efd7ec6b61 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:19.198562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 309/626] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:19.201004 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f291b9-8337-43bd-80f2-91efd7ec6b61 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:19.217378 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:19.231008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aab33a-6f91-45e8-bef0-2160bc822ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:19.231602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aab33a-6f91-45e8-bef0-2160bc822ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:19.231945 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aab33a-6f91-45e8-bef0-2160bc822ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:19.232217 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aab33a-6f91-45e8-bef0-2160bc822ad2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:19.240357 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aab33a-6f91-45e8-bef0-2160bc822ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:19.242089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aab33a-6f91-45e8-bef0-2160bc822ad2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:19.244592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-a5aab33a-6f91-45e8-bef0-2160bc822ad2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:19.256812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:19.257867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:19.258863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:19.258863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:19.258863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:19.258863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:19.258863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:19.258863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:19.258863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:19.258863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:19.258863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:19.258863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:19.261637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 318/627] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 31 00:08:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:19.267852 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3164-f943-4aca-8319-b588f99379bb None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:19.268362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3164-f943-4aca-8319-b588f99379bb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:19.268822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3164-f943-4aca-8319-b588f99379bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:19.289296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-267c3164-f943-4aca-8319-b588f99379bb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:19.290850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-267c3164-f943-4aca-8319-b588f99379bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:19.315147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f291b9-8337-43bd-80f2-91efd7ec6b61 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:19.352429 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd5a63-3267-44f3-8b0d-6d9c4e2f5ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:19.353198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd5a63-3267-44f3-8b0d-6d9c4e2f5ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:19.353874 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd5a63-3267-44f3-8b0d-6d9c4e2f5ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:19.353985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd5a63-3267-44f3-8b0d-6d9c4e2f5ce0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:19.361391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd5a63-3267-44f3-8b0d-6d9c4e2f5ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:19.363151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd5a63-3267-44f3-8b0d-6d9c4e2f5ce0 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:19.365410 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 319/628] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:19.366615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c3164-f943-4aca-8319-b588f99379bb None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-cfbd5a63-3267-44f3-8b0d-6d9c4e2f5ce0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:19.376080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:19.377037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:19.377974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:19.377974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:19.377974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:19.377974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:19.377974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:19.377974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:19.377974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:19.377974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:19.377974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 310/629] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:19.383307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd5a63-3267-44f3-8b0d-6d9c4e2f5ce0 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:19.458215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:19.476899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c3164-f943-4aca-8319-b588f99379bb None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:19.490862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd5a63-3267-44f3-8b0d-6d9c4e2f5ce0 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:19.505795 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:19.515325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126377f-25da-4299-981a-6119a7f14624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:19.516405 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126377f-25da-4299-981a-6119a7f14624 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:19.516871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126377f-25da-4299-981a-6119a7f14624 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:19.517405 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126377f-25da-4299-981a-6119a7f14624 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:19.518417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126377f-25da-4299-981a-6119a7f14624 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:19.518921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126377f-25da-4299-981a-6119a7f14624 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:19.520730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126377f-25da-4299-981a-6119a7f14624 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:19.533841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46d287-7b33-4e09-b1f2-18b1b58c4ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:19.534477 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46d287-7b33-4e09-b1f2-18b1b58c4ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:19.534758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46d287-7b33-4e09-b1f2-18b1b58c4ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:19.535031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46d287-7b33-4e09-b1f2-18b1b58c4ec1 None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:19.535771 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46d287-7b33-4e09-b1f2-18b1b58c4ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:19.536074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46d287-7b33-4e09-b1f2-18b1b58c4ec1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:19.537632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46d287-7b33-4e09-b1f2-18b1b58c4ec1 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:19.547023 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 320/630] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 31 00:08:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:19.548308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126377f-25da-4299-981a-6119a7f14624 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:19.556068 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 311/631] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:19.556976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46d287-7b33-4e09-b1f2-18b1b58c4ec1 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:19.655002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126377f-25da-4299-981a-6119a7f14624 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:19.661823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46d287-7b33-4e09-b1f2-18b1b58c4ec1 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:19.690236 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476bc4e-6092-4b18-b8b9-03272f456d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:19.690894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476bc4e-6092-4b18-b8b9-03272f456d60 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:19.691179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476bc4e-6092-4b18-b8b9-03272f456d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:19.691454 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476bc4e-6092-4b18-b8b9-03272f456d60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:19.691936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:19.697768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551ca6f-6af3-4a22-a2b6-ef793aa06531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:19.698376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551ca6f-6af3-4a22-a2b6-ef793aa06531 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:19.698650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551ca6f-6af3-4a22-a2b6-ef793aa06531 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:19.698910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551ca6f-6af3-4a22-a2b6-ef793aa06531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:19.702664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476bc4e-6092-4b18-b8b9-03272f456d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-6476bc4e-6092-4b18-b8b9-03272f456d60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:19.707419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:19.708456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:19.709355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:19.709355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:19.709355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:19.709355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:19.709355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:19.709355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:19.709355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:19.709355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:19.709355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:19.709355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:19.709355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:19.709355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:19.709355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 321/632] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:19.709355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476bc4e-6092-4b18-b8b9-03272f456d60 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:19.754496 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:19.768529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551ca6f-6af3-4a22-a2b6-ef793aa06531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:19.770005 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551ca6f-6af3-4a22-a2b6-ef793aa06531 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:19.805436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476bc4e-6092-4b18-b8b9-03272f456d60 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:19.839938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035c58f-23f2-4789-98f2-b05b50ac021b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:19.840618 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035c58f-23f2-4789-98f2-b05b50ac021b None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:19.840895 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035c58f-23f2-4789-98f2-b05b50ac021b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:19.841168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035c58f-23f2-4789-98f2-b05b50ac021b None admin] PATH_INFO: `/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/ac02a26fe2a44b7db623003d1a96ed36/roles/bf66c83a5d0f41039e44947c9fb18d3c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:19.855557 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035c58f-23f2-4789-98f2-b05b50ac021b None admin] RBAC: Authorizing `identity:create_grant(project_id=0864c2a6b50f403db79930d0869f8e23, user_id=ac02a26fe2a44b7db623003d1a96ed36, role_id=bf66c83a5d0f41039e44947c9fb18d3c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:19.857017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035c58f-23f2-4789-98f2-b05b50ac021b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:19.871475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 322/633] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:19 2022] PUT /identity/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/ac02a26fe2a44b7db623003d1a96ed36/roles/bf66c83a5d0f41039e44947c9fb18d3c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:08:19.872335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035c58f-23f2-4789-98f2-b05b50ac021b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:19.876992 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 312/634] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:08:19.878940 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e4fc3-4b41-4954-a76d-8d6c6d157f35 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:19.879278 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e4fc3-4b41-4954-a76d-8d6c6d157f35 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:19.879610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e4fc3-4b41-4954-a76d-8d6c6d157f35 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:19.881249 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 313/635] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:19.882496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e4fc3-4b41-4954-a76d-8d6c6d157f35 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:19.924042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:19.992358 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:20.001701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035c58f-23f2-4789-98f2-b05b50ac021b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:20.011296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e4fc3-4b41-4954-a76d-8d6c6d157f35 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:20.047802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f61b7-37f1-4edd-b096-06b907fbd9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:20.048475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f61b7-37f1-4edd-b096-06b907fbd9ab None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.048756 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f61b7-37f1-4edd-b096-06b907fbd9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.049027 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f61b7-37f1-4edd-b096-06b907fbd9ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.053296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745b912-93f2-4f71-b763-e7bef8812fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:20.053909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745b912-93f2-4f71-b763-e7bef8812fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.054192 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745b912-93f2-4f71-b763-e7bef8812fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.054460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745b912-93f2-4f71-b763-e7bef8812fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.055173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745b912-93f2-4f71-b763-e7bef8812fc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:20.055472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745b912-93f2-4f71-b763-e7bef8812fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:20.056984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745b912-93f2-4f71-b763-e7bef8812fc1 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:20.062367 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f61b7-37f1-4edd-b096-06b907fbd9ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:20.067797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 314/636] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:20.067797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745b912-93f2-4f71-b763-e7bef8812fc1 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-6c5f61b7-37f1-4edd-b096-06b907fbd9ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:20.067995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:20.068934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:20.069898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:20.069898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:20.069898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:20.069898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:20.069898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:20.069898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:20.069898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:20.069898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:20.069898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:20.069898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:20.069898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:20.069898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:20.069898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 323/637] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:20.070640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3e21e-650c-41eb-ba0a-233ed6465280 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.072131 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3e21e-650c-41eb-ba0a-233ed6465280 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.072131 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3e21e-650c-41eb-ba0a-233ed6465280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.091328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-44a3e21e-650c-41eb-ba0a-233ed6465280 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:20.092792 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-44a3e21e-650c-41eb-ba0a-233ed6465280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:20.172551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 324/638] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:20.173416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3e21e-650c-41eb-ba0a-233ed6465280 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:20.195905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:20.204804 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745b912-93f2-4f71-b763-e7bef8812fc1 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:20.255857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10bf45-b51b-45d8-9791-fa38caa98bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:20.256886 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10bf45-b51b-45d8-9791-fa38caa98bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.257559 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10bf45-b51b-45d8-9791-fa38caa98bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.258013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10bf45-b51b-45d8-9791-fa38caa98bf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.272375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10bf45-b51b-45d8-9791-fa38caa98bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:20.274554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10bf45-b51b-45d8-9791-fa38caa98bf4 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:20.284688 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-8c10bf45-b51b-45d8-9791-fa38caa98bf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:20.298034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:20.299318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:20.300504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:20.300504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:20.300504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:20.302925 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 315/639] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:20.303985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10bf45-b51b-45d8-9791-fa38caa98bf4 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:20.309134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3e21e-650c-41eb-ba0a-233ed6465280 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:20.345709 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7860a-c5f6-457c-a867-c20e281d66c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:20.346472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7860a-c5f6-457c-a867-c20e281d66c8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.346848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7860a-c5f6-457c-a867-c20e281d66c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.347219 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7860a-c5f6-457c-a867-c20e281d66c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.359129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7860a-c5f6-457c-a867-c20e281d66c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:20.360800 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7860a-c5f6-457c-a867-c20e281d66c8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2ed7860a-c5f6-457c-a867-c20e281d66c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:20.375479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:20.376740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:20.377891 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:20.377891 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:20.377891 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:20.383594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 325/640] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:20.383594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7860a-c5f6-457c-a867-c20e281d66c8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:20.436886 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10bf45-b51b-45d8-9791-fa38caa98bf4 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:20.475278 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd33782-5e92-4d71-a0e0-3051d226b7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:20.476029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd33782-5e92-4d71-a0e0-3051d226b7ac None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.476375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd33782-5e92-4d71-a0e0-3051d226b7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.476711 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd33782-5e92-4d71-a0e0-3051d226b7ac None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.477390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd33782-5e92-4d71-a0e0-3051d226b7ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:20.477687 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd33782-5e92-4d71-a0e0-3051d226b7ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:20.479059 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd33782-5e92-4d71-a0e0-3051d226b7ac None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:20.484176 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7860a-c5f6-457c-a867-c20e281d66c8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:20.492193 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 316/641] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:20.492945 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd33782-5e92-4d71-a0e0-3051d226b7ac None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:20.504023 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:20.521711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d20124-5cd1-43d7-973f-91724b6707af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:20.522470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d20124-5cd1-43d7-973f-91724b6707af None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.522695 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d20124-5cd1-43d7-973f-91724b6707af None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.522973 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d20124-5cd1-43d7-973f-91724b6707af None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.523648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d20124-5cd1-43d7-973f-91724b6707af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:20.523979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d20124-5cd1-43d7-973f-91724b6707af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:20.525370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d20124-5cd1-43d7-973f-91724b6707af None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:20.532628 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:20.543386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 326/642] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:20.544291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d20124-5cd1-43d7-973f-91724b6707af None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:20.601556 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd33782-5e92-4d71-a0e0-3051d226b7ac None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:20.636401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c345fcd-5fb4-4ab4-9d62-ff8e36e07005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:20.637024 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c345fcd-5fb4-4ab4-9d62-ff8e36e07005 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.637288 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c345fcd-5fb4-4ab4-9d62-ff8e36e07005 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.637559 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c345fcd-5fb4-4ab4-9d62-ff8e36e07005 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.638214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c345fcd-5fb4-4ab4-9d62-ff8e36e07005 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:20.638519 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c345fcd-5fb4-4ab4-9d62-ff8e36e07005 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:20.639969 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c345fcd-5fb4-4ab4-9d62-ff8e36e07005 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:20.652219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 317/643] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:20.654609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d20124-5cd1-43d7-973f-91724b6707af None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:20.657390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c345fcd-5fb4-4ab4-9d62-ff8e36e07005 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:20.691346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b362e3-c076-44c9-a911-ff71b9d31703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:20.692334 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b362e3-c076-44c9-a911-ff71b9d31703 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.692817 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b362e3-c076-44c9-a911-ff71b9d31703 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.693262 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b362e3-c076-44c9-a911-ff71b9d31703 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.704366 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b362e3-c076-44c9-a911-ff71b9d31703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-f3b362e3-c076-44c9-a911-ff71b9d31703 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:20.709163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:20.710161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:20.711061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:20.711061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:20.711061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:20.711061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:20.711061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:20.711061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:20.711061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:20.711061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:20.711061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:20.711061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:20.711061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:20.711061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:20.711061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 327/644] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:20.711061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b362e3-c076-44c9-a911-ff71b9d31703 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:20.730812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:20.767636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c345fcd-5fb4-4ab4-9d62-ff8e36e07005 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:20.777264 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:20.802682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abc08b-4115-420a-97b8-0364a05d868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:20.803318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc08b-4115-420a-97b8-0364a05d868f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.803597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc08b-4115-420a-97b8-0364a05d868f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.803900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc08b-4115-420a-97b8-0364a05d868f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.814799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abc08b-4115-420a-97b8-0364a05d868f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:20.816351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abc08b-4115-420a-97b8-0364a05d868f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:20.825980 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b362e3-c076-44c9-a911-ff71b9d31703 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-95abc08b-4115-420a-97b8-0364a05d868f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:20.831645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:20.832668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:20.834461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:20.834461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:20.834461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:20.836046 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 318/645] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:20.837575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abc08b-4115-420a-97b8-0364a05d868f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:20.865704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eab706-1d93-4bc1-ac91-9a6a5622ae44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:20.866594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eab706-1d93-4bc1-ac91-9a6a5622ae44 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.867044 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eab706-1d93-4bc1-ac91-9a6a5622ae44 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.867313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eab706-1d93-4bc1-ac91-9a6a5622ae44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.874301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eab706-1d93-4bc1-ac91-9a6a5622ae44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:20.875850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eab706-1d93-4bc1-ac91-9a6a5622ae44 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-f0eab706-1d93-4bc1-ac91-9a6a5622ae44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:20.887150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:20.888152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:20.889074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:20.889074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:20.889074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:20.889074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:20.889074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:20.889074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:20.889074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:20.889074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:20.889074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 328/646] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:20.889074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eab706-1d93-4bc1-ac91-9a6a5622ae44 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:20.948879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abc08b-4115-420a-97b8-0364a05d868f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:20.972094 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:20.986562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27de57-bfc0-4b9d-a02f-7103c6ae45bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:20.987199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27de57-bfc0-4b9d-a02f-7103c6ae45bd None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.987525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27de57-bfc0-4b9d-a02f-7103c6ae45bd None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.987827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27de57-bfc0-4b9d-a02f-7103c6ae45bd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.994946 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27de57-bfc0-4b9d-a02f-7103c6ae45bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:20.996481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27de57-bfc0-4b9d-a02f-7103c6ae45bd None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.003770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eab706-1d93-4bc1-ac91-9a6a5622ae44 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-be27de57-bfc0-4b9d-a02f-7103c6ae45bd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:21.008821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:21.009988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:21.011209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:21.011209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:21.011209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:21.011209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:21.011209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:21.011209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:21.011209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:21.011209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:21.011209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:08:21.011209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:21.014789 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 319/647] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:21.015558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27de57-bfc0-4b9d-a02f-7103c6ae45bd None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.025448 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:21.043948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441ec34-7c0b-4681-bcf9-353e64e48208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.044624 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ec34-7c0b-4681-bcf9-353e64e48208 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.045052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ec34-7c0b-4681-bcf9-353e64e48208 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.045454 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ec34-7c0b-4681-bcf9-353e64e48208 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.046174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441ec34-7c0b-4681-bcf9-353e64e48208 None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:21.046537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441ec34-7c0b-4681-bcf9-353e64e48208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.047996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441ec34-7c0b-4681-bcf9-353e64e48208 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.060517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 329/648] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:21.060517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441ec34-7c0b-4681-bcf9-353e64e48208 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.124611 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27de57-bfc0-4b9d-a02f-7103c6ae45bd None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.164373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b95d0-cce1-4362-94b5-19193e0d18a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.165504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b95d0-cce1-4362-94b5-19193e0d18a8 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.165604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b95d0-cce1-4362-94b5-19193e0d18a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.165826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b95d0-cce1-4362-94b5-19193e0d18a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.166472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b95d0-cce1-4362-94b5-19193e0d18a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:21.166769 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b95d0-cce1-4362-94b5-19193e0d18a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.168282 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b95d0-cce1-4362-94b5-19193e0d18a8 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.171883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441ec34-7c0b-4681-bcf9-353e64e48208 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.180918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 320/649] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:21.185991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b95d0-cce1-4362-94b5-19193e0d18a8 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.207993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db66bc0-b6ec-48ef-936c-98807e1a9520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.208781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db66bc0-b6ec-48ef-936c-98807e1a9520 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.209150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db66bc0-b6ec-48ef-936c-98807e1a9520 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.209521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db66bc0-b6ec-48ef-936c-98807e1a9520 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.210307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db66bc0-b6ec-48ef-936c-98807e1a9520 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:21.210693 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db66bc0-b6ec-48ef-936c-98807e1a9520 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.212251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db66bc0-b6ec-48ef-936c-98807e1a9520 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.230321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 330/650] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:21.230321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db66bc0-b6ec-48ef-936c-98807e1a9520 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.234043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:21.274592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:21.297351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b95d0-cce1-4362-94b5-19193e0d18a8 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.338170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b78a4c-14ce-4bc0-9a0f-248100586f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.338910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b78a4c-14ce-4bc0-9a0f-248100586f47 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.339260 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b78a4c-14ce-4bc0-9a0f-248100586f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.339674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b78a4c-14ce-4bc0-9a0f-248100586f47 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.340435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b78a4c-14ce-4bc0-9a0f-248100586f47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:21.340811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b78a4c-14ce-4bc0-9a0f-248100586f47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.342315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b78a4c-14ce-4bc0-9a0f-248100586f47 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.344795 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db66bc0-b6ec-48ef-936c-98807e1a9520 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.361444 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 321/651] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:21.366804 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b78a4c-14ce-4bc0-9a0f-248100586f47 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.381145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794911b-d7db-4cfb-8836-fbf8ba6743bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.381858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794911b-d7db-4cfb-8836-fbf8ba6743bd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.382127 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794911b-d7db-4cfb-8836-fbf8ba6743bd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.382376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794911b-d7db-4cfb-8836-fbf8ba6743bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.393433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794911b-d7db-4cfb-8836-fbf8ba6743bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.394946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794911b-d7db-4cfb-8836-fbf8ba6743bd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9794911b-d7db-4cfb-8836-fbf8ba6743bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:21.410621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:21.411849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:21.413004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:21.413004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:21.413004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:21.413004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 331/652] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:21.417261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794911b-d7db-4cfb-8836-fbf8ba6743bd None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.470374 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:21.474134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b78a4c-14ce-4bc0-9a0f-248100586f47 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.510334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5736d5-779b-4de9-b639-10d9fde9c81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.511064 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5736d5-779b-4de9-b639-10d9fde9c81c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.511412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5736d5-779b-4de9-b639-10d9fde9c81c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.511780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5736d5-779b-4de9-b639-10d9fde9c81c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.517810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:21.519714 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5736d5-779b-4de9-b639-10d9fde9c81c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.521350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5736d5-779b-4de9-b639-10d9fde9c81c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.527462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794911b-d7db-4cfb-8836-fbf8ba6743bd None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-ec5736d5-779b-4de9-b639-10d9fde9c81c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:21.533362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:21.534331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:21.535281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:21.535281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:21.535281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:21.535281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:21.535281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:21.535281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:21.535281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:21.535281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:21.535281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:08:21.535281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:21.535281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 322/653] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:21.536460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5736d5-779b-4de9-b639-10d9fde9c81c None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.569822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040f120-1fa1-4fe5-a6fd-e09c65716da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.570352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040f120-1fa1-4fe5-a6fd-e09c65716da8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.570630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040f120-1fa1-4fe5-a6fd-e09c65716da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.570900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040f120-1fa1-4fe5-a6fd-e09c65716da8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.571626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040f120-1fa1-4fe5-a6fd-e09c65716da8 None admin] RBAC: Adding query filter params (role.id=bf66c83a5d0f41039e44947c9fb18d3c, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=cb9ef38ec3b448828826de5f76a552d8) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:21.571966 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040f120-1fa1-4fe5-a6fd-e09c65716da8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.573433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040f120-1fa1-4fe5-a6fd-e09c65716da8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.579727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 332/654] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/role_assignments?user.id=cb9ef38ec3b448828826de5f76a552d8&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=bf66c83a5d0f41039e44947c9fb18d3c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:21.585145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040f120-1fa1-4fe5-a6fd-e09c65716da8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.650292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5736d5-779b-4de9-b639-10d9fde9c81c None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.689673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd056261-e689-490f-acef-9a700af2eda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.690308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd056261-e689-490f-acef-9a700af2eda5 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.690588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd056261-e689-490f-acef-9a700af2eda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.690862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd056261-e689-490f-acef-9a700af2eda5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.722754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:21.743675 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040f120-1fa1-4fe5-a6fd-e09c65716da8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.775249 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd056261-e689-490f-acef-9a700af2eda5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.777582 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd056261-e689-490f-acef-9a700af2eda5 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.790244 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4eeb1-eb3c-465b-85f8-4ec427923f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.790896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4eeb1-eb3c-465b-85f8-4ec427923f77 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.791177 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4eeb1-eb3c-465b-85f8-4ec427923f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.791455 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4eeb1-eb3c-465b-85f8-4ec427923f77 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.792193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4eeb1-eb3c-465b-85f8-4ec427923f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:21.792503 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4eeb1-eb3c-465b-85f8-4ec427923f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.793885 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4eeb1-eb3c-465b-85f8-4ec427923f77 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.806223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 333/655] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:21.807127 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4eeb1-eb3c-465b-85f8-4ec427923f77 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.831091 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:21.885822 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 323/656] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:08:21.887546 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301fe74-e78f-49ed-b633-8ac7e8885469 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.888119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301fe74-e78f-49ed-b633-8ac7e8885469 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.888586 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301fe74-e78f-49ed-b633-8ac7e8885469 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.890030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 324/657] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:21.891296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301fe74-e78f-49ed-b633-8ac7e8885469 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.925928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4eeb1-eb3c-465b-85f8-4ec427923f77 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.957315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:21.960752 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b9757-49b1-4fe4-98b0-759f80388021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.961383 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b9757-49b1-4fe4-98b0-759f80388021 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.961721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b9757-49b1-4fe4-98b0-759f80388021 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.962002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b9757-49b1-4fe4-98b0-759f80388021 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.962749 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b9757-49b1-4fe4-98b0-759f80388021 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:21.963057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b9757-49b1-4fe4-98b0-759f80388021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.964541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b9757-49b1-4fe4-98b0-759f80388021 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.983746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 334/658] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:21.984652 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b9757-49b1-4fe4-98b0-759f80388021 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:22.016488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301fe74-e78f-49ed-b633-8ac7e8885469 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:22.053466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f02bb-0c29-490f-a953-4343dcd68f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:22.054100 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f02bb-0c29-490f-a953-4343dcd68f42 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:22.054488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f02bb-0c29-490f-a953-4343dcd68f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:22.054763 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f02bb-0c29-490f-a953-4343dcd68f42 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:22.063894 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f02bb-0c29-490f-a953-4343dcd68f42 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:22.064909 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:22.065589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f02bb-0c29-490f-a953-4343dcd68f42 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-9d3f02bb-0c29-490f-a953-4343dcd68f42 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:22.077646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:22.078872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:22.080560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:22.080560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:22.080560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:22.080560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:22.080560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:22.080560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:22.080560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:22.080560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:22.080560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:08:22.080560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:22.085063 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 325/659] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:22.086240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a9a60-96ee-4926-b2e8-bf68a09cd326 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:22.086517 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a9a60-96ee-4926-b2e8-bf68a09cd326 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:22.086787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a9a60-96ee-4926-b2e8-bf68a09cd326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:22.093256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b9757-49b1-4fe4-98b0-759f80388021 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:22.104430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-d64a9a60-96ee-4926-b2e8-bf68a09cd326 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:22.105633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d64a9a60-96ee-4926-b2e8-bf68a09cd326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:22.132921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6077d0-45af-4c89-b8bd-6deb15263dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:22.133658 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6077d0-45af-4c89-b8bd-6deb15263dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:22.133937 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6077d0-45af-4c89-b8bd-6deb15263dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:22.134213 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6077d0-45af-4c89-b8bd-6deb15263dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:22.148624 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6077d0-45af-4c89-b8bd-6deb15263dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:22.150176 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6077d0-45af-4c89-b8bd-6deb15263dd7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3a6077d0-45af-4c89-b8bd-6deb15263dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:22.169021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:22.170144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:22.171246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:22.171246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:22.171246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:22.174917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 335/660] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:22.175581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6077d0-45af-4c89-b8bd-6deb15263dd7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:22.200029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 326/661] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:22.200029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a9a60-96ee-4926-b2e8-bf68a09cd326 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:22.257043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:22.307349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6077d0-45af-4c89-b8bd-6deb15263dd7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:22.321431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a9a60-96ee-4926-b2e8-bf68a09cd326 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:22.335407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:22.346422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351c4c9-4f6f-4de8-b270-50441477d693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:22.347664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c4c9-4f6f-4de8-b270-50441477d693 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:22.348120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c4c9-4f6f-4de8-b270-50441477d693 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:22.348535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c4c9-4f6f-4de8-b270-50441477d693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:22.366859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d5274-47f5-4487-b4af-b48e2d447901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:22.367499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d5274-47f5-4487-b4af-b48e2d447901 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:22.367814 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d5274-47f5-4487-b4af-b48e2d447901 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:22.368089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d5274-47f5-4487-b4af-b48e2d447901 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:22.369080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d5274-47f5-4487-b4af-b48e2d447901 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:22.369386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d5274-47f5-4487-b4af-b48e2d447901 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:22.371214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d5274-47f5-4487-b4af-b48e2d447901 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:22.394986 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 327/662] 10.222.0.50 () {56 vars in 1139 bytes} [Wed Aug 31 00:08:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:22.396256 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d5274-47f5-4487-b4af-b48e2d447901 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:22.422640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351c4c9-4f6f-4de8-b270-50441477d693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:22.424435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351c4c9-4f6f-4de8-b270-50441477d693 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:22.513568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d5274-47f5-4487-b4af-b48e2d447901 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:22.521891 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:22.533830 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 336/663] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:08:22.533830 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351c4c9-4f6f-4de8-b270-50441477d693 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:22.555413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6a9c5-f589-4aca-b8cc-4a2a849b2025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:22.556176 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6a9c5-f589-4aca-b8cc-4a2a849b2025 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:22.556518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6a9c5-f589-4aca-b8cc-4a2a849b2025 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:22.556852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6a9c5-f589-4aca-b8cc-4a2a849b2025 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:22.557553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6a9c5-f589-4aca-b8cc-4a2a849b2025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:22.557932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6a9c5-f589-4aca-b8cc-4a2a849b2025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:22.559315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6a9c5-f589-4aca-b8cc-4a2a849b2025 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:22.562245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:22.573302 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 328/664] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:22.574261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6a9c5-f589-4aca-b8cc-4a2a849b2025 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:22.640876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351c4c9-4f6f-4de8-b270-50441477d693 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:22.677895 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f42508-31db-4317-8536-882c492bb616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:22.678320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f42508-31db-4317-8536-882c492bb616 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:22.678598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f42508-31db-4317-8536-882c492bb616 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:22.678916 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f42508-31db-4317-8536-882c492bb616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:22.681030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6a9c5-f589-4aca-b8cc-4a2a849b2025 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:22.715919 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455b088-563f-4158-8d9f-7df9e84a2336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:22.716581 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b088-563f-4158-8d9f-7df9e84a2336 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:22.716864 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b088-563f-4158-8d9f-7df9e84a2336 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:22.717135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b088-563f-4158-8d9f-7df9e84a2336 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:22.727627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455b088-563f-4158-8d9f-7df9e84a2336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-f455b088-563f-4158-8d9f-7df9e84a2336 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:22.732855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:22.733839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:22.734761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:22.734761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:22.734761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:22.734761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:22.734761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:22.734761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:22.734761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:22.734761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:22.734761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:22.734761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:22.734761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:22.734761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:22.734761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 329/665] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:22.734761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455b088-563f-4158-8d9f-7df9e84a2336 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:22.753835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f42508-31db-4317-8536-882c492bb616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:22.755428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f42508-31db-4317-8536-882c492bb616 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:22.769314 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:22.783467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:22.845550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455b088-563f-4158-8d9f-7df9e84a2336 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:22.860633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 337/666] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:08:22.861489 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f42508-31db-4317-8536-882c492bb616 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:22.885515 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58a99f-a27a-4ebe-98a2-e7ef71b2d634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:22.886415 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58a99f-a27a-4ebe-98a2-e7ef71b2d634 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:22.886856 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58a99f-a27a-4ebe-98a2-e7ef71b2d634 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:22.887133 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58a99f-a27a-4ebe-98a2-e7ef71b2d634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:22.897626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58a99f-a27a-4ebe-98a2-e7ef71b2d634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:22.899015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58a99f-a27a-4ebe-98a2-e7ef71b2d634 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-8d58a99f-a27a-4ebe-98a2-e7ef71b2d634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:22.914041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:22.915048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:22.916010 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:22.916010 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:22.916010 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:22.916010 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 330/667] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:22.916254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58a99f-a27a-4ebe-98a2-e7ef71b2d634 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:22.970995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f42508-31db-4317-8536-882c492bb616 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:22.997790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:23.006276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:23.007486 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b5f89-ec03-465b-943d-73666d97f821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:23.008269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b5f89-ec03-465b-943d-73666d97f821 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.008556 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b5f89-ec03-465b-943d-73666d97f821 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.008836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b5f89-ec03-465b-943d-73666d97f821 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.015963 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b5f89-ec03-465b-943d-73666d97f821 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:23.017473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b5f89-ec03-465b-943d-73666d97f821 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7d0b5f89-ec03-465b-943d-73666d97f821 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:23.030310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:23.031574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:23.032631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:23.032631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:23.032631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:23.032631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:23.032631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:23.032631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:23.032631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:23.032631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:23.033731 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58a99f-a27a-4ebe-98a2-e7ef71b2d634 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:23.035292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 338/668] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:23.036167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b5f89-ec03-465b-943d-73666d97f821 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:23.076700 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f846c5-5e3a-4e3b-a0bf-448d44f5b5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:23.077332 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f846c5-5e3a-4e3b-a0bf-448d44f5b5fc None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.077612 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f846c5-5e3a-4e3b-a0bf-448d44f5b5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.077923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f846c5-5e3a-4e3b-a0bf-448d44f5b5fc None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.078586 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f846c5-5e3a-4e3b-a0bf-448d44f5b5fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:23.078882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f846c5-5e3a-4e3b-a0bf-448d44f5b5fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:23.080313 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f846c5-5e3a-4e3b-a0bf-448d44f5b5fc None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:23.088982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 331/669] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:23.089798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f846c5-5e3a-4e3b-a0bf-448d44f5b5fc None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:23.155442 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b5f89-ec03-465b-943d-73666d97f821 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:23.191770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026745d-de63-4fd0-bdca-becb8ec93bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:23.192677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026745d-de63-4fd0-bdca-becb8ec93bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.193120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026745d-de63-4fd0-bdca-becb8ec93bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.193391 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026745d-de63-4fd0-bdca-becb8ec93bb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.202648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f846c5-5e3a-4e3b-a0bf-448d44f5b5fc None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:23.205623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026745d-de63-4fd0-bdca-becb8ec93bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:23.206776 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026745d-de63-4fd0-bdca-becb8ec93bb4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-8026745d-de63-4fd0-bdca-becb8ec93bb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:23.221312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:23.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:23.223283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:23.223283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:23.223283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:23.223283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 339/670] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:23.223967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026745d-de63-4fd0-bdca-becb8ec93bb4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:23.242400 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c44514-7f52-474d-a535-8d2a92237f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:23.243046 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c44514-7f52-474d-a535-8d2a92237f09 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.243322 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c44514-7f52-474d-a535-8d2a92237f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.243589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c44514-7f52-474d-a535-8d2a92237f09 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.244267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c44514-7f52-474d-a535-8d2a92237f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:23.244568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c44514-7f52-474d-a535-8d2a92237f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:23.245944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c44514-7f52-474d-a535-8d2a92237f09 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:23.256990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:23.261572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 332/671] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:23.262361 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c44514-7f52-474d-a535-8d2a92237f09 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:23.277737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:23.343598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026745d-de63-4fd0-bdca-becb8ec93bb4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:23.369707 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c44514-7f52-474d-a535-8d2a92237f09 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:23.378079 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b921aa6-6ab5-4015-b8bf-2b3a2aa870ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:23.378696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b921aa6-6ab5-4015-b8bf-2b3a2aa870ab None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.378985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b921aa6-6ab5-4015-b8bf-2b3a2aa870ab None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.379256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b921aa6-6ab5-4015-b8bf-2b3a2aa870ab None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.379993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b921aa6-6ab5-4015-b8bf-2b3a2aa870ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:23.380300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b921aa6-6ab5-4015-b8bf-2b3a2aa870ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:23.381774 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b921aa6-6ab5-4015-b8bf-2b3a2aa870ab None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:23.394312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 340/672] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:23.395010 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b921aa6-6ab5-4015-b8bf-2b3a2aa870ab None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:23.409119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a4e71-8c8b-44d9-a232-82b291db101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:23.409686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a4e71-8c8b-44d9-a232-82b291db101d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.409965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a4e71-8c8b-44d9-a232-82b291db101d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.410234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a4e71-8c8b-44d9-a232-82b291db101d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.421523 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a4e71-8c8b-44d9-a232-82b291db101d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:23.422976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a4e71-8c8b-44d9-a232-82b291db101d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-5a5a4e71-8c8b-44d9-a232-82b291db101d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:23.438706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:23.440123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:23.441048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:23.441048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:23.441048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:23.441048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 333/673] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:23.441048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a4e71-8c8b-44d9-a232-82b291db101d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:23.493377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:23.504312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:23.509844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b921aa6-6ab5-4015-b8bf-2b3a2aa870ab None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:23.544284 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a4e71-8c8b-44d9-a232-82b291db101d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:23.546620 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e36808-0b1c-4321-a85f-39827efee373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:23.547247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e36808-0b1c-4321-a85f-39827efee373 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.547518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e36808-0b1c-4321-a85f-39827efee373 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.547837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e36808-0b1c-4321-a85f-39827efee373 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.548491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e36808-0b1c-4321-a85f-39827efee373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:23.548797 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e36808-0b1c-4321-a85f-39827efee373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:23.550171 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e36808-0b1c-4321-a85f-39827efee373 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:23.562775 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 341/674] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:23.563947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e36808-0b1c-4321-a85f-39827efee373 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:23.585248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea67b17-058f-47f7-a6e4-972c46f6c632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:23.585883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea67b17-058f-47f7-a6e4-972c46f6c632 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.586159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea67b17-058f-47f7-a6e4-972c46f6c632 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.586430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea67b17-058f-47f7-a6e4-972c46f6c632 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.593161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea67b17-058f-47f7-a6e4-972c46f6c632 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:23.594698 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea67b17-058f-47f7-a6e4-972c46f6c632 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-fea67b17-058f-47f7-a6e4-972c46f6c632 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:23.605885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:23.606797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:23.607762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:23.607762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:23.607762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:23.607762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:23.607762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:23.607762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:23.607762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:23.607762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:23.607762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 334/675] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:23.607762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea67b17-058f-47f7-a6e4-972c46f6c632 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:23.666642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e36808-0b1c-4321-a85f-39827efee373 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:23.700849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d12ff-66ce-48d9-b33f-9575e689af48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:23.701458 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d12ff-66ce-48d9-b33f-9575e689af48 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.701735 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d12ff-66ce-48d9-b33f-9575e689af48 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.702018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d12ff-66ce-48d9-b33f-9575e689af48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.702734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d12ff-66ce-48d9-b33f-9575e689af48 None admin] RBAC: Adding query filter params (role.id=bf66c83a5d0f41039e44947c9fb18d3c, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=f886be277ef84ec28a290380980c6f06) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:23.703138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d12ff-66ce-48d9-b33f-9575e689af48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:23.704640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d12ff-66ce-48d9-b33f-9575e689af48 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:23.705569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea67b17-058f-47f7-a6e4-972c46f6c632 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:23.710351 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 342/676] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:23 2022] GET /identity/v3/role_assignments?user.id=f886be277ef84ec28a290380980c6f06&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=bf66c83a5d0f41039e44947c9fb18d3c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:23.711138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d12ff-66ce-48d9-b33f-9575e689af48 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:23.719336 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:23.743335 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbe08d-b04c-4adf-a82d-a8f2ab5e604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:23.744269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe08d-b04c-4adf-a82d-a8f2ab5e604a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.744689 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe08d-b04c-4adf-a82d-a8f2ab5e604a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.745174 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe08d-b04c-4adf-a82d-a8f2ab5e604a None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.745986 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbe08d-b04c-4adf-a82d-a8f2ab5e604a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:23.746483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbe08d-b04c-4adf-a82d-a8f2ab5e604a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:23.748087 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbe08d-b04c-4adf-a82d-a8f2ab5e604a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:23.752212 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:23.762101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 335/677] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:23.763528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722ba13-cfba-439e-b653-8f362df68958 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.763842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722ba13-cfba-439e-b653-8f362df68958 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.764118 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722ba13-cfba-439e-b653-8f362df68958 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.765744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 336/678] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:23.768646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722ba13-cfba-439e-b653-8f362df68958 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:23.849869 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d12ff-66ce-48d9-b33f-9575e689af48 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:23.887295 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722ba13-cfba-439e-b653-8f362df68958 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:23.892426 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436137c0-c95b-4ae7-bd32-c79321ac324d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:23.893267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436137c0-c95b-4ae7-bd32-c79321ac324d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.893562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436137c0-c95b-4ae7-bd32-c79321ac324d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.893836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436137c0-c95b-4ae7-bd32-c79321ac324d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.902009 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436137c0-c95b-4ae7-bd32-c79321ac324d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:23.903499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436137c0-c95b-4ae7-bd32-c79321ac324d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-436137c0-c95b-4ae7-bd32-c79321ac324d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:23.916856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:23.917753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:23.919049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:23.919049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:23.919049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:23.919049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:23.919049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:23.919049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:23.919049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:23.919049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:23.919049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 343/679] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:23.919049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436137c0-c95b-4ae7-bd32-c79321ac324d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:23.937631 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cde49-a99b-4eb1-ae06-f4ed42d57aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:23.939071 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cde49-a99b-4eb1-ae06-f4ed42d57aaf None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.939437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cde49-a99b-4eb1-ae06-f4ed42d57aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.939836 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cde49-a99b-4eb1-ae06-f4ed42d57aaf None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.940618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cde49-a99b-4eb1-ae06-f4ed42d57aaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:23.940923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cde49-a99b-4eb1-ae06-f4ed42d57aaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:23.942397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cde49-a99b-4eb1-ae06-f4ed42d57aaf None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:23.956009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 337/680] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:23.957169 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee99b1-a2d6-4c42-8230-63bc8ad0dc6a None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.957456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee99b1-a2d6-4c42-8230-63bc8ad0dc6a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.957803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee99b1-a2d6-4c42-8230-63bc8ad0dc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.975647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-b5ee99b1-a2d6-4c42-8230-63bc8ad0dc6a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:23.976846 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b5ee99b1-a2d6-4c42-8230-63bc8ad0dc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:24.003392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:24.022550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:24.044751 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436137c0-c95b-4ae7-bd32-c79321ac324d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:24.056051 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 338/681] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:24.058123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee99b1-a2d6-4c42-8230-63bc8ad0dc6a None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.081617 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbb6d6-f67f-4b81-9c12-d7bb814b5f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:24.082427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbb6d6-f67f-4b81-9c12-d7bb814b5f7e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.082811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbb6d6-f67f-4b81-9c12-d7bb814b5f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.083189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbb6d6-f67f-4b81-9c12-d7bb814b5f7e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.091559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbb6d6-f67f-4b81-9c12-d7bb814b5f7e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:24.093192 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbb6d6-f67f-4b81-9c12-d7bb814b5f7e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-c1dbb6d6-f67f-4b81-9c12-d7bb814b5f7e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:24.105133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:24.106406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:24.107674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:24.107674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:24.107674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:24.107674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:24.107674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:24.107674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:24.107674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:24.107674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:24.107674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:08:24.107674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:24.113979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 344/682] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:24.113979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbb6d6-f67f-4b81-9c12-d7bb814b5f7e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.189072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee99b1-a2d6-4c42-8230-63bc8ad0dc6a None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:24.226869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15917f59-211f-412d-b78b-8d00ece68564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:24.227815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15917f59-211f-412d-b78b-8d00ece68564 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.228194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15917f59-211f-412d-b78b-8d00ece68564 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.228617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15917f59-211f-412d-b78b-8d00ece68564 None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.229424 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15917f59-211f-412d-b78b-8d00ece68564 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:24.229826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15917f59-211f-412d-b78b-8d00ece68564 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:24.231544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15917f59-211f-412d-b78b-8d00ece68564 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:24.243847 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbb6d6-f67f-4b81-9c12-d7bb814b5f7e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:24.250337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 339/683] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:24.251200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15917f59-211f-412d-b78b-8d00ece68564 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.280080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee670f4c-f426-427a-87a3-535281adb39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:24.281065 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee670f4c-f426-427a-87a3-535281adb39b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.281518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee670f4c-f426-427a-87a3-535281adb39b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.281949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee670f4c-f426-427a-87a3-535281adb39b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.282869 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee670f4c-f426-427a-87a3-535281adb39b None admin] RBAC: Adding query filter params (role.id=bf66c83a5d0f41039e44947c9fb18d3c, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=fbc36c937503477e8542cbef7c5f5db8) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:24.283391 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee670f4c-f426-427a-87a3-535281adb39b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:24.285064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee670f4c-f426-427a-87a3-535281adb39b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:24.291657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 345/684] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/role_assignments?user.id=fbc36c937503477e8542cbef7c5f5db8&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=bf66c83a5d0f41039e44947c9fb18d3c => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:24.292749 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee670f4c-f426-427a-87a3-535281adb39b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.308846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:24.316304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:24.412219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15917f59-211f-412d-b78b-8d00ece68564 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:24.425510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee670f4c-f426-427a-87a3-535281adb39b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:24.460440 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cbe2b-72df-46d1-a7c4-e7e4d3c391dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:24.461075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cbe2b-72df-46d1-a7c4-e7e4d3c391dc None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.461359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cbe2b-72df-46d1-a7c4-e7e4d3c391dc None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.461631 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cbe2b-72df-46d1-a7c4-e7e4d3c391dc None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.462385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cbe2b-72df-46d1-a7c4-e7e4d3c391dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:24.462695 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cbe2b-72df-46d1-a7c4-e7e4d3c391dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:24.464464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cbe2b-72df-46d1-a7c4-e7e4d3c391dc None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:24.480998 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abeda8a-134e-4353-8c50-a7e290f4347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:24.481906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeda8a-134e-4353-8c50-a7e290f4347e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.482191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeda8a-134e-4353-8c50-a7e290f4347e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.482465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeda8a-134e-4353-8c50-a7e290f4347e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.483211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abeda8a-134e-4353-8c50-a7e290f4347e None admin] RBAC: Adding query filter params (role.id=bf66c83a5d0f41039e44947c9fb18d3c, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=5bde943833bb43e78879748c49ce3332) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:24.483673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 340/685] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:24.483814 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abeda8a-134e-4353-8c50-a7e290f4347e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:24.484467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cbe2b-72df-46d1-a7c4-e7e4d3c391dc None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.485848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abeda8a-134e-4353-8c50-a7e290f4347e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:24.494392 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 346/686] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/role_assignments?user.id=5bde943833bb43e78879748c49ce3332&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=bf66c83a5d0f41039e44947c9fb18d3c => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:24.495648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abeda8a-134e-4353-8c50-a7e290f4347e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.587562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:24.597574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:24.626092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cbe2b-72df-46d1-a7c4-e7e4d3c391dc None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:24.631874 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abeda8a-134e-4353-8c50-a7e290f4347e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:24.677819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de3c65-19ba-4b68-b951-7c4a2946e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:24.678391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de3c65-19ba-4b68-b951-7c4a2946e71a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.678678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de3c65-19ba-4b68-b951-7c4a2946e71a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.678951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de3c65-19ba-4b68-b951-7c4a2946e71a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.680090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90929f81-59fb-4067-bbd7-e063fec4d399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:24.680724 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929f81-59fb-4067-bbd7-e063fec4d399 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.681052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929f81-59fb-4067-bbd7-e063fec4d399 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.681327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929f81-59fb-4067-bbd7-e063fec4d399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.699718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de3c65-19ba-4b68-b951-7c4a2946e71a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-c4de3c65-19ba-4b68-b951-7c4a2946e71a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:24.705098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:24.706072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:24.707426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:24.707426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:24.707426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:24.707426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:24.707426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:24.707426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:24.707426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:24.707426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:24.707426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:24.707426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:24.707426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:24.707426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:24.707426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 341/687] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:24.717353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de3c65-19ba-4b68-b951-7c4a2946e71a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.770248 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90929f81-59fb-4067-bbd7-e063fec4d399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:24.771753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90929f81-59fb-4067-bbd7-e063fec4d399 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:24.848112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:24.859751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de3c65-19ba-4b68-b951-7c4a2946e71a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:24.887222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 347/688] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:08:24.892443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90929f81-59fb-4067-bbd7-e063fec4d399 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.899910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b8358-77c3-4ebc-85f9-55f3f40a2ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:24.900620 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b8358-77c3-4ebc-85f9-55f3f40a2ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.900965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b8358-77c3-4ebc-85f9-55f3f40a2ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.901306 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b8358-77c3-4ebc-85f9-55f3f40a2ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.902043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b8358-77c3-4ebc-85f9-55f3f40a2ac6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:24.902412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b8358-77c3-4ebc-85f9-55f3f40a2ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:24.907720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b8358-77c3-4ebc-85f9-55f3f40a2ac6 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:24.913796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 342/689] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:24.919567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b8358-77c3-4ebc-85f9-55f3f40a2ac6 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.928808 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:25.017600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90929f81-59fb-4067-bbd7-e063fec4d399 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.076705 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aab37-2358-4255-ae8b-af8b4d244fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.077741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aab37-2358-4255-ae8b-af8b4d244fab None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.078283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aab37-2358-4255-ae8b-af8b4d244fab None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.078760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aab37-2358-4255-ae8b-af8b4d244fab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.097917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889aab37-2358-4255-ae8b-af8b4d244fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.100347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889aab37-2358-4255-ae8b-af8b4d244fab None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.114525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b8358-77c3-4ebc-85f9-55f3f40a2ac6 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-889aab37-2358-4255-ae8b-af8b4d244fab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:25.130341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:25.131430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:25.132424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:25.132424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:25.132424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:25.136288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 348/690] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:25.142169 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aab37-2358-4255-ae8b-af8b4d244fab None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:25.183270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:25.183757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede7789-f743-41a7-a01d-d8e1f9144bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.184425 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede7789-f743-41a7-a01d-d8e1f9144bcb None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.184777 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede7789-f743-41a7-a01d-d8e1f9144bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.184971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede7789-f743-41a7-a01d-d8e1f9144bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.196654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede7789-f743-41a7-a01d-d8e1f9144bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.198132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede7789-f743-41a7-a01d-d8e1f9144bcb None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-dede7789-f743-41a7-a01d-d8e1f9144bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:25.212791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:25.213875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:25.215463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:25.215463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:25.215463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:25.215463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 343/691] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:25.219950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede7789-f743-41a7-a01d-d8e1f9144bcb None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:25.274507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aab37-2358-4255-ae8b-af8b4d244fab None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.278395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:25.313917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc5d20-ade4-4b24-a182-915d059eb871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.315048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc5d20-ade4-4b24-a182-915d059eb871 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.315523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc5d20-ade4-4b24-a182-915d059eb871 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.316058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc5d20-ade4-4b24-a182-915d059eb871 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.316914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc5d20-ade4-4b24-a182-915d059eb871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:25.317432 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc5d20-ade4-4b24-a182-915d059eb871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.319038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc5d20-ade4-4b24-a182-915d059eb871 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.333425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 349/692] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:25.338788 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc5d20-ade4-4b24-a182-915d059eb871 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:25.345774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede7789-f743-41a7-a01d-d8e1f9144bcb None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.433634 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:25.441314 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e8bb0-0e00-41f8-af2e-3ee10da26ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.441941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8bb0-0e00-41f8-af2e-3ee10da26ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.442222 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8bb0-0e00-41f8-af2e-3ee10da26ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.442494 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8bb0-0e00-41f8-af2e-3ee10da26ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.443147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e8bb0-0e00-41f8-af2e-3ee10da26ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:25.443813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e8bb0-0e00-41f8-af2e-3ee10da26ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.445076 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e8bb0-0e00-41f8-af2e-3ee10da26ed0 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.456823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc5d20-ade4-4b24-a182-915d059eb871 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.478191 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 344/693] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:25.483559 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e8bb0-0e00-41f8-af2e-3ee10da26ed0 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:25.496753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1126f-156e-43f4-87ee-64b692f9343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.497726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1126f-156e-43f4-87ee-64b692f9343e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.498629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1126f-156e-43f4-87ee-64b692f9343e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.499114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1126f-156e-43f4-87ee-64b692f9343e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.507496 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1126f-156e-43f4-87ee-64b692f9343e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.509233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1126f-156e-43f4-87ee-64b692f9343e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3fe1126f-156e-43f4-87ee-64b692f9343e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:25.522356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:25.523321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:25.524338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:25.524338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:25.524338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:25.524338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:25.524338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:25.524338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:25.524338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:25.524338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:25.527066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 350/694] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:25.534856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1126f-156e-43f4-87ee-64b692f9343e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:25.654072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1126f-156e-43f4-87ee-64b692f9343e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.697384 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31b0f8-78e7-4ac2-ba00-533745572610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.698470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31b0f8-78e7-4ac2-ba00-533745572610 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.699189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31b0f8-78e7-4ac2-ba00-533745572610 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.700079 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31b0f8-78e7-4ac2-ba00-533745572610 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.700985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31b0f8-78e7-4ac2-ba00-533745572610 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:25.701505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31b0f8-78e7-4ac2-ba00-533745572610 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.703175 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31b0f8-78e7-4ac2-ba00-533745572610 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.718558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 351/695] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:25.721631 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e8bb0-0e00-41f8-af2e-3ee10da26ed0 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.724417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31b0f8-78e7-4ac2-ba00-533745572610 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:25.728605 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:25.756379 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:25.811132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a243dc-5fec-416e-9625-bdcaeaee536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.811811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a243dc-5fec-416e-9625-bdcaeaee536a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.812098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a243dc-5fec-416e-9625-bdcaeaee536a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.812393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a243dc-5fec-416e-9625-bdcaeaee536a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.828799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a243dc-5fec-416e-9625-bdcaeaee536a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.830265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a243dc-5fec-416e-9625-bdcaeaee536a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.844333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31b0f8-78e7-4ac2-ba00-533745572610 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-91a243dc-5fec-416e-9625-bdcaeaee536a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:25.852938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:25.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:25.855297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:25.855297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:25.855297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:25.855297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:25.855297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:25.855297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:25.855297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:25.855297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:25.855297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:25.855297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:25.855297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 345/696] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 31 00:08:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:25.855985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4810e26-a5f7-4adb-85c8-ef410faa2c00 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.855985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4810e26-a5f7-4adb-85c8-ef410faa2c00 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.856134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4810e26-a5f7-4adb-85c8-ef410faa2c00 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.857607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 346/697] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:25.863266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e754ff-2ae1-40ef-9010-b24606b71299 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.863548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e754ff-2ae1-40ef-9010-b24606b71299 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.863852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e754ff-2ae1-40ef-9010-b24606b71299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.881957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-06e754ff-2ae1-40ef-9010-b24606b71299 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:25.883190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-06e754ff-2ae1-40ef-9010-b24606b71299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:25.885481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7316c-44fc-4993-b103-82308783b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.886452 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7316c-44fc-4993-b103-82308783b31b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.886937 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7316c-44fc-4993-b103-82308783b31b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.887410 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7316c-44fc-4993-b103-82308783b31b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.888375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7316c-44fc-4993-b103-82308783b31b None admin] RBAC: Adding query filter params (role.id=bf66c83a5d0f41039e44947c9fb18d3c, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=ac02a26fe2a44b7db623003d1a96ed36) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:25.888889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7316c-44fc-4993-b103-82308783b31b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.890806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7316c-44fc-4993-b103-82308783b31b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.897730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 352/698] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:25 2022] GET /identity/v3/role_assignments?user.id=ac02a26fe2a44b7db623003d1a96ed36&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=bf66c83a5d0f41039e44947c9fb18d3c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:25.898859 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7316c-44fc-4993-b103-82308783b31b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:25.977993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:26.003568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 347/699] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:26.018931 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7316c-44fc-4993-b103-82308783b31b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:26.061380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967b319-7c4e-4a27-ba5b-15a701fa39f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:26.062439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967b319-7c4e-4a27-ba5b-15a701fa39f0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.062732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967b319-7c4e-4a27-ba5b-15a701fa39f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.063006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967b319-7c4e-4a27-ba5b-15a701fa39f0 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.064220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967b319-7c4e-4a27-ba5b-15a701fa39f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:26.064531 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967b319-7c4e-4a27-ba5b-15a701fa39f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:26.066025 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967b319-7c4e-4a27-ba5b-15a701fa39f0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:26.085003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 353/700] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 31 00:08:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:26.090288 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e754ff-2ae1-40ef-9010-b24606b71299 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:26.218428 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e754ff-2ae1-40ef-9010-b24606b71299 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:26.221175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:26.257602 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896ca0f-344a-4605-bf3f-d374fa9ecc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:26.258140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896ca0f-344a-4605-bf3f-d374fa9ecc93 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.258416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896ca0f-344a-4605-bf3f-d374fa9ecc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.258684 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896ca0f-344a-4605-bf3f-d374fa9ecc93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.330859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896ca0f-344a-4605-bf3f-d374fa9ecc93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:26.332487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896ca0f-344a-4605-bf3f-d374fa9ecc93 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:26.389259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967b319-7c4e-4a27-ba5b-15a701fa39f0 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:26.437258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 348/701] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:08:26.442869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896ca0f-344a-4605-bf3f-d374fa9ecc93 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:26.446066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:26.500314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967b319-7c4e-4a27-ba5b-15a701fa39f0 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:26.528651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:26.544901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767dcb5-159f-44df-b8d1-ed125e037f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:26.545551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767dcb5-159f-44df-b8d1-ed125e037f52 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.545831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767dcb5-159f-44df-b8d1-ed125e037f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.546106 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767dcb5-159f-44df-b8d1-ed125e037f52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.561430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767dcb5-159f-44df-b8d1-ed125e037f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:26.563114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767dcb5-159f-44df-b8d1-ed125e037f52 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9767dcb5-159f-44df-b8d1-ed125e037f52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:26.585995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:26.587072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:26.588065 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:26.588065 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:26.588065 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:26.588065 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 354/702] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:26.591099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896ca0f-344a-4605-bf3f-d374fa9ecc93 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:26.593971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767dcb5-159f-44df-b8d1-ed125e037f52 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:26.626677 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef23560-3652-4861-86da-c92a3a60b1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:26.627314 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef23560-3652-4861-86da-c92a3a60b1dc None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.627589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef23560-3652-4861-86da-c92a3a60b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.627880 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef23560-3652-4861-86da-c92a3a60b1dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.638543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef23560-3652-4861-86da-c92a3a60b1dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:26.640092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef23560-3652-4861-86da-c92a3a60b1dc None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-4ef23560-3652-4861-86da-c92a3a60b1dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:26.655346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:26.656534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:26.657465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:26.657465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:26.657465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:26.657465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 349/703] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:26.666576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef23560-3652-4861-86da-c92a3a60b1dc None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:26.739117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767dcb5-159f-44df-b8d1-ed125e037f52 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:26.743478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:26.779267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64041640-33f5-4583-a4f7-7097375f4792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:26.779831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64041640-33f5-4583-a4f7-7097375f4792 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.780114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64041640-33f5-4583-a4f7-7097375f4792 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.780388 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64041640-33f5-4583-a4f7-7097375f4792 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.781150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64041640-33f5-4583-a4f7-7097375f4792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:26.781551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64041640-33f5-4583-a4f7-7097375f4792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:26.783050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64041640-33f5-4583-a4f7-7097375f4792 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:26.796967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 355/704] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:26.798515 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc339572-7963-4e93-b863-3ccaea1831dd None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.798804 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc339572-7963-4e93-b863-3ccaea1831dd None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.799082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc339572-7963-4e93-b863-3ccaea1831dd None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.804616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 356/705] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:26.804616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc339572-7963-4e93-b863-3ccaea1831dd None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:26.810394 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef23560-3652-4861-86da-c92a3a60b1dc None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:26.844684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:26.854927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc0784-dfc8-4efe-92bd-2803d5c19e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:26.855549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0784-dfc8-4efe-92bd-2803d5c19e66 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.855859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0784-dfc8-4efe-92bd-2803d5c19e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.856134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0784-dfc8-4efe-92bd-2803d5c19e66 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.857196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc0784-dfc8-4efe-92bd-2803d5c19e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:26.857505 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc0784-dfc8-4efe-92bd-2803d5c19e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:26.859179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc0784-dfc8-4efe-92bd-2803d5c19e66 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:26.879839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 350/706] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:26.879839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309d7d7-a4b9-48b6-8106-360b3ce144a5 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.879839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309d7d7-a4b9-48b6-8106-360b3ce144a5 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.879839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309d7d7-a4b9-48b6-8106-360b3ce144a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.901057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-0309d7d7-a4b9-48b6-8106-360b3ce144a5 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:26.902340 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-0309d7d7-a4b9-48b6-8106-360b3ce144a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:26.927305 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc339572-7963-4e93-b863-3ccaea1831dd None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:26.965947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75a36f-f2e5-4916-b753-62928db86313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:26.966730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a36f-f2e5-4916-b753-62928db86313 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.967124 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a36f-f2e5-4916-b753-62928db86313 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.967497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a36f-f2e5-4916-b753-62928db86313 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.968285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75a36f-f2e5-4916-b753-62928db86313 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:26.969859 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75a36f-f2e5-4916-b753-62928db86313 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:26.994131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 351/707] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:26.995412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309d7d7-a4b9-48b6-8106-360b3ce144a5 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:27.001800 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 357/708] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:08:26 2022] POST /identity/v3/users => generated 254 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:27.052946 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:27.111667 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309d7d7-a4b9-48b6-8106-360b3ce144a5 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:27.151373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b25b2-b4a9-4229-85bc-b7ade723b86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:27.152385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b25b2-b4a9-4229-85bc-b7ade723b86f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.152839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b25b2-b4a9-4229-85bc-b7ade723b86f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.153356 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b25b2-b4a9-4229-85bc-b7ade723b86f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.161633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b25b2-b4a9-4229-85bc-b7ade723b86f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:27.166000 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b25b2-b4a9-4229-85bc-b7ade723b86f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-df8b25b2-b4a9-4229-85bc-b7ade723b86f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:27.179244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:27.180286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:27.181227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:27.181227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:27.181227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:27.181227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:27.181227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:27.181227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:27.181227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:27.181227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:27.183496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 352/709] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:27.192913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75a36f-f2e5-4916-b753-62928db86313 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:27.217718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaecbf-a05a-4660-ab75-129be6a45d44 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.218296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaecbf-a05a-4660-ab75-129be6a45d44 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.218721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaecbf-a05a-4660-ab75-129be6a45d44 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.221240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 353/710] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:27.229496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92a282-e6bb-4edf-8a37-27c3c02e78b0 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.230042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92a282-e6bb-4edf-8a37-27c3c02e78b0 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.230466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92a282-e6bb-4edf-8a37-27c3c02e78b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.253791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-2d92a282-e6bb-4edf-8a37-27c3c02e78b0 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:27.255766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2d92a282-e6bb-4edf-8a37-27c3c02e78b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:27.329077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:27.338837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75a36f-f2e5-4916-b753-62928db86313 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:27.343273 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 354/711] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:08:27.344501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92a282-e6bb-4edf-8a37-27c3c02e78b0 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:27.380428 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:27.384981 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a301694-514e-4e63-8171-399142c56d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:27.385889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a301694-514e-4e63-8171-399142c56d45 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.387124 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a301694-514e-4e63-8171-399142c56d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.387603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a301694-514e-4e63-8171-399142c56d45 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.388720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a301694-514e-4e63-8171-399142c56d45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:27.389235 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a301694-514e-4e63-8171-399142c56d45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:27.391947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a301694-514e-4e63-8171-399142c56d45 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:27.406739 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 358/712] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:27.413167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a301694-514e-4e63-8171-399142c56d45 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:27.457708 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92a282-e6bb-4edf-8a37-27c3c02e78b0 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:27.498488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e6a76-dd33-40b2-ae55-a6c0175ae5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:27.499129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6a76-dd33-40b2-ae55-a6c0175ae5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.499401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6a76-dd33-40b2-ae55-a6c0175ae5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.499666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6a76-dd33-40b2-ae55-a6c0175ae5f7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.500370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e6a76-dd33-40b2-ae55-a6c0175ae5f7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:27.501867 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e6a76-dd33-40b2-ae55-a6c0175ae5f7 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-680e6a76-dd33-40b2-ae55-a6c0175ae5f7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:27.513470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:27.514702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:27.515607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 355/713] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Aug 31 00:08:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:27.523481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e6a76-dd33-40b2-ae55-a6c0175ae5f7 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:27.568849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a301694-514e-4e63-8171-399142c56d45 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:27.655746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:27.659930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e6a76-dd33-40b2-ae55-a6c0175ae5f7 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:27.674769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c0dea-191d-4e30-8263-fa4d510fd4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:27.675648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c0dea-191d-4e30-8263-fa4d510fd4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.675975 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c0dea-191d-4e30-8263-fa4d510fd4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.676250 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c0dea-191d-4e30-8263-fa4d510fd4e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.677508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c0dea-191d-4e30-8263-fa4d510fd4e4 None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=cb9ef38ec3b448828826de5f76a552d8) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:27.677825 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c0dea-191d-4e30-8263-fa4d510fd4e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:27.679558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c0dea-191d-4e30-8263-fa4d510fd4e4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:27.691729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 359/714] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:27 2022] GET /identity/v3/role_assignments?user.id=cb9ef38ec3b448828826de5f76a552d8&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:27.691729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c0dea-191d-4e30-8263-fa4d510fd4e4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:27.720511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8fc94-3e05-4b79-887f-fbfa05847671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:27.721225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8fc94-3e05-4b79-887f-fbfa05847671 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.721502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8fc94-3e05-4b79-887f-fbfa05847671 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.721808 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8fc94-3e05-4b79-887f-fbfa05847671 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.722463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8fc94-3e05-4b79-887f-fbfa05847671 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:27.722763 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8fc94-3e05-4b79-887f-fbfa05847671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:27.725308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8fc94-3e05-4b79-887f-fbfa05847671 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:27.728725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:27.740085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 356/715] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Aug 31 00:08:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:27.745585 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8fc94-3e05-4b79-887f-fbfa05847671 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:27.828959 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c0dea-191d-4e30-8263-fa4d510fd4e4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:27.870115 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7d50b-b5f4-423c-aae2-a96c64fa5685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:27.870115 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d50b-b5f4-423c-aae2-a96c64fa5685 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.870115 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d50b-b5f4-423c-aae2-a96c64fa5685 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.870115 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d50b-b5f4-423c-aae2-a96c64fa5685 None admin] PATH_INFO: `/v3/services/network` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.870630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7d50b-b5f4-423c-aae2-a96c64fa5685 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:27.870630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7d50b-b5f4-423c-aae2-a96c64fa5685 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-27f7d50b-b5f4-423c-aae2-a96c64fa5685 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:27.882597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:27.884006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:27.885118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:27.885118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:27.885118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:27.885118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:27.885118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:27.885118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:27.885118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:27.885118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:27.885118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:27.885118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:27.885118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:27.885118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:27.885118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:08:27.885118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:27.891829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 360/716] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:27 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:27.893270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7d50b-b5f4-423c-aae2-a96c64fa5685 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:27.955960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8fc94-3e05-4b79-887f-fbfa05847671 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:27.984858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:28.006949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7d50b-b5f4-423c-aae2-a96c64fa5685 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:28.010736 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ec1ea-1a51-4fd4-8b21-f937d287c545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:28.011590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ec1ea-1a51-4fd4-8b21-f937d287c545 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:28.012060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ec1ea-1a51-4fd4-8b21-f937d287c545 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:28.012476 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ec1ea-1a51-4fd4-8b21-f937d287c545 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:28.013287 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ec1ea-1a51-4fd4-8b21-f937d287c545 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:28.014778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ec1ea-1a51-4fd4-8b21-f937d287c545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:28.016600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ec1ea-1a51-4fd4-8b21-f937d287c545 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:28.023454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 357/717] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Aug 31 00:08:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:28.045559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e409c-1b5a-444e-a207-883926c3fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:28.046368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e409c-1b5a-444e-a207-883926c3fc62 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:28.046753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e409c-1b5a-444e-a207-883926c3fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:28.047161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e409c-1b5a-444e-a207-883926c3fc62 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:28.047950 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e409c-1b5a-444e-a207-883926c3fc62 None admin] RBAC: Adding query filter params (name=network) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:28.048355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e409c-1b5a-444e-a207-883926c3fc62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:28.049909 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e409c-1b5a-444e-a207-883926c3fc62 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:28.059843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 361/718] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:28.061997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ec1ea-1a51-4fd4-8b21-f937d287c545 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:28.096431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:28.190336 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ec1ea-1a51-4fd4-8b21-f937d287c545 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:28.229031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602207ce-dff8-4c5c-a059-973dc0112c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:28.229787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602207ce-dff8-4c5c-a059-973dc0112c73 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:28.230228 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602207ce-dff8-4c5c-a059-973dc0112c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:28.230498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602207ce-dff8-4c5c-a059-973dc0112c73 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:28.231135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602207ce-dff8-4c5c-a059-973dc0112c73 None admin] RBAC: Adding query filter params (type=network) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:28.231434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602207ce-dff8-4c5c-a059-973dc0112c73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:28.232874 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602207ce-dff8-4c5c-a059-973dc0112c73 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:28.242695 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 358/719] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:28.531266 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965348e5-7af3-4c36-bc99-fd729a12f76d None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:28.531657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965348e5-7af3-4c36-bc99-fd729a12f76d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:28.531808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965348e5-7af3-4c36-bc99-fd729a12f76d None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:28.533266 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 362/720] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:28.541876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18202e-3480-4378-b7a6-3c95236f9e4f None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:28.541876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18202e-3480-4378-b7a6-3c95236f9e4f None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:28.541876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18202e-3480-4378-b7a6-3c95236f9e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:28.558143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-ff18202e-3480-4378-b7a6-3c95236f9e4f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:28.559672 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ff18202e-3480-4378-b7a6-3c95236f9e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:28.633107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 359/721] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:29.022343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965348e5-7af3-4c36-bc99-fd729a12f76d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:29.175192 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965348e5-7af3-4c36-bc99-fd729a12f76d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:29.215492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5edc01-db8d-4595-9854-05c116f4155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:29.216383 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5edc01-db8d-4595-9854-05c116f4155d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.216871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5edc01-db8d-4595-9854-05c116f4155d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.217335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5edc01-db8d-4595-9854-05c116f4155d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.230526 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5edc01-db8d-4595-9854-05c116f4155d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2a5edc01-db8d-4595-9854-05c116f4155d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:29.236075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:29.237007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:29.238013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:29.238013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:29.238013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:29.238013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:29.238013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:29.238013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:29.238013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:29.238013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:29.238013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:29.238013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:29.238013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:29.238013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:29.238013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 363/722] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:29.245275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18202e-3480-4378-b7a6-3c95236f9e4f None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:29.282847 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:29.372235 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18202e-3480-4378-b7a6-3c95236f9e4f None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:29.408333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d542678-e3bd-4697-8385-593c7df57d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:29.408333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542678-e3bd-4697-8385-593c7df57d33 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.409003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542678-e3bd-4697-8385-593c7df57d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.409003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542678-e3bd-4697-8385-593c7df57d33 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.409573 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d542678-e3bd-4697-8385-593c7df57d33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:29.415678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d542678-e3bd-4697-8385-593c7df57d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:29.415678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d542678-e3bd-4697-8385-593c7df57d33 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:29.420578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 360/723] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:29.426243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5edc01-db8d-4595-9854-05c116f4155d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:29.433759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:29.555222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5edc01-db8d-4595-9854-05c116f4155d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:29.592542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0d287-fa67-48ea-a3a6-4424abb181a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:29.593174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0d287-fa67-48ea-a3a6-4424abb181a8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.593453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0d287-fa67-48ea-a3a6-4424abb181a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.593725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0d287-fa67-48ea-a3a6-4424abb181a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.604785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0d287-fa67-48ea-a3a6-4424abb181a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:29.606251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0d287-fa67-48ea-a3a6-4424abb181a8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-1fd0d287-fa67-48ea-a3a6-4424abb181a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:29.621947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:29.624339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:29.626534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:29.626534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:29.626534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:29.626534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 364/724] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:29.632961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d542678-e3bd-4697-8385-593c7df57d33 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:29.716436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc76c13-a6e5-4c60-bacc-4a9a063be8c0 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.716798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc76c13-a6e5-4c60-bacc-4a9a063be8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.716999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc76c13-a6e5-4c60-bacc-4a9a063be8c0 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.718866 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 365/725] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:29.724147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c678b9f-2358-4784-a51f-de43ef4b4da7 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.724435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c678b9f-2358-4784-a51f-de43ef4b4da7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.724716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c678b9f-2358-4784-a51f-de43ef4b4da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.744104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:29.754217 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d542678-e3bd-4697-8385-593c7df57d33 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:29.754550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4c678b9f-2358-4784-a51f-de43ef4b4da7 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:29.755771 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4c678b9f-2358-4784-a51f-de43ef4b4da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:29.789239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b936ed-8ee6-48c2-84f5-8a69571e37d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:29.789856 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b936ed-8ee6-48c2-84f5-8a69571e37d5 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.790136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b936ed-8ee6-48c2-84f5-8a69571e37d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.790406 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b936ed-8ee6-48c2-84f5-8a69571e37d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.791055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b936ed-8ee6-48c2-84f5-8a69571e37d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:29.791357 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b936ed-8ee6-48c2-84f5-8a69571e37d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:29.792785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b936ed-8ee6-48c2-84f5-8a69571e37d5 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:29.805592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 361/726] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:29.810954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b936ed-8ee6-48c2-84f5-8a69571e37d5 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:29.858084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:29.896582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 366/727] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:29.955139 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b936ed-8ee6-48c2-84f5-8a69571e37d5 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:29.989646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb506b0-9330-4cd7-adb6-6e1b1195ae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:29.990279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb506b0-9330-4cd7-adb6-6e1b1195ae66 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.990561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb506b0-9330-4cd7-adb6-6e1b1195ae66 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.990835 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb506b0-9330-4cd7-adb6-6e1b1195ae66 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.998145 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb506b0-9330-4cd7-adb6-6e1b1195ae66 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:29.999641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb506b0-9330-4cd7-adb6-6e1b1195ae66 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-efb506b0-9330-4cd7-adb6-6e1b1195ae66 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:30.012180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:30.014384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:30.017116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:30.017116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:30.017116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:30.017116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:30.017116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:30.017116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:30.017116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:30.017116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:30.017116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:08:30.017116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:30.017116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 362/728] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:30.026066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c678b9f-2358-4784-a51f-de43ef4b4da7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.079392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6568a29-71d3-48e6-8a02-adb866ac1b61 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.079758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6568a29-71d3-48e6-8a02-adb866ac1b61 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.079929 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6568a29-71d3-48e6-8a02-adb866ac1b61 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.081246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 363/729] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:30.089488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3889bca-2c4a-4613-a508-ec8fc61f0c02 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.089764 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3889bca-2c4a-4613-a508-ec8fc61f0c02 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.090033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3889bca-2c4a-4613-a508-ec8fc61f0c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.104181 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:30.115541 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-c3889bca-2c4a-4613-a508-ec8fc61f0c02 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:30.116989 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c3889bca-2c4a-4613-a508-ec8fc61f0c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:30.211224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c678b9f-2358-4784-a51f-de43ef4b4da7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.254674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 364/730] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:08:30.255672 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3889bca-2c4a-4613-a508-ec8fc61f0c02 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.260797 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4776f-227a-4252-b377-45077528e422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.261417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4776f-227a-4252-b377-45077528e422 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.261691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4776f-227a-4252-b377-45077528e422 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.261961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4776f-227a-4252-b377-45077528e422 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.262709 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4776f-227a-4252-b377-45077528e422 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:30.263021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4776f-227a-4252-b377-45077528e422 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:30.264476 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4776f-227a-4252-b377-45077528e422 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:30.307090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 367/731] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Aug 31 00:08:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:30.311159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4776f-227a-4252-b377-45077528e422 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.402978 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:30.441125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3889bca-2c4a-4613-a508-ec8fc61f0c02 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.499811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4776f-227a-4252-b377-45077528e422 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.516554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760a2f7-d66a-48cc-84a3-d5137c7a12d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.517219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760a2f7-d66a-48cc-84a3-d5137c7a12d7 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.517495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760a2f7-d66a-48cc-84a3-d5137c7a12d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.517765 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760a2f7-d66a-48cc-84a3-d5137c7a12d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.539722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760a2f7-d66a-48cc-84a3-d5137c7a12d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-8760a2f7-d66a-48cc-84a3-d5137c7a12d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:30.540890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:30.541844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:30.543037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:30.543037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:30.543037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:30.543037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:30.543037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:30.543037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:30.543037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:30.543037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:30.543037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:30.543037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:30.543037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:30.543037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:30.543037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 365/732] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:30.544005 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:30.547743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ddba4-8345-43bc-b048-34401a6d70d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.547987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760a2f7-d66a-48cc-84a3-d5137c7a12d7 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.548930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ddba4-8345-43bc-b048-34401a6d70d5 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.550134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ddba4-8345-43bc-b048-34401a6d70d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.550611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ddba4-8345-43bc-b048-34401a6d70d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.635134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ddba4-8345-43bc-b048-34401a6d70d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:30.637265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ddba4-8345-43bc-b048-34401a6d70d5 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:30.686374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:30.692595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760a2f7-d66a-48cc-84a3-d5137c7a12d7 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.731420 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a821a0b-1991-48f5-8517-ad62d9a66414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.732498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a821a0b-1991-48f5-8517-ad62d9a66414 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.733076 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a821a0b-1991-48f5-8517-ad62d9a66414 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.733579 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a821a0b-1991-48f5-8517-ad62d9a66414 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.734504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a821a0b-1991-48f5-8517-ad62d9a66414 None admin] RBAC: Adding query filter params (name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:30.735079 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a821a0b-1991-48f5-8517-ad62d9a66414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:30.736946 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a821a0b-1991-48f5-8517-ad62d9a66414 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:30.747802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 368/733] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:08:30.747802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ddba4-8345-43bc-b048-34401a6d70d5 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.751028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 366/734] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:30.755798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee61f1-a102-44c3-9b65-076e3cd368da None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.755798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee61f1-a102-44c3-9b65-076e3cd368da None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.755798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee61f1-a102-44c3-9b65-076e3cd368da None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.758396 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 367/735] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:30.759170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee61f1-a102-44c3-9b65-076e3cd368da None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.822410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:30.845369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ddba4-8345-43bc-b048-34401a6d70d5 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.867178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee61f1-a102-44c3-9b65-076e3cd368da None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.878068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61522c-3d01-4568-bdc1-997e0aefd154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.878811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61522c-3d01-4568-bdc1-997e0aefd154 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.879092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61522c-3d01-4568-bdc1-997e0aefd154 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.879372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61522c-3d01-4568-bdc1-997e0aefd154 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.889398 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61522c-3d01-4568-bdc1-997e0aefd154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-0d61522c-3d01-4568-bdc1-997e0aefd154 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:30.894704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:30.895661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:30.896926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:30.896926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:30.896926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:30.896926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:30.896926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:30.896926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:30.896926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:30.896926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:30.896926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:30.896926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:30.896926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:30.896926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:30.896926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 369/736] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:30.896926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61522c-3d01-4568-bdc1-997e0aefd154 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.900903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:30.902827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb994f43-97b1-46f6-b021-191be6666c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.903563 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb994f43-97b1-46f6-b021-191be6666c20 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.903909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb994f43-97b1-46f6-b021-191be6666c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.904206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb994f43-97b1-46f6-b021-191be6666c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.914629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb994f43-97b1-46f6-b021-191be6666c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:30.916124 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb994f43-97b1-46f6-b021-191be6666c20 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-fb994f43-97b1-46f6-b021-191be6666c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:30.931043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:30.932088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:30.933062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:30.933062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:30.933062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:30.933062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 368/737] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:30.933668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430b732-abb0-48fd-be0b-cbaad35cc836 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.933936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430b732-abb0-48fd-be0b-cbaad35cc836 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.934244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430b732-abb0-48fd-be0b-cbaad35cc836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.953085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-3430b732-abb0-48fd-be0b-cbaad35cc836 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:30.954239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3430b732-abb0-48fd-be0b-cbaad35cc836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:30.999510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61522c-3d01-4568-bdc1-997e0aefd154 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:31.020410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 369/738] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:31.021852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bafd25-ba5a-4a28-b0ef-4060bf23bae8 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:31.022137 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bafd25-ba5a-4a28-b0ef-4060bf23bae8 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:31.022409 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bafd25-ba5a-4a28-b0ef-4060bf23bae8 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:31.023648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 370/739] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:31.024428 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bafd25-ba5a-4a28-b0ef-4060bf23bae8 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:31.043230 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c8172-73e4-40fd-af9d-1f88e00d546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:31.044200 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c8172-73e4-40fd-af9d-1f88e00d546c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:31.044200 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c8172-73e4-40fd-af9d-1f88e00d546c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:31.044482 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c8172-73e4-40fd-af9d-1f88e00d546c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:31.055158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c8172-73e4-40fd-af9d-1f88e00d546c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:31.056662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c8172-73e4-40fd-af9d-1f88e00d546c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:31.071227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-162c8172-73e4-40fd-af9d-1f88e00d546c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:31.072080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:31.073062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:31.074033 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:31.074033 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:31.074033 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:31.074033 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 370/740] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:31.074314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c8172-73e4-40fd-af9d-1f88e00d546c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:31.130251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:31.148157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bafd25-ba5a-4a28-b0ef-4060bf23bae8 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:31.184219 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c8172-73e4-40fd-af9d-1f88e00d546c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:31.187095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d742064-c38d-4772-9472-5c50f407d51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:31.187095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d742064-c38d-4772-9472-5c50f407d51f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:31.187416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d742064-c38d-4772-9472-5c50f407d51f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:31.187619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d742064-c38d-4772-9472-5c50f407d51f None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:31.188388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d742064-c38d-4772-9472-5c50f407d51f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:31.188825 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d742064-c38d-4772-9472-5c50f407d51f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:31.190553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d742064-c38d-4772-9472-5c50f407d51f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:31.203934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 371/741] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:31.203934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1f0a9-231f-40e7-8dd0-a03375bf656d None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:31.203934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1f0a9-231f-40e7-8dd0-a03375bf656d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:31.203934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1f0a9-231f-40e7-8dd0-a03375bf656d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:31.219297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-46f1f0a9-231f-40e7-8dd0-a03375bf656d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:31.220537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-46f1f0a9-231f-40e7-8dd0-a03375bf656d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:31.230680 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dfa9e-1ca2-4fb0-97dc-340c1aee7d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:31.231477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dfa9e-1ca2-4fb0-97dc-340c1aee7d7e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:31.231884 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dfa9e-1ca2-4fb0-97dc-340c1aee7d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:31.232169 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dfa9e-1ca2-4fb0-97dc-340c1aee7d7e None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:31.232881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2dfa9e-1ca2-4fb0-97dc-340c1aee7d7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:31.233178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2dfa9e-1ca2-4fb0-97dc-340c1aee7d7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:31.234546 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2dfa9e-1ca2-4fb0-97dc-340c1aee7d7e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:31.246882 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 371/742] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:31.247889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dfa9e-1ca2-4fb0-97dc-340c1aee7d7e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:31.296511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 372/743] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:08:31.297669 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1f0a9-231f-40e7-8dd0-a03375bf656d None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:31.329882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:31.357074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dfa9e-1ca2-4fb0-97dc-340c1aee7d7e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:31.374657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:31.393929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b410a-9960-49e4-904d-7696208029ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:31.394547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b410a-9960-49e4-904d-7696208029ec None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:31.394823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b410a-9960-49e4-904d-7696208029ec None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:31.395093 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b410a-9960-49e4-904d-7696208029ec None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:31.395768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b410a-9960-49e4-904d-7696208029ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:31.396068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b410a-9960-49e4-904d-7696208029ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:31.397464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b410a-9960-49e4-904d-7696208029ec None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:31.405951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1f0a9-231f-40e7-8dd0-a03375bf656d None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:31.409320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 372/744] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:31.410372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b410a-9960-49e4-904d-7696208029ec None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:31.443319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778bf92-1373-4434-9258-f101d3878ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:31.443984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778bf92-1373-4434-9258-f101d3878ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:31.444343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778bf92-1373-4434-9258-f101d3878ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:31.444692 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778bf92-1373-4434-9258-f101d3878ff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:31.455540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778bf92-1373-4434-9258-f101d3878ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:31.457220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778bf92-1373-4434-9258-f101d3878ff7 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-4778bf92-1373-4434-9258-f101d3878ff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:31.472533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:31.473549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:31.474469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:31.474469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:31.474469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:31.478490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 373/745] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:31.479188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778bf92-1373-4434-9258-f101d3878ff7 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:31.513031 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b410a-9960-49e4-904d-7696208029ec None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:31.547352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a21ad0-8bbf-4889-b727-e70e965afcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:31.548181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a21ad0-8bbf-4889-b727-e70e965afcc4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:31.548459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a21ad0-8bbf-4889-b727-e70e965afcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:31.548721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a21ad0-8bbf-4889-b727-e70e965afcc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:31.555601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a21ad0-8bbf-4889-b727-e70e965afcc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:31.557385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a21ad0-8bbf-4889-b727-e70e965afcc4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:31.564091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-28a21ad0-8bbf-4889-b727-e70e965afcc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:31.568746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:31.569691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:31.570904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:31.570904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:31.570904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:31.570904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:31.570904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:31.570904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:31.570904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:31.570904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:31.570904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 373/746] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:31.570904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a21ad0-8bbf-4889-b727-e70e965afcc4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:31.584714 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778bf92-1373-4434-9258-f101d3878ff7 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:31.605297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:31.618213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69635ca6-4101-42f1-9a55-1d8d27345378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:31.618819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69635ca6-4101-42f1-9a55-1d8d27345378 None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:31.619101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69635ca6-4101-42f1-9a55-1d8d27345378 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:31.619369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69635ca6-4101-42f1-9a55-1d8d27345378 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:31.620061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69635ca6-4101-42f1-9a55-1d8d27345378 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:31.621416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69635ca6-4101-42f1-9a55-1d8d27345378 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:31.638543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 374/747] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 31 00:08:31 2022] POST /identity/v3/services => generated 240 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:31.638543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69635ca6-4101-42f1-9a55-1d8d27345378 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:31.675238 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a21ad0-8bbf-4889-b727-e70e965afcc4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:31.728285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da883a-8bb4-45b7-a442-bee9d3000274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:31.728854 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da883a-8bb4-45b7-a442-bee9d3000274 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:31.729133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da883a-8bb4-45b7-a442-bee9d3000274 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:31.729407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da883a-8bb4-45b7-a442-bee9d3000274 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:31.739026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da883a-8bb4-45b7-a442-bee9d3000274 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:31.740576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da883a-8bb4-45b7-a442-bee9d3000274 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-c0da883a-8bb4-45b7-a442-bee9d3000274 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:31.753977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:31.755039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:31.756058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:31.756058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:31.756058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:31.756058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:31.756058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:31.756058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:31.756058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:31.756058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:31.756058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:31.756058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:31.756058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 374/748] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 31 00:08:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:31.756058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da883a-8bb4-45b7-a442-bee9d3000274 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:31.758015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69635ca6-4101-42f1-9a55-1d8d27345378 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:31.799938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a5643-c8bc-4be3-b036-e512b8d269f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:31.800575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a5643-c8bc-4be3-b036-e512b8d269f4 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:31.800850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a5643-c8bc-4be3-b036-e512b8d269f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:31.801115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a5643-c8bc-4be3-b036-e512b8d269f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:31.801767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a5643-c8bc-4be3-b036-e512b8d269f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:31.802061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a5643-c8bc-4be3-b036-e512b8d269f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:31.803442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a5643-c8bc-4be3-b036-e512b8d269f4 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:31.818567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 375/749] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:31.819810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a5643-c8bc-4be3-b036-e512b8d269f4 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:31.822901 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:31.863159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:31.873584 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da883a-8bb4-45b7-a442-bee9d3000274 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:31.911339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b21f10-16cc-4871-8bd3-a0b9219da82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:31.912015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b21f10-16cc-4871-8bd3-a0b9219da82c None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:31.912303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b21f10-16cc-4871-8bd3-a0b9219da82c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:31.912583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b21f10-16cc-4871-8bd3-a0b9219da82c None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:31.913246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b21f10-16cc-4871-8bd3-a0b9219da82c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:31.914640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b21f10-16cc-4871-8bd3-a0b9219da82c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:31.932399 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 375/750] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 31 00:08:31 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:31.933401 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b21f10-16cc-4871-8bd3-a0b9219da82c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:31.933828 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a5643-c8bc-4be3-b036-e512b8d269f4 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:31.989977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d1733-8483-4585-8d48-68ea2f8f4b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:31.990661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d1733-8483-4585-8d48-68ea2f8f4b54 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:31.991038 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d1733-8483-4585-8d48-68ea2f8f4b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:31.991401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d1733-8483-4585-8d48-68ea2f8f4b54 None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:31.992427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d1733-8483-4585-8d48-68ea2f8f4b54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:31.992857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d1733-8483-4585-8d48-68ea2f8f4b54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:31.996077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d1733-8483-4585-8d48-68ea2f8f4b54 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:32.016339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 376/751] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:32.017608 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d1733-8483-4585-8d48-68ea2f8f4b54 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:32.076909 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b21f10-16cc-4871-8bd3-a0b9219da82c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:32.105742 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:32.122800 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ffbec-0e40-4a6e-8c54-fd75c20028ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:32.123460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ffbec-0e40-4a6e-8c54-fd75c20028ab None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:32.123793 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ffbec-0e40-4a6e-8c54-fd75c20028ab None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:32.124066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ffbec-0e40-4a6e-8c54-fd75c20028ab None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:32.124810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ffbec-0e40-4a6e-8c54-fd75c20028ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:32.125123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ffbec-0e40-4a6e-8c54-fd75c20028ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:32.126600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ffbec-0e40-4a6e-8c54-fd75c20028ab None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:32.146665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 376/752] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Aug 31 00:08:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:32.146863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ffbec-0e40-4a6e-8c54-fd75c20028ab None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:32.167259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:32.169633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d1733-8483-4585-8d48-68ea2f8f4b54 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:32.206080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c786ed4-2e6a-4476-9fc3-1e8bdb9584f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:32.206794 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c786ed4-2e6a-4476-9fc3-1e8bdb9584f3 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:32.207077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c786ed4-2e6a-4476-9fc3-1e8bdb9584f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:32.207353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c786ed4-2e6a-4476-9fc3-1e8bdb9584f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:32.215504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c786ed4-2e6a-4476-9fc3-1e8bdb9584f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:32.217219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c786ed4-2e6a-4476-9fc3-1e8bdb9584f3 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-3c786ed4-2e6a-4476-9fc3-1e8bdb9584f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:32.230266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:32.231438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:32.232462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:32.232462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:32.232462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:32.232462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:32.232462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:32.232462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:32.232462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:32.232462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:32.232462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:32.232462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:32.236289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 377/753] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 31 00:08:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:32.237182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c786ed4-2e6a-4476-9fc3-1e8bdb9584f3 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:32.291985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ffbec-0e40-4a6e-8c54-fd75c20028ab None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:32.341184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8a928-b983-4141-948d-591f5b129613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:32.342195 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8a928-b983-4141-948d-591f5b129613 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:32.342677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8a928-b983-4141-948d-591f5b129613 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:32.343175 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8a928-b983-4141-948d-591f5b129613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:32.344637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8a928-b983-4141-948d-591f5b129613 None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=ac02a26fe2a44b7db623003d1a96ed36) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:32.345311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8a928-b983-4141-948d-591f5b129613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:32.347158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8a928-b983-4141-948d-591f5b129613 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:32.356110 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 377/754] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:32 2022] GET /identity/v3/role_assignments?user.id=ac02a26fe2a44b7db623003d1a96ed36&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:32.357181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8a928-b983-4141-948d-591f5b129613 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:32.358042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c786ed4-2e6a-4476-9fc3-1e8bdb9584f3 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:32.382138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:32.409640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb02390-d5dd-49f3-9c8e-0df166b0cf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:32.411225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb02390-d5dd-49f3-9c8e-0df166b0cf95 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:32.411225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb02390-d5dd-49f3-9c8e-0df166b0cf95 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:32.411225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb02390-d5dd-49f3-9c8e-0df166b0cf95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:32.525889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb02390-d5dd-49f3-9c8e-0df166b0cf95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:32.526158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:32.526670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb02390-d5dd-49f3-9c8e-0df166b0cf95 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:32.591761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8a928-b983-4141-948d-591f5b129613 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:32.646743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 378/755] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:32.652858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb02390-d5dd-49f3-9c8e-0df166b0cf95 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:32.672089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:32.688520 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75234c7-af44-4443-92f7-d16297668057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:32.689161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75234c7-af44-4443-92f7-d16297668057 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:32.689777 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75234c7-af44-4443-92f7-d16297668057 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:32.690058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75234c7-af44-4443-92f7-d16297668057 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:32.691276 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75234c7-af44-4443-92f7-d16297668057 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:32.691276 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75234c7-af44-4443-92f7-d16297668057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:32.692595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75234c7-af44-4443-92f7-d16297668057 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:32.741849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 378/756] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 31 00:08:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:32.748763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75234c7-af44-4443-92f7-d16297668057 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:32.758644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb02390-d5dd-49f3-9c8e-0df166b0cf95 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:32.794116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8cbb9-b022-4f66-917b-8fd186eb9a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:32.795162 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8cbb9-b022-4f66-917b-8fd186eb9a93 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:32.795657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8cbb9-b022-4f66-917b-8fd186eb9a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:32.796168 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8cbb9-b022-4f66-917b-8fd186eb9a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:32.807473 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8cbb9-b022-4f66-917b-8fd186eb9a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:32.809289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8cbb9-b022-4f66-917b-8fd186eb9a93 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-2ff8cbb9-b022-4f66-917b-8fd186eb9a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:32.825147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:32.826146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:32.827081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:32.827081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:32.827081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:32.829097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 379/757] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:32.834863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8cbb9-b022-4f66-917b-8fd186eb9a93 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:32.909661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:32.942164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8cbb9-b022-4f66-917b-8fd186eb9a93 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:32.982237 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75234c7-af44-4443-92f7-d16297668057 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:32.987063 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43144715-03a4-41b2-8785-f079d1e4d566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:32.987940 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43144715-03a4-41b2-8785-f079d1e4d566 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:32.988448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43144715-03a4-41b2-8785-f079d1e4d566 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:32.988918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43144715-03a4-41b2-8785-f079d1e4d566 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:32.989818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43144715-03a4-41b2-8785-f079d1e4d566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:32.990317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43144715-03a4-41b2-8785-f079d1e4d566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:32.992048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43144715-03a4-41b2-8785-f079d1e4d566 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.005598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 380/758] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:33.011590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43144715-03a4-41b2-8785-f079d1e4d566 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.048697 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:33.058568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328553-83a8-45fc-893c-90ab161887ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.059326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328553-83a8-45fc-893c-90ab161887ae None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.059608 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328553-83a8-45fc-893c-90ab161887ae None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.059904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328553-83a8-45fc-893c-90ab161887ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.078011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328553-83a8-45fc-893c-90ab161887ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.078011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328553-83a8-45fc-893c-90ab161887ae None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-cb328553-83a8-45fc-893c-90ab161887ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:33.092303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:33.093327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:33.094255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:33.094255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:33.094255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:33.094255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 379/759] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:33.100776 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328553-83a8-45fc-893c-90ab161887ae None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.190744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43144715-03a4-41b2-8785-f079d1e4d566 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.223778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:33.236601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266677f7-7925-43ae-bb3b-5eadcc95e043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.237597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266677f7-7925-43ae-bb3b-5eadcc95e043 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.238082 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266677f7-7925-43ae-bb3b-5eadcc95e043 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.238581 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266677f7-7925-43ae-bb3b-5eadcc95e043 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.252085 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328553-83a8-45fc-893c-90ab161887ae None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.254023 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266677f7-7925-43ae-bb3b-5eadcc95e043 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.255792 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266677f7-7925-43ae-bb3b-5eadcc95e043 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-266677f7-7925-43ae-bb3b-5eadcc95e043 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:33.277942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:33.278939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:33.279924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:33.279924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:33.279924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:33.279924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:33.279924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:33.279924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:33.279924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:33.279924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:33.286809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26e335-6f99-4302-b403-46d4d8e933e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.287296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e335-6f99-4302-b403-46d4d8e933e3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.287509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 381/760] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:33.287613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e335-6f99-4302-b403-46d4d8e933e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.287822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e335-6f99-4302-b403-46d4d8e933e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.291466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26e335-6f99-4302-b403-46d4d8e933e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:33.291466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26e335-6f99-4302-b403-46d4d8e933e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.291466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26e335-6f99-4302-b403-46d4d8e933e3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.294305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266677f7-7925-43ae-bb3b-5eadcc95e043 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.303195 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 380/761] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:33.308850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26e335-6f99-4302-b403-46d4d8e933e3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.360276 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:33.420190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26e335-6f99-4302-b403-46d4d8e933e3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.456580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4fd5e-eb4f-4357-b8a1-71f1bc983e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.457221 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4fd5e-eb4f-4357-b8a1-71f1bc983e1f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.457498 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4fd5e-eb4f-4357-b8a1-71f1bc983e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.457770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4fd5e-eb4f-4357-b8a1-71f1bc983e1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.469921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4fd5e-eb4f-4357-b8a1-71f1bc983e1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.471399 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4fd5e-eb4f-4357-b8a1-71f1bc983e1f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-4ee4fd5e-eb4f-4357-b8a1-71f1bc983e1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:33.495555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:33.496568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:33.497523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:33.497523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:33.497523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:33.497523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:33.497523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:33.497523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:33.497523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:33.497523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:33.498505 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266677f7-7925-43ae-bb3b-5eadcc95e043 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.501487 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 381/762] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:33.507819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4fd5e-eb4f-4357-b8a1-71f1bc983e1f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.599105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c20979-3f5a-4209-b55c-289132dc5d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.599786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c20979-3f5a-4209-b55c-289132dc5d81 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.600065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c20979-3f5a-4209-b55c-289132dc5d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.600330 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c20979-3f5a-4209-b55c-289132dc5d81 None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.601034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c20979-3f5a-4209-b55c-289132dc5d81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:33.603106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c20979-3f5a-4209-b55c-289132dc5d81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.604621 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c20979-3f5a-4209-b55c-289132dc5d81 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.622665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4fd5e-eb4f-4357-b8a1-71f1bc983e1f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.625041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:33.627260 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 382/763] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:33.633398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c20979-3f5a-4209-b55c-289132dc5d81 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.660410 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761d29d-aecd-4635-a82a-07073fbafe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.661042 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761d29d-aecd-4635-a82a-07073fbafe27 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.661355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761d29d-aecd-4635-a82a-07073fbafe27 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.661622 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761d29d-aecd-4635-a82a-07073fbafe27 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.662327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761d29d-aecd-4635-a82a-07073fbafe27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:33.662632 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761d29d-aecd-4635-a82a-07073fbafe27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.664372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761d29d-aecd-4635-a82a-07073fbafe27 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.677376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 382/764] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:33.684128 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761d29d-aecd-4635-a82a-07073fbafe27 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.823985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761d29d-aecd-4635-a82a-07073fbafe27 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.861133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce808c9-5e46-4bb2-a586-f7400e5b3fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.861898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce808c9-5e46-4bb2-a586-f7400e5b3fb3 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.862204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce808c9-5e46-4bb2-a586-f7400e5b3fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.862489 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:33.863391 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce808c9-5e46-4bb2-a586-f7400e5b3fb3 None admin] PATH_INFO: `/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/cb9ef38ec3b448828826de5f76a552d8/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.865547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce808c9-5e46-4bb2-a586-f7400e5b3fb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0864c2a6b50f403db79930d0869f8e23, user_id=cb9ef38ec3b448828826de5f76a552d8, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.867039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce808c9-5e46-4bb2-a586-f7400e5b3fb3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.884544 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 383/765] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:33 2022] PUT /identity/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/cb9ef38ec3b448828826de5f76a552d8/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:08:33.933650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c20979-3f5a-4209-b55c-289132dc5d81 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.956049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b27e63-fd05-4ef5-b031-0b70ee3630de None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.956402 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b27e63-fd05-4ef5-b031-0b70ee3630de None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.957009 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b27e63-fd05-4ef5-b031-0b70ee3630de None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.958795 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 384/766] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:33.964462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0fa7-d6c2-4990-9d94-dff5b91fa433 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.964748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0fa7-d6c2-4990-9d94-dff5b91fa433 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.965024 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0fa7-d6c2-4990-9d94-dff5b91fa433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.986240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accab5e-e2b0-4e1c-ba1a-b52d67e39808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.986887 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accab5e-e2b0-4e1c-ba1a-b52d67e39808 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.987211 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accab5e-e2b0-4e1c-ba1a-b52d67e39808 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.987488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accab5e-e2b0-4e1c-ba1a-b52d67e39808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.988326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accab5e-e2b0-4e1c-ba1a-b52d67e39808 None admin] RBAC: Adding query filter params (role.id=bf66c83a5d0f41039e44947c9fb18d3c, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=bc55768a6d2940f8b9c406bad2c278b6) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:33.988633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accab5e-e2b0-4e1c-ba1a-b52d67e39808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.990115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accab5e-e2b0-4e1c-ba1a-b52d67e39808 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.997544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 383/767] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/role_assignments?user.id=bc55768a6d2940f8b9c406bad2c278b6&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=bf66c83a5d0f41039e44947c9fb18d3c => generated 259 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:34.001186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c94f0fa7-d6c2-4990-9d94-dff5b91fa433 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:34.002472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c94f0fa7-d6c2-4990-9d94-dff5b91fa433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:34.044137 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:34.126278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 385/768] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:34.173153 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2702d-bd88-47e0-81be-2ec66bd66854 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.173413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2702d-bd88-47e0-81be-2ec66bd66854 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.173688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2702d-bd88-47e0-81be-2ec66bd66854 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.175433 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 384/769] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:34.181749 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb3d8-92b7-416b-8339-6164a276d950 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.182041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb3d8-92b7-416b-8339-6164a276d950 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.182311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb3d8-92b7-416b-8339-6164a276d950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.202167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-629bb3d8-92b7-416b-8339-6164a276d950 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:34.203288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-629bb3d8-92b7-416b-8339-6164a276d950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:34.282073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 386/770] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:34.517714 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2702d-bd88-47e0-81be-2ec66bd66854 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:34.634220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2702d-bd88-47e0-81be-2ec66bd66854 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:34.649177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:34.670241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a708d6-84cd-49bf-88fd-4c1a0a6b513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:34.670876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a708d6-84cd-49bf-88fd-4c1a0a6b513f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.671155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a708d6-84cd-49bf-88fd-4c1a0a6b513f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.671425 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a708d6-84cd-49bf-88fd-4c1a0a6b513f None admin] PATH_INFO: `/v3/services/network` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.672050 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a708d6-84cd-49bf-88fd-4c1a0a6b513f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:34.673753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a708d6-84cd-49bf-88fd-4c1a0a6b513f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-b7a708d6-84cd-49bf-88fd-4c1a0a6b513f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:34.683460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:34.684501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:34.685766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 385/771] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:34 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:34.691203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bb3d8-92b7-416b-8339-6164a276d950 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:34.756112 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a708d6-84cd-49bf-88fd-4c1a0a6b513f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:34.795598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:34.816846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bb3d8-92b7-416b-8339-6164a276d950 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:34.860243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71eb89d-ef67-4a47-9abc-091f95dd198c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:34.861229 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eb89d-ef67-4a47-9abc-091f95dd198c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.861976 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eb89d-ef67-4a47-9abc-091f95dd198c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.862696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eb89d-ef67-4a47-9abc-091f95dd198c None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.863522 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71eb89d-ef67-4a47-9abc-091f95dd198c None admin] RBAC: Adding query filter params (name=network) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:34.864170 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71eb89d-ef67-4a47-9abc-091f95dd198c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:34.866348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71eb89d-ef67-4a47-9abc-091f95dd198c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:34.872411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 387/772] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:34.874150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7241e8-8f0a-4d14-aad5-4235e92bf52d None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.874949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7241e8-8f0a-4d14-aad5-4235e92bf52d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.875403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7241e8-8f0a-4d14-aad5-4235e92bf52d None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.877664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 388/773] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:34.878545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7241e8-8f0a-4d14-aad5-4235e92bf52d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:34.888340 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a708d6-84cd-49bf-88fd-4c1a0a6b513f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:34.926298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4176f-c3f1-4960-a8e8-a09baf023849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:34.927761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4176f-c3f1-4960-a8e8-a09baf023849 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.928221 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4176f-c3f1-4960-a8e8-a09baf023849 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.928693 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4176f-c3f1-4960-a8e8-a09baf023849 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.929884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4176f-c3f1-4960-a8e8-a09baf023849 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:34.931891 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4176f-c3f1-4960-a8e8-a09baf023849 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-f1a4176f-c3f1-4960-a8e8-a09baf023849 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:34.944132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:34.945158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:34.946025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:34.946025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:34.946025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:34.946025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:34.946025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:34.946025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:34.946025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:34.946025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:34.946025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:34.946025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:34.946025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:34.946025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:34.946025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:08:34.946025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:34.949106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 386/774] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Aug 31 00:08:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:34.951271 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16842159-9441-4582-8f81-63ab284ca47a None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.951823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16842159-9441-4582-8f81-63ab284ca47a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.952236 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16842159-9441-4582-8f81-63ab284ca47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.976498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-16842159-9441-4582-8f81-63ab284ca47a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:34.978189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-16842159-9441-4582-8f81-63ab284ca47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:34.996701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7241e8-8f0a-4d14-aad5-4235e92bf52d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:35.020894 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:35.039878 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101fc9a-aada-4d58-b0a7-c53126801816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:35.040754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101fc9a-aada-4d58-b0a7-c53126801816 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:35.041178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101fc9a-aada-4d58-b0a7-c53126801816 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:35.042020 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101fc9a-aada-4d58-b0a7-c53126801816 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:35.042940 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101fc9a-aada-4d58-b0a7-c53126801816 None admin] RBAC: Adding query filter params (type=network) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:35.043497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101fc9a-aada-4d58-b0a7-c53126801816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:35.045224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101fc9a-aada-4d58-b0a7-c53126801816 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:35.054061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 389/775] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:35.055451 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101fc9a-aada-4d58-b0a7-c53126801816 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:35.063983 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 387/776] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:35.065371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16842159-9441-4582-8f81-63ab284ca47a None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:35.074837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:35.179314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101fc9a-aada-4d58-b0a7-c53126801816 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:35.220505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46396644-6d96-41eb-9856-ea57fb802479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:35.221786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46396644-6d96-41eb-9856-ea57fb802479 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:35.222221 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46396644-6d96-41eb-9856-ea57fb802479 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:35.222675 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46396644-6d96-41eb-9856-ea57fb802479 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:35.223487 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46396644-6d96-41eb-9856-ea57fb802479 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:35.224197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46396644-6d96-41eb-9856-ea57fb802479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:35.226415 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46396644-6d96-41eb-9856-ea57fb802479 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:35.232608 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 390/777] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Aug 31 00:08:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:35.240655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46396644-6d96-41eb-9856-ea57fb802479 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:35.253383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16842159-9441-4582-8f81-63ab284ca47a None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:35.289113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ea145-d060-4d6a-97d6-4a4755e14662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:35.290150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea145-d060-4d6a-97d6-4a4755e14662 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:35.290618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea145-d060-4d6a-97d6-4a4755e14662 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:35.291212 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea145-d060-4d6a-97d6-4a4755e14662 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:35.292154 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ea145-d060-4d6a-97d6-4a4755e14662 None admin] RBAC: Adding query filter params (interface=public, service_id=bfcfa9b522c342f08086130f563d77ec, region_id=RegionOne) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:35.292678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ea145-d060-4d6a-97d6-4a4755e14662 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:35.294258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ea145-d060-4d6a-97d6-4a4755e14662 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:35.303031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 388/778] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 31 00:08:35 2022] GET /identity/v3/endpoints?service_id=bfcfa9b522c342f08086130f563d77ec&interface=public®ion_id=RegionOne => generated 194 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:35.308817 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ea145-d060-4d6a-97d6-4a4755e14662 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:35.377315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:35.410274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:35.442302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46396644-6d96-41eb-9856-ea57fb802479 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:35.458695 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ea145-d060-4d6a-97d6-4a4755e14662 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:35.488383 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bcf92-f3e5-43ad-b65f-50583a5b2496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:35.489552 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bcf92-f3e5-43ad-b65f-50583a5b2496 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:35.489980 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bcf92-f3e5-43ad-b65f-50583a5b2496 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:35.490591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bcf92-f3e5-43ad-b65f-50583a5b2496 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:35.491322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bcf92-f3e5-43ad-b65f-50583a5b2496 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:35.491732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bcf92-f3e5-43ad-b65f-50583a5b2496 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:35.493290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bcf92-f3e5-43ad-b65f-50583a5b2496 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:35.494821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b6b43-c17b-4ab9-b5f0-04eccade7c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:35.495585 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b6b43-c17b-4ab9-b5f0-04eccade7c02 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:35.496078 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b6b43-c17b-4ab9-b5f0-04eccade7c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:35.496549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b6b43-c17b-4ab9-b5f0-04eccade7c02 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:35.497325 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b6b43-c17b-4ab9-b5f0-04eccade7c02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:35.498865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b6b43-c17b-4ab9-b5f0-04eccade7c02 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:35.503722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 391/779] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Aug 31 00:08:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:35.503722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bcf92-f3e5-43ad-b65f-50583a5b2496 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:35.510039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 389/780] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 31 00:08:35 2022] GET /identity/v3/services => generated 772 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:35.519735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b6b43-c17b-4ab9-b5f0-04eccade7c02 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:35.670720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bcf92-f3e5-43ad-b65f-50583a5b2496 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:35.693411 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:35.698286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b6b43-c17b-4ab9-b5f0-04eccade7c02 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:35.731263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e06188-17e8-4427-ace4-da3130ce4e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:35.731947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e06188-17e8-4427-ace4-da3130ce4e3e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:35.732232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e06188-17e8-4427-ace4-da3130ce4e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:35.732504 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e06188-17e8-4427-ace4-da3130ce4e3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:35.744061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec67bc6-128c-4924-827c-2be127eeba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:35.744791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:35.746110 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67bc6-128c-4924-827c-2be127eeba37 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:35.746385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67bc6-128c-4924-827c-2be127eeba37 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:35.746691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67bc6-128c-4924-827c-2be127eeba37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:35.747819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec67bc6-128c-4924-827c-2be127eeba37 None admin] RBAC: Adding query filter params (interface=public, service_id=49e79c0de1474f83ab46c2a799372c28, region_id=RegionOne) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:35.748264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec67bc6-128c-4924-827c-2be127eeba37 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:35.748467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e06188-17e8-4427-ace4-da3130ce4e3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:35.749702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec67bc6-128c-4924-827c-2be127eeba37 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e2e06188-17e8-4427-ace4-da3130ce4e3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:35.754631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:35.755616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:35.756524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:35.756524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:35.756524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:35.756524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:35.756524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:35.756524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:35.756524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:35.756524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:35.756524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:35.756524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:35.756524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:35.756524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:35.756524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 392/781] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:35.757252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 390/782] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 31 00:08:35 2022] GET /identity/v3/endpoints?service_id=49e79c0de1474f83ab46c2a799372c28&interface=public®ion_id=RegionOne => generated 194 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:35.764274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e06188-17e8-4427-ace4-da3130ce4e3e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:35.772900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec67bc6-128c-4924-827c-2be127eeba37 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:35.929353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e06188-17e8-4427-ace4-da3130ce4e3e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:35.933349 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec67bc6-128c-4924-827c-2be127eeba37 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:35.996378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc667ec-3c43-4a50-99d2-9cc9f4319323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:35.997763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc667ec-3c43-4a50-99d2-9cc9f4319323 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:35.998045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc667ec-3c43-4a50-99d2-9cc9f4319323 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:35.998319 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc667ec-3c43-4a50-99d2-9cc9f4319323 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:35.998943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc667ec-3c43-4a50-99d2-9cc9f4319323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:36.000370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc667ec-3c43-4a50-99d2-9cc9f4319323 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:36.004690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77656a5b-2d35-4d0e-91d8-92e812ee2244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:36.005375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77656a5b-2d35-4d0e-91d8-92e812ee2244 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.005655 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77656a5b-2d35-4d0e-91d8-92e812ee2244 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.005927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77656a5b-2d35-4d0e-91d8-92e812ee2244 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.006608 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77656a5b-2d35-4d0e-91d8-92e812ee2244 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:36.006917 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77656a5b-2d35-4d0e-91d8-92e812ee2244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:36.008327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77656a5b-2d35-4d0e-91d8-92e812ee2244 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:36.015454 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 393/783] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 31 00:08:35 2022] GET /identity/v3/services => generated 772 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:36.022766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 391/784] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:36.028596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc667ec-3c43-4a50-99d2-9cc9f4319323 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:36.132979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:36.170340 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfdfe2-c7bd-42c3-b890-3ee7e22a8e85 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.170871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfdfe2-c7bd-42c3-b890-3ee7e22a8e85 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.171341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfdfe2-c7bd-42c3-b890-3ee7e22a8e85 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.173335 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 392/785] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:36.182246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4ce76-3983-4ffe-8f48-d6e9515f0323 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.182812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4ce76-3983-4ffe-8f48-d6e9515f0323 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.183297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4ce76-3983-4ffe-8f48-d6e9515f0323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.195093 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc667ec-3c43-4a50-99d2-9cc9f4319323 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:36.206301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5ca4ce76-3983-4ffe-8f48-d6e9515f0323 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:36.207830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5ca4ce76-3983-4ffe-8f48-d6e9515f0323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:36.232083 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:36.234113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0b17a-947d-437f-9dac-9cc4f9d9c914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:36.234766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0b17a-947d-437f-9dac-9cc4f9d9c914 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.235041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0b17a-947d-437f-9dac-9cc4f9d9c914 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.235310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0b17a-947d-437f-9dac-9cc4f9d9c914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.307092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 393/786] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:36.343734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ce2f-41b8-4a53-8b69-3b16828bf51d None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.344022 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ce2f-41b8-4a53-8b69-3b16828bf51d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.344459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ce2f-41b8-4a53-8b69-3b16828bf51d None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.346526 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 394/787] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:36.352281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c91dc9-650a-4c44-b23c-ed972e3d8c7a None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.352759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c91dc9-650a-4c44-b23c-ed972e3d8c7a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.353181 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c91dc9-650a-4c44-b23c-ed972e3d8c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.393888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-b0c91dc9-650a-4c44-b23c-ed972e3d8c7a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:36.395412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b0c91dc9-650a-4c44-b23c-ed972e3d8c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:36.460921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0b17a-947d-437f-9dac-9cc4f9d9c914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:36.462371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0b17a-947d-437f-9dac-9cc4f9d9c914 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:36.487651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 395/788] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-0ec0b17a-947d-437f-9dac-9cc4f9d9c914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:36.491449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:36.492668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:36.493759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:36.493759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:36.493759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:36.498124 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 394/789] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:36.499378 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c91dc9-650a-4c44-b23c-ed972e3d8c7a None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:36.628339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0b17a-947d-437f-9dac-9cc4f9d9c914 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:36.650157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:36.671809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c91dc9-650a-4c44-b23c-ed972e3d8c7a None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:36.738644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec547cac-8cd5-41aa-a34a-0d0005bd0d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:36.739178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec547cac-8cd5-41aa-a34a-0d0005bd0d16 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.739456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec547cac-8cd5-41aa-a34a-0d0005bd0d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.739739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec547cac-8cd5-41aa-a34a-0d0005bd0d16 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.740392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec547cac-8cd5-41aa-a34a-0d0005bd0d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:36.741434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec547cac-8cd5-41aa-a34a-0d0005bd0d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:36.743395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec547cac-8cd5-41aa-a34a-0d0005bd0d16 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:36.758089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 396/790] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:36.766733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec547cac-8cd5-41aa-a34a-0d0005bd0d16 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:36.783957 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0b17a-947d-437f-9dac-9cc4f9d9c914 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:36.821469 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:36.824646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf06d50-b049-4759-b72d-21a2cbbd06f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:36.825644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf06d50-b049-4759-b72d-21a2cbbd06f2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.826129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf06d50-b049-4759-b72d-21a2cbbd06f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.826676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf06d50-b049-4759-b72d-21a2cbbd06f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.838177 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf06d50-b049-4759-b72d-21a2cbbd06f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-1bf06d50-b049-4759-b72d-21a2cbbd06f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:36.843822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:36.844999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:36.845898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:36.845898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:36.845898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:36.845898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:36.845898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:36.845898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:36.845898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:36.845898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:36.845898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:36.845898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:36.845898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:36.845898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:36.848866 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 395/791] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:36.850063 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf06d50-b049-4759-b72d-21a2cbbd06f2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:36.913015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec547cac-8cd5-41aa-a34a-0d0005bd0d16 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:36.958679 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf06d50-b049-4759-b72d-21a2cbbd06f2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:36.960245 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f9cc4-289c-4bcc-b623-134a122d8789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:36.962074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f9cc4-289c-4bcc-b623-134a122d8789 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.962573 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f9cc4-289c-4bcc-b623-134a122d8789 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.963040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f9cc4-289c-4bcc-b623-134a122d8789 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.973308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f9cc4-289c-4bcc-b623-134a122d8789 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:36.975520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f9cc4-289c-4bcc-b623-134a122d8789 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-289f9cc4-289c-4bcc-b623-134a122d8789 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:36.990997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:36.992012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:36.993056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:36.993056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:36.993056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:36.993056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:36.993056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:36.993056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:36.993056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:36.993056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:36.993056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:08:36.993056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:36.994364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16111e28-2c59-4f92-9be8-d9d92bb28d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:36.994992 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111e28-2c59-4f92-9be8-d9d92bb28d06 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.995265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111e28-2c59-4f92-9be8-d9d92bb28d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.995530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111e28-2c59-4f92-9be8-d9d92bb28d06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.995779 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 397/792] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:36.996766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f9cc4-289c-4bcc-b623-134a122d8789 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:37.006209 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16111e28-2c59-4f92-9be8-d9d92bb28d06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:37.008681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-16111e28-2c59-4f92-9be8-d9d92bb28d06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:37.011271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:37.012701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:37.013625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:37.013625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:37.013625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:37.013625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:37.013625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:37.013625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:37.013625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:37.013625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:37.013625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:37.013625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:37.013625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:37.013625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:37.017376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 396/793] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:37.018117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16111e28-2c59-4f92-9be8-d9d92bb28d06 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:37.054359 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:37.121125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16111e28-2c59-4f92-9be8-d9d92bb28d06 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:37.138319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f9cc4-289c-4bcc-b623-134a122d8789 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:37.160048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990de557-2583-4211-b217-555ccc642b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:37.165539 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990de557-2583-4211-b217-555ccc642b3a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:37.165623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990de557-2583-4211-b217-555ccc642b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:37.165844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990de557-2583-4211-b217-555ccc642b3a None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:37.166709 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990de557-2583-4211-b217-555ccc642b3a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:37.167014 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990de557-2583-4211-b217-555ccc642b3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:37.168528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990de557-2583-4211-b217-555ccc642b3a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:37.185371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b061147-5a04-4e4f-8c55-8117d5aab574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:37.186341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b061147-5a04-4e4f-8c55-8117d5aab574 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:37.186830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b061147-5a04-4e4f-8c55-8117d5aab574 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:37.187097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 397/794] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Aug 31 00:08:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:37.187574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b061147-5a04-4e4f-8c55-8117d5aab574 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:37.187994 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990de557-2583-4211-b217-555ccc642b3a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:37.188820 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b061147-5a04-4e4f-8c55-8117d5aab574 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:37.189336 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b061147-5a04-4e4f-8c55-8117d5aab574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:37.191788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b061147-5a04-4e4f-8c55-8117d5aab574 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:37.204255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 398/795] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:37.205888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b061147-5a04-4e4f-8c55-8117d5aab574 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:37.293740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:37.299067 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:37.309950 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990de557-2583-4211-b217-555ccc642b3a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:37.335082 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b061147-5a04-4e4f-8c55-8117d5aab574 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:37.348251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7940b-beb3-4ae5-b393-2bb307782485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:37.349267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7940b-beb3-4ae5-b393-2bb307782485 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:37.349777 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7940b-beb3-4ae5-b393-2bb307782485 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:37.350314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7940b-beb3-4ae5-b393-2bb307782485 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:37.351185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7940b-beb3-4ae5-b393-2bb307782485 None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:37.351761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7940b-beb3-4ae5-b393-2bb307782485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:37.353469 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7940b-beb3-4ae5-b393-2bb307782485 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:37.363558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 398/796] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:37.365122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7940b-beb3-4ae5-b393-2bb307782485 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:37.372414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568ad7b-8353-4f43-9e04-e8ebf790ebda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:37.373074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ad7b-8353-4f43-9e04-e8ebf790ebda None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:37.373352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ad7b-8353-4f43-9e04-e8ebf790ebda None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:37.373619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ad7b-8353-4f43-9e04-e8ebf790ebda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:37.386266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568ad7b-8353-4f43-9e04-e8ebf790ebda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:37.387786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568ad7b-8353-4f43-9e04-e8ebf790ebda None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-8568ad7b-8353-4f43-9e04-e8ebf790ebda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:37.402668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:37.403743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:37.404690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:37.404690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:37.404690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:37.404690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 399/797] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:37.405464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568ad7b-8353-4f43-9e04-e8ebf790ebda None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:37.482380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7940b-beb3-4ae5-b393-2bb307782485 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:37.504556 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568ad7b-8353-4f43-9e04-e8ebf790ebda None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:37.519620 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d1abd-0340-4552-a4f3-7b0f4439ddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:37.520557 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d1abd-0340-4552-a4f3-7b0f4439ddfb None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:37.520983 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d1abd-0340-4552-a4f3-7b0f4439ddfb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:37.521466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d1abd-0340-4552-a4f3-7b0f4439ddfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:37.524150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:37.535562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d1abd-0340-4552-a4f3-7b0f4439ddfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:37.537520 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d1abd-0340-4552-a4f3-7b0f4439ddfb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:37.538220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420cd31-bd04-4ace-9bcf-051255116106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:37.538851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420cd31-bd04-4ace-9bcf-051255116106 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:37.539127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420cd31-bd04-4ace-9bcf-051255116106 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:37.539398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420cd31-bd04-4ace-9bcf-051255116106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:37.550253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420cd31-bd04-4ace-9bcf-051255116106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:37.551628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420cd31-bd04-4ace-9bcf-051255116106 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e41d1abd-0340-4552-a4f3-7b0f4439ddfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:37.554118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:37.555340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:37.556456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:37.556456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:37.556456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:37.558165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 399/798] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:37.559091 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d1abd-0340-4552-a4f3-7b0f4439ddfb None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:37.571291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-4420cd31-bd04-4ace-9bcf-051255116106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:37.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:37.575807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:37.576777 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:37.576777 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:37.576777 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:37.580499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 400/799] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:37.581336 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420cd31-bd04-4ace-9bcf-051255116106 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:37.679385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d1abd-0340-4552-a4f3-7b0f4439ddfb None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:37.681437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420cd31-bd04-4ace-9bcf-051255116106 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:37.715580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c791f0-2dc5-4d4f-a10a-f3de8ff3d0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:37.716207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c791f0-2dc5-4d4f-a10a-f3de8ff3d0fc None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:37.716467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c791f0-2dc5-4d4f-a10a-f3de8ff3d0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:37.716736 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c791f0-2dc5-4d4f-a10a-f3de8ff3d0fc None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:37.717373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c791f0-2dc5-4d4f-a10a-f3de8ff3d0fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:37.717670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c791f0-2dc5-4d4f-a10a-f3de8ff3d0fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:37.718633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cea7f-c4cf-43eb-9fdc-721cc5d009df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:37.719049 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c791f0-2dc5-4d4f-a10a-f3de8ff3d0fc None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:37.719566 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cea7f-c4cf-43eb-9fdc-721cc5d009df None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:37.720173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cea7f-c4cf-43eb-9fdc-721cc5d009df None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:37.720694 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cea7f-c4cf-43eb-9fdc-721cc5d009df None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:37.721575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cea7f-c4cf-43eb-9fdc-721cc5d009df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:37.722018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cea7f-c4cf-43eb-9fdc-721cc5d009df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:37.723556 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cea7f-c4cf-43eb-9fdc-721cc5d009df None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:37.731593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 401/800] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:37.732477 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c791f0-2dc5-4d4f-a10a-f3de8ff3d0fc None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:37.736252 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 400/801] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:37.737551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b4a69-5b55-449f-81c2-b125fbd0ae4b None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:37.737839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b4a69-5b55-449f-81c2-b125fbd0ae4b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:37.738110 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b4a69-5b55-449f-81c2-b125fbd0ae4b None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:37.739519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 401/802] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:37.741274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b4a69-5b55-449f-81c2-b125fbd0ae4b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:37.764880 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:37.810285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:37.841577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c791f0-2dc5-4d4f-a10a-f3de8ff3d0fc None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:37.846035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b4a69-5b55-449f-81c2-b125fbd0ae4b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:37.877757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f596b9-0b8e-4b55-b638-6035cb036118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:37.878544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f596b9-0b8e-4b55-b638-6035cb036118 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:37.878880 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f596b9-0b8e-4b55-b638-6035cb036118 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:37.879245 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f596b9-0b8e-4b55-b638-6035cb036118 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:37.880011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f596b9-0b8e-4b55-b638-6035cb036118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:37.880416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f596b9-0b8e-4b55-b638-6035cb036118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:37.881446 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2967386-24dc-4d5d-ae38-84964f775c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:37.882022 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f596b9-0b8e-4b55-b638-6035cb036118 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:37.882114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2967386-24dc-4d5d-ae38-84964f775c52 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:37.882346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2967386-24dc-4d5d-ae38-84964f775c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:37.882619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2967386-24dc-4d5d-ae38-84964f775c52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:37.889965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2967386-24dc-4d5d-ae38-84964f775c52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:37.891409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2967386-24dc-4d5d-ae38-84964f775c52 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:37.896606 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 402/803] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:37.897581 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f596b9-0b8e-4b55-b638-6035cb036118 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-b2967386-24dc-4d5d-ae38-84964f775c52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:37.906696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:37.907805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:37.908803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:37.908803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:37.908803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:37.908803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:37.908803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:37.908803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:37.908803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:37.908803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:37.908803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:37.908803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:37.908803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 402/804] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 31 00:08:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:37.914594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945af25-7893-4a29-90ee-813cb4cdb28f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:37.914594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945af25-7893-4a29-90ee-813cb4cdb28f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:37.914594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945af25-7893-4a29-90ee-813cb4cdb28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:37.929604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-6945af25-7893-4a29-90ee-813cb4cdb28f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:37.930612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6945af25-7893-4a29-90ee-813cb4cdb28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:38.001534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:38.015907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 403/805] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:38.015907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945af25-7893-4a29-90ee-813cb4cdb28f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:38.019302 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f596b9-0b8e-4b55-b638-6035cb036118 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:38.069342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc190d6-4013-46a2-a8cb-dc75989a1ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:38.070666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc190d6-4013-46a2-a8cb-dc75989a1ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:38.071221 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc190d6-4013-46a2-a8cb-dc75989a1ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:38.071959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc190d6-4013-46a2-a8cb-dc75989a1ba3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:38.075011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:38.083560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc190d6-4013-46a2-a8cb-dc75989a1ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:38.086124 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc190d6-4013-46a2-a8cb-dc75989a1ba3 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-4fc190d6-4013-46a2-a8cb-dc75989a1ba3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:38.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:38.103815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:38.104722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:38.104722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:38.104722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:38.104722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:38.104722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:38.104722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:38.104722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:38.104722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:38.105879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 403/806] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:38.106049 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc190d6-4013-46a2-a8cb-dc75989a1ba3 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:38.122565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945af25-7893-4a29-90ee-813cb4cdb28f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:38.168358 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3f618-b30e-4d03-8f8c-729b8510ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:38.169136 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3f618-b30e-4d03-8f8c-729b8510ec32 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:38.169532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3f618-b30e-4d03-8f8c-729b8510ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:38.169893 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3f618-b30e-4d03-8f8c-729b8510ec32 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:38.178274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3f618-b30e-4d03-8f8c-729b8510ec32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:38.180038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3f618-b30e-4d03-8f8c-729b8510ec32 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-35a3f618-b30e-4d03-8f8c-729b8510ec32 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:38.193045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:38.194130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:38.200309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:38.200309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:38.200309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:38.200309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:38.200309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:38.200309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:38.200309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:38.200309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:38.200309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:38.200309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:38.200309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 404/807] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 31 00:08:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:38.200309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3f618-b30e-4d03-8f8c-729b8510ec32 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:38.231562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc190d6-4013-46a2-a8cb-dc75989a1ba3 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:38.266527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d28dab-2951-4705-82d4-726677c04f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:38.267304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d28dab-2951-4705-82d4-726677c04f29 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:38.267642 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d28dab-2951-4705-82d4-726677c04f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:38.268018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d28dab-2951-4705-82d4-726677c04f29 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:38.268832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d28dab-2951-4705-82d4-726677c04f29 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:38.269222 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d28dab-2951-4705-82d4-726677c04f29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:38.270740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d28dab-2951-4705-82d4-726677c04f29 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:38.294314 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 404/808] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 31 00:08:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:38.295084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d28dab-2951-4705-82d4-726677c04f29 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:38.307409 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:38.308059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3f618-b30e-4d03-8f8c-729b8510ec32 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:38.328436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:38.345645 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997e6db-ec91-4087-b29d-ab2b6f7eb94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:38.346320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997e6db-ec91-4087-b29d-ab2b6f7eb94e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:38.346603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997e6db-ec91-4087-b29d-ab2b6f7eb94e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:38.347134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997e6db-ec91-4087-b29d-ab2b6f7eb94e None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:38.347571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997e6db-ec91-4087-b29d-ab2b6f7eb94e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:38.347930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997e6db-ec91-4087-b29d-ab2b6f7eb94e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:38.349367 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997e6db-ec91-4087-b29d-ab2b6f7eb94e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:38.361357 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 405/809] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:38.362518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000f0e9-4ca9-4d84-a925-4accb7ecbec5 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:38.362802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000f0e9-4ca9-4d84-a925-4accb7ecbec5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:38.363075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000f0e9-4ca9-4d84-a925-4accb7ecbec5 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:38.367822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 406/810] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:38.367822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000f0e9-4ca9-4d84-a925-4accb7ecbec5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:38.399255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d28dab-2951-4705-82d4-726677c04f29 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:38.432343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356f708-3907-47e2-8b3a-4b2a323b5000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:38.432956 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356f708-3907-47e2-8b3a-4b2a323b5000 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:38.433233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356f708-3907-47e2-8b3a-4b2a323b5000 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:38.433504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356f708-3907-47e2-8b3a-4b2a323b5000 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:38.434244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356f708-3907-47e2-8b3a-4b2a323b5000 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:38.434552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356f708-3907-47e2-8b3a-4b2a323b5000 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:38.436012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356f708-3907-47e2-8b3a-4b2a323b5000 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:38.453585 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 405/811] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Aug 31 00:08:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:38.458310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356f708-3907-47e2-8b3a-4b2a323b5000 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:38.472547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000f0e9-4ca9-4d84-a925-4accb7ecbec5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:38.505992 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a09a5-3d9c-466a-a782-552975dc5650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:38.506608 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a09a5-3d9c-466a-a782-552975dc5650 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:38.506886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a09a5-3d9c-466a-a782-552975dc5650 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:38.507160 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a09a5-3d9c-466a-a782-552975dc5650 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:38.520756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:38.551932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:38.555549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356f708-3907-47e2-8b3a-4b2a323b5000 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:38.575464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a09a5-3d9c-466a-a782-552975dc5650 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:38.577009 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a09a5-3d9c-466a-a782-552975dc5650 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:38.589710 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cc7d7-c2e9-4e80-804c-80b1bc19756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:38.590335 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cc7d7-c2e9-4e80-804c-80b1bc19756f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:38.590615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cc7d7-c2e9-4e80-804c-80b1bc19756f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:38.590883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cc7d7-c2e9-4e80-804c-80b1bc19756f None admin] PATH_INFO: `/v3/services/network` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:38.591465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090cc7d7-c2e9-4e80-804c-80b1bc19756f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:38.592907 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090cc7d7-c2e9-4e80-804c-80b1bc19756f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-090cc7d7-c2e9-4e80-804c-80b1bc19756f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:38.601595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:38.602829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:38.603905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 406/812] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:38 2022] GET /identity/v3/services/network => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:38.604926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cc7d7-c2e9-4e80-804c-80b1bc19756f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:38.681289 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 407/813] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:38.682579 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7611a3-20e8-4cde-86c6-be129387d0c1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:38.682859 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7611a3-20e8-4cde-86c6-be129387d0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:38.683125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7611a3-20e8-4cde-86c6-be129387d0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:38.701387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-dd7611a3-20e8-4cde-86c6-be129387d0c1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:38.702586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-dd7611a3-20e8-4cde-86c6-be129387d0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:38.704211 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cc7d7-c2e9-4e80-804c-80b1bc19756f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:38.732851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:38.738436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e3a6e-cdc0-4c5d-a117-5ea2210cc179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:38.739093 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e3a6e-cdc0-4c5d-a117-5ea2210cc179 None admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:38.739369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e3a6e-cdc0-4c5d-a117-5ea2210cc179 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:38.739638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e3a6e-cdc0-4c5d-a117-5ea2210cc179 None admin] PATH_INFO: `/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/ac02a26fe2a44b7db623003d1a96ed36/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:38.741546 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e3a6e-cdc0-4c5d-a117-5ea2210cc179 None admin] RBAC: Authorizing `identity:create_grant(project_id=0864c2a6b50f403db79930d0869f8e23, user_id=ac02a26fe2a44b7db623003d1a96ed36, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:38.742987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e3a6e-cdc0-4c5d-a117-5ea2210cc179 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:38.756700 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 407/814] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:38 2022] PUT /identity/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/ac02a26fe2a44b7db623003d1a96ed36/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:08:38.757611 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e3a6e-cdc0-4c5d-a117-5ea2210cc179 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:38.792134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 408/815] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:38.794138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7611a3-20e8-4cde-86c6-be129387d0c1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:38.809342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:38.898504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e3a6e-cdc0-4c5d-a117-5ea2210cc179 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:38.929750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7611a3-20e8-4cde-86c6-be129387d0c1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:38.944298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e351e-3e3c-4196-b22c-8a29b859f4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:38.945101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e351e-3e3c-4196-b22c-8a29b859f4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:38.945475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e351e-3e3c-4196-b22c-8a29b859f4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:38.946019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e351e-3e3c-4196-b22c-8a29b859f4c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:38.960370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e351e-3e3c-4196-b22c-8a29b859f4c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:38.962457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e351e-3e3c-4196-b22c-8a29b859f4c0 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:38.970886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d0c50-8167-44d3-94b7-59fdbef64867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:38.972201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0c50-8167-44d3-94b7-59fdbef64867 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:38.972618 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0c50-8167-44d3-94b7-59fdbef64867 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:38.973544 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0c50-8167-44d3-94b7-59fdbef64867 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:38.974477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d0c50-8167-44d3-94b7-59fdbef64867 None admin] RBAC: Adding query filter params (name=network) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:38.975028 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d0c50-8167-44d3-94b7-59fdbef64867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:38.976674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d0c50-8167-44d3-94b7-59fdbef64867 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-024e351e-3e3c-4196-b22c-8a29b859f4c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:38.980678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:38.981811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:38.982942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:38.982942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:38.982942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:38.984289 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 409/817] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:38.984398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 408/817] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:38.987729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e351e-3e3c-4196-b22c-8a29b859f4c0 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:38.991345 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d0c50-8167-44d3-94b7-59fdbef64867 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:39.046820 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:39.077112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:39.111317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d0c50-8167-44d3-94b7-59fdbef64867 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:39.114628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e351e-3e3c-4196-b22c-8a29b859f4c0 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:39.150315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6707a-9e10-484e-9b5c-911bd2f88c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:39.150957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6707a-9e10-484e-9b5c-911bd2f88c35 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.151294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6707a-9e10-484e-9b5c-911bd2f88c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.151623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6707a-9e10-484e-9b5c-911bd2f88c35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.154193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1e781-2250-492f-a5f2-6d927e86bbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:39.154822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e781-2250-492f-a5f2-6d927e86bbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.155103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e781-2250-492f-a5f2-6d927e86bbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.155378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1e781-2250-492f-a5f2-6d927e86bbf8 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.156090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1e781-2250-492f-a5f2-6d927e86bbf8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:39.156369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1e781-2250-492f-a5f2-6d927e86bbf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:39.157833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1e781-2250-492f-a5f2-6d927e86bbf8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:39.163669 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6707a-9e10-484e-9b5c-911bd2f88c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:39.165485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6707a-9e10-484e-9b5c-911bd2f88c35 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:39.168552 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 410/818] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:39.169604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1e781-2250-492f-a5f2-6d927e86bbf8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-06e6707a-9e10-484e-9b5c-911bd2f88c35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:39.180617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:39.181762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:39.182691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:39.182691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:39.182691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:39.182691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 409/819] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:39.182691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6707a-9e10-484e-9b5c-911bd2f88c35 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:39.280711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1e781-2250-492f-a5f2-6d927e86bbf8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:39.286237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:39.293074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6707a-9e10-484e-9b5c-911bd2f88c35 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:39.317080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f685829-ca54-42eb-857f-dc0514da54c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:39.317771 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685829-ca54-42eb-857f-dc0514da54c4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.318052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685829-ca54-42eb-857f-dc0514da54c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.318327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685829-ca54-42eb-857f-dc0514da54c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.319022 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f685829-ca54-42eb-857f-dc0514da54c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:39.319328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f685829-ca54-42eb-857f-dc0514da54c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:39.320761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f685829-ca54-42eb-857f-dc0514da54c4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:39.323099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:39.330802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbb255-ed9c-46dc-a68a-556130124a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:39.331591 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbb255-ed9c-46dc-a68a-556130124a58 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.331901 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbb255-ed9c-46dc-a68a-556130124a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.332177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbb255-ed9c-46dc-a68a-556130124a58 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.332762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbb255-ed9c-46dc-a68a-556130124a58 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:39.337996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 411/820] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:39.337996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f685829-ca54-42eb-857f-dc0514da54c4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:39.338220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbb255-ed9c-46dc-a68a-556130124a58 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-bcbbb255-ed9c-46dc-a68a-556130124a58 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:39.347345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:39.348422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:39.349276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 410/821] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Aug 31 00:08:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:39.350097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbb255-ed9c-46dc-a68a-556130124a58 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:39.456785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f685829-ca54-42eb-857f-dc0514da54c4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:39.457861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbb255-ed9c-46dc-a68a-556130124a58 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:39.491199 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26bff0-8189-4484-bfbb-bac1efd89564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:39.491844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26bff0-8189-4484-bfbb-bac1efd89564 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.492130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26bff0-8189-4484-bfbb-bac1efd89564 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.492406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26bff0-8189-4484-bfbb-bac1efd89564 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.493099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26bff0-8189-4484-bfbb-bac1efd89564 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:39.494038 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951134b-853c-4ad3-964f-81748a787a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:39.494447 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26bff0-8189-4484-bfbb-bac1efd89564 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:39.494657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951134b-853c-4ad3-964f-81748a787a6e None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.494934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951134b-853c-4ad3-964f-81748a787a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.495206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951134b-853c-4ad3-964f-81748a787a6e None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.495891 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951134b-853c-4ad3-964f-81748a787a6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:39.496196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951134b-853c-4ad3-964f-81748a787a6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:39.497563 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951134b-853c-4ad3-964f-81748a787a6e None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:39.510054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 411/822] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:39.510900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951134b-853c-4ad3-964f-81748a787a6e None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:39.535760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 412/823] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:08:39 2022] POST /identity/v3/endpoints => generated 337 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:39.535760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26bff0-8189-4484-bfbb-bac1efd89564 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:39.547449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:39.599933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:39.668124 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951134b-853c-4ad3-964f-81748a787a6e None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:39.670240 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26bff0-8189-4484-bfbb-bac1efd89564 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:39.711548 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618f63e-9612-4dcb-a9e5-e1286eaa7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:39.712150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618f63e-9612-4dcb-a9e5-e1286eaa7d53 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.712430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618f63e-9612-4dcb-a9e5-e1286eaa7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.712703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618f63e-9612-4dcb-a9e5-e1286eaa7d53 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.713350 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618f63e-9612-4dcb-a9e5-e1286eaa7d53 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:39.713560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca75a9-6587-4876-a58d-02cab90cb513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:39.714017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618f63e-9612-4dcb-a9e5-e1286eaa7d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:39.714878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca75a9-6587-4876-a58d-02cab90cb513 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.715062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618f63e-9612-4dcb-a9e5-e1286eaa7d53 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:39.715521 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca75a9-6587-4876-a58d-02cab90cb513 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.716040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca75a9-6587-4876-a58d-02cab90cb513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.723461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca75a9-6587-4876-a58d-02cab90cb513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:39.725615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca75a9-6587-4876-a58d-02cab90cb513 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:39.728931 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 413/824] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Aug 31 00:08:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:39.729295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618f63e-9612-4dcb-a9e5-e1286eaa7d53 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-3bca75a9-6587-4876-a58d-02cab90cb513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:39.741754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:39.742931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:39.744122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:39.744122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:39.744122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:39.744122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:39.744122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:39.744122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:39.744122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:39.744122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:39.744122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 412/825] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:39.745094 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca75a9-6587-4876-a58d-02cab90cb513 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:39.845234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:39.862632 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618f63e-9612-4dcb-a9e5-e1286eaa7d53 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:39.866503 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca75a9-6587-4876-a58d-02cab90cb513 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:39.876285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:39.898600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fe7ae-2455-4abf-8eec-e20d2d4a26d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:39.899316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fe7ae-2455-4abf-8eec-e20d2d4a26d0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.899608 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fe7ae-2455-4abf-8eec-e20d2d4a26d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.899913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fe7ae-2455-4abf-8eec-e20d2d4a26d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.900844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b9b49-e063-4626-9cc1-7f414dbd4602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:39.901537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b9b49-e063-4626-9cc1-7f414dbd4602 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.901897 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b9b49-e063-4626-9cc1-7f414dbd4602 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.902234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b9b49-e063-4626-9cc1-7f414dbd4602 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.902938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b9b49-e063-4626-9cc1-7f414dbd4602 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:39.903306 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b9b49-e063-4626-9cc1-7f414dbd4602 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:39.904801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b9b49-e063-4626-9cc1-7f414dbd4602 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:39.907020 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fe7ae-2455-4abf-8eec-e20d2d4a26d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:39.908611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fe7ae-2455-4abf-8eec-e20d2d4a26d0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:39.914563 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 413/826] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Aug 31 00:08:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:39.914563 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b9b49-e063-4626-9cc1-7f414dbd4602 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9d4fe7ae-2455-4abf-8eec-e20d2d4a26d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:39.924929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:39.926060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:39.927222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:39.927222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:39.927222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:39.927222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:39.927222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:39.927222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:39.927222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:39.927222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:39.927991 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 414/827] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:39.933002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fe7ae-2455-4abf-8eec-e20d2d4a26d0 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:40.017097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b9b49-e063-4626-9cc1-7f414dbd4602 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:40.030921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fe7ae-2455-4abf-8eec-e20d2d4a26d0 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:40.054241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a22c72-4209-4c30-a586-54347c6c2418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:40.054983 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a22c72-4209-4c30-a586-54347c6c2418 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:40.055327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a22c72-4209-4c30-a586-54347c6c2418 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:40.055731 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a22c72-4209-4c30-a586-54347c6c2418 None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:40.056509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a22c72-4209-4c30-a586-54347c6c2418 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:40.056821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a22c72-4209-4c30-a586-54347c6c2418 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:40.058274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a22c72-4209-4c30-a586-54347c6c2418 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:40.067276 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c187ce-b848-411f-9795-6ea1d7834cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:40.068117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c187ce-b848-411f-9795-6ea1d7834cf7 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:40.068281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c187ce-b848-411f-9795-6ea1d7834cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:40.068549 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c187ce-b848-411f-9795-6ea1d7834cf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:40.069218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c187ce-b848-411f-9795-6ea1d7834cf7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:40.070608 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c187ce-b848-411f-9795-6ea1d7834cf7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:40.076443 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 414/828] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:40.076443 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a22c72-4209-4c30-a586-54347c6c2418 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:40.078821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:40.095748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 415/829] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:08:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:40.095748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c187ce-b848-411f-9795-6ea1d7834cf7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:40.130212 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:40.220622 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a22c72-4209-4c30-a586-54347c6c2418 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:40.252466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c187ce-b848-411f-9795-6ea1d7834cf7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:40.263292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8968cb-aa4a-4a56-8cf2-ddade621b7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:40.264341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8968cb-aa4a-4a56-8cf2-ddade621b7ac None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:40.264341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8968cb-aa4a-4a56-8cf2-ddade621b7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:40.264535 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8968cb-aa4a-4a56-8cf2-ddade621b7ac None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:40.265679 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8968cb-aa4a-4a56-8cf2-ddade621b7ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:40.265990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8968cb-aa4a-4a56-8cf2-ddade621b7ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:40.268477 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8968cb-aa4a-4a56-8cf2-ddade621b7ac None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:40.284044 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 415/830] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:40.289738 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8968cb-aa4a-4a56-8cf2-ddade621b7ac None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:40.296049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63499-0089-488b-8b1f-46d58f407e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:40.296992 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63499-0089-488b-8b1f-46d58f407e9c None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:40.297456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63499-0089-488b-8b1f-46d58f407e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:40.297908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63499-0089-488b-8b1f-46d58f407e9c None admin] PATH_INFO: `/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/bc55768a6d2940f8b9c406bad2c278b6/roles/bf66c83a5d0f41039e44947c9fb18d3c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:40.318346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b63499-0089-488b-8b1f-46d58f407e9c None admin] RBAC: Authorizing `identity:create_grant(project_id=0864c2a6b50f403db79930d0869f8e23, user_id=bc55768a6d2940f8b9c406bad2c278b6, role_id=bf66c83a5d0f41039e44947c9fb18d3c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:40.319852 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b63499-0089-488b-8b1f-46d58f407e9c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:40.343636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 416/831] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:40 2022] PUT /identity/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/bc55768a6d2940f8b9c406bad2c278b6/roles/bf66c83a5d0f41039e44947c9fb18d3c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:08:40.387736 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:40.430034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8968cb-aa4a-4a56-8cf2-ddade621b7ac None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:40.469379 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324913e4-38c8-4930-ae1d-0109bdbce7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:40.470018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324913e4-38c8-4930-ae1d-0109bdbce7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:40.470341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324913e4-38c8-4930-ae1d-0109bdbce7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:40.470619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324913e4-38c8-4930-ae1d-0109bdbce7d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:40.471367 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324913e4-38c8-4930-ae1d-0109bdbce7d8 None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=cb9ef38ec3b448828826de5f76a552d8) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:40.471683 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324913e4-38c8-4930-ae1d-0109bdbce7d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:40.473195 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324913e4-38c8-4930-ae1d-0109bdbce7d8 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:40.480490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 416/832] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:40 2022] GET /identity/v3/role_assignments?user.id=cb9ef38ec3b448828826de5f76a552d8&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:40.706812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdd730-dc60-4d2e-bf88-0c8306681e2c None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:40.707225 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdd730-dc60-4d2e-bf88-0c8306681e2c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:40.707416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdd730-dc60-4d2e-bf88-0c8306681e2c None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:40.709051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 417/833] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:40.714801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace7c0f-3d90-4849-9150-7d31c2c14ca6 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:40.715271 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace7c0f-3d90-4849-9150-7d31c2c14ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:40.715349 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace7c0f-3d90-4849-9150-7d31c2c14ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:40.734155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-6ace7c0f-3d90-4849-9150-7d31c2c14ca6 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:40.735358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6ace7c0f-3d90-4849-9150-7d31c2c14ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:40.805426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 417/834] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:41.069685 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdd730-dc60-4d2e-bf88-0c8306681e2c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:41.148531 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:41.177483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdd730-dc60-4d2e-bf88-0c8306681e2c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:41.213853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01639bbe-4651-4621-8228-71baa7ccda17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:41.214497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01639bbe-4651-4621-8228-71baa7ccda17 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:41.215008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01639bbe-4651-4621-8228-71baa7ccda17 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:41.215287 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01639bbe-4651-4621-8228-71baa7ccda17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:41.225888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01639bbe-4651-4621-8228-71baa7ccda17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-01639bbe-4651-4621-8228-71baa7ccda17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:41.230699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:41.231661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:41.232600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:41.232600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:41.232600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:41.232600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:41.232600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:41.232600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:41.232600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:41.232600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:41.232600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:41.232600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:41.232600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:41.232600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:41.232600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 418/835] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:41.238233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace7c0f-3d90-4849-9150-7d31c2c14ca6 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:41.300517 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:41.345561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace7c0f-3d90-4849-9150-7d31c2c14ca6 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:41.380000 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a116d9-bc2d-4690-a1bf-94ed365507d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:41.380837 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a116d9-bc2d-4690-a1bf-94ed365507d5 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:41.381262 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a116d9-bc2d-4690-a1bf-94ed365507d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:41.381677 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a116d9-bc2d-4690-a1bf-94ed365507d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:41.382494 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a116d9-bc2d-4690-a1bf-94ed365507d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:41.382965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a116d9-bc2d-4690-a1bf-94ed365507d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:41.384531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a116d9-bc2d-4690-a1bf-94ed365507d5 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:41.394600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 418/836] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:41.403376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01639bbe-4651-4621-8228-71baa7ccda17 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:41.504860 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01639bbe-4651-4621-8228-71baa7ccda17 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:41.541254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a30bcd-9ad3-4c09-8d11-f4a6d1cfc709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:41.541920 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a30bcd-9ad3-4c09-8d11-f4a6d1cfc709 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:41.542268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a30bcd-9ad3-4c09-8d11-f4a6d1cfc709 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:41.542549 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a30bcd-9ad3-4c09-8d11-f4a6d1cfc709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:41.550675 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:41.556399 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a30bcd-9ad3-4c09-8d11-f4a6d1cfc709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:41.557882 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a30bcd-9ad3-4c09-8d11-f4a6d1cfc709 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-61a30bcd-9ad3-4c09-8d11-f4a6d1cfc709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:41.574562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:41.575588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:41.576573 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:41.576573 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:41.576573 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:41.580056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 419/837] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:41.581990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a116d9-bc2d-4690-a1bf-94ed365507d5 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:41.687906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a116d9-bc2d-4690-a1bf-94ed365507d5 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:41.709583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:41.725058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8912a3-4632-4250-a1f6-d77fbd328597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:41.726320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8912a3-4632-4250-a1f6-d77fbd328597 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:41.726773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8912a3-4632-4250-a1f6-d77fbd328597 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:41.727193 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8912a3-4632-4250-a1f6-d77fbd328597 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:41.728015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8912a3-4632-4250-a1f6-d77fbd328597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:41.728461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8912a3-4632-4250-a1f6-d77fbd328597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:41.730016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8912a3-4632-4250-a1f6-d77fbd328597 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:41.742654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 419/838] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:41.748271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a30bcd-9ad3-4c09-8d11-f4a6d1cfc709 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:41.860181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a30bcd-9ad3-4c09-8d11-f4a6d1cfc709 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:41.894947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7f6e6-0966-4ac0-9555-8c20f9af3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:41.895588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7f6e6-0966-4ac0-9555-8c20f9af3ced None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:41.895906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7f6e6-0966-4ac0-9555-8c20f9af3ced None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:41.896191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7f6e6-0966-4ac0-9555-8c20f9af3ced None admin] PATH_INFO: `/v3/users/swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:41.904016 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7f6e6-0966-4ac0-9555-8c20f9af3ced None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:41.905483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7f6e6-0966-4ac0-9555-8c20f9af3ced None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-1fe7f6e6-0966-4ac0-9555-8c20f9af3ced None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:41.916881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:41.918090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:41.919376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:41.919376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:41.919376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:41.919376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:41.919376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:41.919376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:41.919376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:41.919376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:41.919376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:08:41.919376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:41.919376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 420/839] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:41.924202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8912a3-4632-4250-a1f6-d77fbd328597 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:42.036169 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8912a3-4632-4250-a1f6-d77fbd328597 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:42.073110 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ced827-626b-47cd-b883-9c24aed7ac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:42.074026 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ced827-626b-47cd-b883-9c24aed7ac79 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.074513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ced827-626b-47cd-b883-9c24aed7ac79 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.074930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ced827-626b-47cd-b883-9c24aed7ac79 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.075836 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ced827-626b-47cd-b883-9c24aed7ac79 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:42.076288 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ced827-626b-47cd-b883-9c24aed7ac79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:42.077907 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ced827-626b-47cd-b883-9c24aed7ac79 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:42.089233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ef737-e5e5-422f-8263-6a53a4f75fc3 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.089519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ef737-e5e5-422f-8263-6a53a4f75fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.089788 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ef737-e5e5-422f-8263-6a53a4f75fc3 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.092402 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 421/840] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:42.096735 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cfe79-668b-478f-beaf-9c74b9fb9d36 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.097012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cfe79-668b-478f-beaf-9c74b9fb9d36 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.097283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cfe79-668b-478f-beaf-9c74b9fb9d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.098203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 420/841] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Aug 31 00:08:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:42.104642 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ced827-626b-47cd-b883-9c24aed7ac79 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:42.118777 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-347cfe79-668b-478f-beaf-9c74b9fb9d36 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:42.120335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-347cfe79-668b-478f-beaf-9c74b9fb9d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:42.155629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:42.173739 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:42.212937 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 422/842] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:42.231965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ced827-626b-47cd-b883-9c24aed7ac79 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:42.266972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff13ba-fff6-4d01-aa23-a031f72c7628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:42.267620 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff13ba-fff6-4d01-aa23-a031f72c7628 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.267941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff13ba-fff6-4d01-aa23-a031f72c7628 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.268371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff13ba-fff6-4d01-aa23-a031f72c7628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.342051 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff13ba-fff6-4d01-aa23-a031f72c7628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:42.343530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff13ba-fff6-4d01-aa23-a031f72c7628 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:42.387630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:42.450575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0056d-37e0-4bb3-a0b7-323f21a335da None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.451121 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 421/843] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:42 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:42.451218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0056d-37e0-4bb3-a0b7-323f21a335da None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.451218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0056d-37e0-4bb3-a0b7-323f21a335da None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.452711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 423/844] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:42.457199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff13ba-fff6-4d01-aa23-a031f72c7628 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:42.457590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf5400-0c2f-45d9-b629-a454c729728f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.457877 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf5400-0c2f-45d9-b629-a454c729728f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.458149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf5400-0c2f-45d9-b629-a454c729728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.477377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-64cf5400-0c2f-45d9-b629-a454c729728f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:42.478618 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-64cf5400-0c2f-45d9-b629-a454c729728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:42.545562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 424/845] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:42.546454 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf5400-0c2f-45d9-b629-a454c729728f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:42.558704 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff13ba-fff6-4d01-aa23-a031f72c7628 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:42.599880 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241408e5-8344-4d16-b77a-23facc2cc35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:42.600441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241408e5-8344-4d16-b77a-23facc2cc35d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.600720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241408e5-8344-4d16-b77a-23facc2cc35d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.600988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241408e5-8344-4d16-b77a-23facc2cc35d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.608872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:42.613421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241408e5-8344-4d16-b77a-23facc2cc35d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:42.615229 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241408e5-8344-4d16-b77a-23facc2cc35d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-241408e5-8344-4d16-b77a-23facc2cc35d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:42.629670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:42.630668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:42.631570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:42.631570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:42.631570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:42.635385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 422/846] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:42.636580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5b86-2884-4757-8607-2dafa680685f None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.636874 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5b86-2884-4757-8607-2dafa680685f None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.637151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf5b86-2884-4757-8607-2dafa680685f None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.638435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 423/847] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:42.639120 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf5b86-2884-4757-8607-2dafa680685f None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:42.656764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf5400-0c2f-45d9-b629-a454c729728f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:42.665760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:42.696633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aae014-cf73-43c7-a2b3-9febc7b5c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:42.697401 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aae014-cf73-43c7-a2b3-9febc7b5c675 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.697690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aae014-cf73-43c7-a2b3-9febc7b5c675 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.698022 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aae014-cf73-43c7-a2b3-9febc7b5c675 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.699046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aae014-cf73-43c7-a2b3-9febc7b5c675 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:42.700531 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aae014-cf73-43c7-a2b3-9febc7b5c675 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-d1aae014-cf73-43c7-a2b3-9febc7b5c675 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:42.709411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:42.710647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:42.711524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 425/848] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:42.712471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6781-de8b-492e-892c-b4f7640f4574 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.712471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6781-de8b-492e-892c-b4f7640f4574 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.712615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6781-de8b-492e-892c-b4f7640f4574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.731410 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-978d6781-de8b-492e-892c-b4f7640f4574 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:42.732639 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-978d6781-de8b-492e-892c-b4f7640f4574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:42.753599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf5b86-2884-4757-8607-2dafa680685f None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:42.791463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c04ae-310c-44c3-b206-0f0052993fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:42.792202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c04ae-310c-44c3-b206-0f0052993fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.792485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c04ae-310c-44c3-b206-0f0052993fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.792757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c04ae-310c-44c3-b206-0f0052993fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.793569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c04ae-310c-44c3-b206-0f0052993fc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:42.793991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c04ae-310c-44c3-b206-0f0052993fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:42.795430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c04ae-310c-44c3-b206-0f0052993fc5 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:42.798330 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 426/849] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:42.799356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d6781-de8b-492e-892c-b4f7640f4574 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:42.814479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 424/850] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:42.816100 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c04ae-310c-44c3-b206-0f0052993fc5 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:42.875946 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:42.911791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:42.915110 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d6781-de8b-492e-892c-b4f7640f4574 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:42.935285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c04ae-310c-44c3-b206-0f0052993fc5 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:42.950568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c838bc-7493-4889-b218-afb6f35a7a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:42.951175 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c838bc-7493-4889-b218-afb6f35a7a78 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.951445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c838bc-7493-4889-b218-afb6f35a7a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.951732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c838bc-7493-4889-b218-afb6f35a7a78 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.952379 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c838bc-7493-4889-b218-afb6f35a7a78 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:42.952678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c838bc-7493-4889-b218-afb6f35a7a78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:42.954056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c838bc-7493-4889-b218-afb6f35a7a78 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:42.959742 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 427/851] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:42.959742 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c838bc-7493-4889-b218-afb6f35a7a78 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:42.976607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02baf35-afc8-465a-a506-f5a93bf3fb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:42.977467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02baf35-afc8-465a-a506-f5a93bf3fb23 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.977908 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02baf35-afc8-465a-a506-f5a93bf3fb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.978322 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02baf35-afc8-465a-a506-f5a93bf3fb23 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.979162 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02baf35-afc8-465a-a506-f5a93bf3fb23 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:42.980853 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02baf35-afc8-465a-a506-f5a93bf3fb23 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-d02baf35-afc8-465a-a506-f5a93bf3fb23 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:42.990522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:42.991819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:42.992960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:42.992960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:42.992960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:42.992960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:42.992960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:42.992960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:42.992960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:42.992960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:42.992960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:42.992960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:42.992960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:42.992960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:42.992960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:42.992960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:42.995408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 425/852] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Aug 31 00:08:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:42.996360 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02baf35-afc8-465a-a506-f5a93bf3fb23 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:43.061535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c838bc-7493-4889-b218-afb6f35a7a78 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:43.095994 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234df27f-b96c-4294-8085-bd9aa787bd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:43.096631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234df27f-b96c-4294-8085-bd9aa787bd8f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:43.096908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234df27f-b96c-4294-8085-bd9aa787bd8f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:43.097179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234df27f-b96c-4294-8085-bd9aa787bd8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:43.101920 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02baf35-afc8-465a-a506-f5a93bf3fb23 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:43.103778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234df27f-b96c-4294-8085-bd9aa787bd8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:43.105231 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234df27f-b96c-4294-8085-bd9aa787bd8f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-234df27f-b96c-4294-8085-bd9aa787bd8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:43.116303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:43.117265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:43.118197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:43.118197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:43.118197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:43.118197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:43.118197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:43.118197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:43.118197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:43.118197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:43.118197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 428/853] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:43.118197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234df27f-b96c-4294-8085-bd9aa787bd8f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:43.119621 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:43.140744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e618ce9-fe3e-4d53-9d24-b8842b505545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:43.141350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618ce9-fe3e-4d53-9d24-b8842b505545 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:43.141626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618ce9-fe3e-4d53-9d24-b8842b505545 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:43.141899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618ce9-fe3e-4d53-9d24-b8842b505545 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:43.142626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e618ce9-fe3e-4d53-9d24-b8842b505545 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:43.142926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e618ce9-fe3e-4d53-9d24-b8842b505545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:43.144358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e618ce9-fe3e-4d53-9d24-b8842b505545 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:43.144730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:43.149069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 426/854] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:43.149840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e618ce9-fe3e-4d53-9d24-b8842b505545 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:43.248132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234df27f-b96c-4294-8085-bd9aa787bd8f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:43.271257 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e618ce9-fe3e-4d53-9d24-b8842b505545 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:43.296424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8829cd5-9b5a-423c-8f52-10ff3181979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:43.297091 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8829cd5-9b5a-423c-8f52-10ff3181979c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:43.297370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8829cd5-9b5a-423c-8f52-10ff3181979c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:43.297668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8829cd5-9b5a-423c-8f52-10ff3181979c None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:43.298292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8829cd5-9b5a-423c-8f52-10ff3181979c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:43.298590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8829cd5-9b5a-423c-8f52-10ff3181979c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:43.300167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8829cd5-9b5a-423c-8f52-10ff3181979c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:43.305848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 429/855] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:43.308333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8829cd5-9b5a-423c-8f52-10ff3181979c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:43.316673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9128d62-a930-4cd1-9518-9ff9aa7b0146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:43.317331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9128d62-a930-4cd1-9518-9ff9aa7b0146 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:43.317610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9128d62-a930-4cd1-9518-9ff9aa7b0146 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:43.317879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9128d62-a930-4cd1-9518-9ff9aa7b0146 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:43.328679 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9128d62-a930-4cd1-9518-9ff9aa7b0146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-e9128d62-a930-4cd1-9518-9ff9aa7b0146 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:43.333932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:43.334921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:43.335865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:43.335865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:43.335865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:43.335865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:43.335865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:43.335865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:43.335865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:43.335865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:43.335865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:43.335865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:43.335865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:08:43.335865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:43.335865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 427/856] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:08:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:43.336597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9128d62-a930-4cd1-9518-9ff9aa7b0146 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:43.382729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:43.402963 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:43.416545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8829cd5-9b5a-423c-8f52-10ff3181979c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:43.451120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fca637-16af-4ad4-a0e2-125d0a5d7e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:43.451788 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fca637-16af-4ad4-a0e2-125d0a5d7e8a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:43.452050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fca637-16af-4ad4-a0e2-125d0a5d7e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:43.452325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fca637-16af-4ad4-a0e2-125d0a5d7e8a None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:43.453028 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fca637-16af-4ad4-a0e2-125d0a5d7e8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:43.453333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fca637-16af-4ad4-a0e2-125d0a5d7e8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:43.454772 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fca637-16af-4ad4-a0e2-125d0a5d7e8a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:43.462680 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9128d62-a930-4cd1-9518-9ff9aa7b0146 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:43.467610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 430/857] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:43.468453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fca637-16af-4ad4-a0e2-125d0a5d7e8a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:43.500676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab48c0-1b65-420d-97af-3bbf7893d087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:43.501597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab48c0-1b65-420d-97af-3bbf7893d087 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:43.502099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab48c0-1b65-420d-97af-3bbf7893d087 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:43.502533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab48c0-1b65-420d-97af-3bbf7893d087 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:43.503345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab48c0-1b65-420d-97af-3bbf7893d087 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:43.503796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab48c0-1b65-420d-97af-3bbf7893d087 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:43.505103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab48c0-1b65-420d-97af-3bbf7893d087 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:43.510589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 428/858] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:43.516735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab48c0-1b65-420d-97af-3bbf7893d087 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:43.604784 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fca637-16af-4ad4-a0e2-125d0a5d7e8a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:43.632424 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab48c0-1b65-420d-97af-3bbf7893d087 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:43.634254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:43.653524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6ab9d-04ca-4ca1-9093-7c77bce335a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:43.654500 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6ab9d-04ca-4ca1-9093-7c77bce335a7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:43.654855 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6ab9d-04ca-4ca1-9093-7c77bce335a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:43.655205 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6ab9d-04ca-4ca1-9093-7c77bce335a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:43.656005 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6ab9d-04ca-4ca1-9093-7c77bce335a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:43.656381 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6ab9d-04ca-4ca1-9093-7c77bce335a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:43.658689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6ab9d-04ca-4ca1-9093-7c77bce335a7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:43.668684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 431/859] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:08:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:43.672276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01609b3-affa-4205-8fd7-a475e80166ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:43.672930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01609b3-affa-4205-8fd7-a475e80166ae None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:43.673160 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01609b3-affa-4205-8fd7-a475e80166ae None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:43.673432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01609b3-affa-4205-8fd7-a475e80166ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:43.674200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01609b3-affa-4205-8fd7-a475e80166ae None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=ac02a26fe2a44b7db623003d1a96ed36) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:43.674303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6ab9d-04ca-4ca1-9093-7c77bce335a7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:43.674501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01609b3-affa-4205-8fd7-a475e80166ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:43.676421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01609b3-affa-4205-8fd7-a475e80166ae None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:43.684347 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 429/860] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:43 2022] GET /identity/v3/role_assignments?user.id=ac02a26fe2a44b7db623003d1a96ed36&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:43.692835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:43.797517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6ab9d-04ca-4ca1-9093-7c77bce335a7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:43.836483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa578376-e9f9-47ff-8f0e-ed2b5bf799ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:43.837203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa578376-e9f9-47ff-8f0e-ed2b5bf799ac None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:43.837485 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa578376-e9f9-47ff-8f0e-ed2b5bf799ac None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:43.837759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa578376-e9f9-47ff-8f0e-ed2b5bf799ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:43.849311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa578376-e9f9-47ff-8f0e-ed2b5bf799ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:43.850789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa578376-e9f9-47ff-8f0e-ed2b5bf799ac None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-fa578376-e9f9-47ff-8f0e-ed2b5bf799ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:43.865833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:43.866849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:43.868600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:43.868600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:43.868600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:43.868600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 432/861] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:43.873103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01609b3-affa-4205-8fd7-a475e80166ae None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:43.973469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01609b3-affa-4205-8fd7-a475e80166ae None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:44.010253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5371821-45ce-4e89-ba73-9acbed9637d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:44.011178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5371821-45ce-4e89-ba73-9acbed9637d3 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:44.011637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5371821-45ce-4e89-ba73-9acbed9637d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:44.012115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5371821-45ce-4e89-ba73-9acbed9637d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:44.012940 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5371821-45ce-4e89-ba73-9acbed9637d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:44.013444 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5371821-45ce-4e89-ba73-9acbed9637d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:44.014997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5371821-45ce-4e89-ba73-9acbed9637d3 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:44.032121 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 430/862] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:44.034099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa578376-e9f9-47ff-8f0e-ed2b5bf799ac None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:44.098856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:44.138850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa578376-e9f9-47ff-8f0e-ed2b5bf799ac None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:44.176796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb2d34-3c21-4801-a459-4aeb75ef75ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:44.177442 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb2d34-3c21-4801-a459-4aeb75ef75ff None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:44.177722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb2d34-3c21-4801-a459-4aeb75ef75ff None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:44.177996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb2d34-3c21-4801-a459-4aeb75ef75ff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:44.186182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb2d34-3c21-4801-a459-4aeb75ef75ff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:44.187671 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb2d34-3c21-4801-a459-4aeb75ef75ff None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-a8fb2d34-3c21-4801-a459-4aeb75ef75ff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:44.200578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:44.201648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:44.202781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:44.202781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:44.202781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:44.202781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:44.202781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:44.202781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:44.202781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:44.202781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:44.202781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:44.202781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:44.202781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 433/863] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 31 00:08:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:44.207983 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5371821-45ce-4e89-ba73-9acbed9637d3 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:44.236224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:44.314051 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5371821-45ce-4e89-ba73-9acbed9637d3 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:44.349001 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991adeb6-da0e-4f1f-92c4-6da48dfd7ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:44.349616 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991adeb6-da0e-4f1f-92c4-6da48dfd7ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:44.349892 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991adeb6-da0e-4f1f-92c4-6da48dfd7ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:44.350163 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991adeb6-da0e-4f1f-92c4-6da48dfd7ca3 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:44.350897 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991adeb6-da0e-4f1f-92c4-6da48dfd7ca3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:44.351199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991adeb6-da0e-4f1f-92c4-6da48dfd7ca3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:44.352684 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991adeb6-da0e-4f1f-92c4-6da48dfd7ca3 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:44.370801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 431/864] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Aug 31 00:08:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:44.376407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb2d34-3c21-4801-a459-4aeb75ef75ff None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:44.483676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb2d34-3c21-4801-a459-4aeb75ef75ff None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:44.506436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:44.518554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ee540-ac59-466b-9b18-fe70d9805cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:44.519240 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ee540-ac59-466b-9b18-fe70d9805cae None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:44.519522 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ee540-ac59-466b-9b18-fe70d9805cae None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:44.519827 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ee540-ac59-466b-9b18-fe70d9805cae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:44.591103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ee540-ac59-466b-9b18-fe70d9805cae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:44.592716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ee540-ac59-466b-9b18-fe70d9805cae None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:44.700673 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 434/865] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:44.706406 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991adeb6-da0e-4f1f-92c4-6da48dfd7ca3 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:44.790552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:44.806774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991adeb6-da0e-4f1f-92c4-6da48dfd7ca3 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:44.841702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bcf79-7c7d-4d00-bc19-cadda9669f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:44.842345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bcf79-7c7d-4d00-bc19-cadda9669f74 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:44.842626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bcf79-7c7d-4d00-bc19-cadda9669f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:44.842899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bcf79-7c7d-4d00-bc19-cadda9669f74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:44.853458 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bcf79-7c7d-4d00-bc19-cadda9669f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:44.855015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bcf79-7c7d-4d00-bc19-cadda9669f74 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-323bcf79-7c7d-4d00-bc19-cadda9669f74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:44.872386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:44.873840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:44.874774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:44.874774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:44.874774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:44.877028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 432/866] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:44.882488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ee540-ac59-466b-9b18-fe70d9805cae None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:44.916140 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:44.992181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ee540-ac59-466b-9b18-fe70d9805cae None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:45.031204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156201b0-565e-4773-8e81-f16239d00d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:45.031904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156201b0-565e-4773-8e81-f16239d00d99 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.032186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156201b0-565e-4773-8e81-f16239d00d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.032461 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156201b0-565e-4773-8e81-f16239d00d99 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.033201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156201b0-565e-4773-8e81-f16239d00d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:45.033523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156201b0-565e-4773-8e81-f16239d00d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:45.034933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156201b0-565e-4773-8e81-f16239d00d99 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:45.047228 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 435/867] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:45.052898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bcf79-7c7d-4d00-bc19-cadda9669f74 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:45.155896 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bcf79-7c7d-4d00-bc19-cadda9669f74 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:45.172260 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355041d-f365-4f46-b296-6831358b77e5 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.172552 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355041d-f365-4f46-b296-6831358b77e5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.172886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355041d-f365-4f46-b296-6831358b77e5 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.174570 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 436/868] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:45.179518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9bae6-e031-438f-87fa-9760de261027 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.179830 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9bae6-e031-438f-87fa-9760de261027 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.180104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9bae6-e031-438f-87fa-9760de261027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.196231 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac636f3a-2864-42fd-9267-df54764d45d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:45.197146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac636f3a-2864-42fd-9267-df54764d45d0 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.197569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac636f3a-2864-42fd-9267-df54764d45d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.197981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac636f3a-2864-42fd-9267-df54764d45d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.201309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:45.202460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-73f9bae6-e031-438f-87fa-9760de261027 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:45.203796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-73f9bae6-e031-438f-87fa-9760de261027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:45.207328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac636f3a-2864-42fd-9267-df54764d45d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:45.209233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac636f3a-2864-42fd-9267-df54764d45d0 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-ac636f3a-2864-42fd-9267-df54764d45d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:45.221461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:45.222713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:45.223661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:45.223661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:45.223661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:45.223661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:45.223661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:45.223661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:45.223661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:45.223661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:45.225098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 433/869] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:45.230949 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac636f3a-2864-42fd-9267-df54764d45d0 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:45.288601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 437/870] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:45.341729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac636f3a-2864-42fd-9267-df54764d45d0 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:45.377547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672e890-5b37-4e92-b545-424544ddd0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:45.378543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672e890-5b37-4e92-b545-424544ddd0fe None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.379023 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672e890-5b37-4e92-b545-424544ddd0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.379504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672e890-5b37-4e92-b545-424544ddd0fe None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.380539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672e890-5b37-4e92-b545-424544ddd0fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:45.381057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672e890-5b37-4e92-b545-424544ddd0fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:45.382730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672e890-5b37-4e92-b545-424544ddd0fe None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:45.396422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 434/871] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:45.402849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9bae6-e031-438f-87fa-9760de261027 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:45.418433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:45.507376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9bae6-e031-438f-87fa-9760de261027 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:45.544815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79c541-8a86-4397-8c5a-a1f2ce2d0b76 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.545161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79c541-8a86-4397-8c5a-a1f2ce2d0b76 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.545374 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79c541-8a86-4397-8c5a-a1f2ce2d0b76 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.546653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f83d93-7bb6-4948-bc79-5861043780c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:45.547048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 435/872] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:45.547278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83d93-7bb6-4948-bc79-5861043780c2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.547560 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83d93-7bb6-4948-bc79-5861043780c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.547865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83d93-7bb6-4948-bc79-5861043780c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.548690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f83d93-7bb6-4948-bc79-5861043780c2 None admin] RBAC: Adding query filter params (role.id=bf66c83a5d0f41039e44947c9fb18d3c, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=bc55768a6d2940f8b9c406bad2c278b6) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:45.549057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f83d93-7bb6-4948-bc79-5861043780c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:45.550492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f83d93-7bb6-4948-bc79-5861043780c2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:45.552085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031c830-44c8-4caa-8c5f-ad5b134d9ae5 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.552373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031c830-44c8-4caa-8c5f-ad5b134d9ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.552655 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031c830-44c8-4caa-8c5f-ad5b134d9ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.557308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 438/873] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:45 2022] GET /identity/v3/role_assignments?user.id=bc55768a6d2940f8b9c406bad2c278b6&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=bf66c83a5d0f41039e44947c9fb18d3c => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:45.569966 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f83d93-7bb6-4948-bc79-5861043780c2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:45.579429 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5031c830-44c8-4caa-8c5f-ad5b134d9ae5 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:45.581536 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5031c830-44c8-4caa-8c5f-ad5b134d9ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:45.656047 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:45.660525 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:45.680652 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 436/874] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:45.693932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f83d93-7bb6-4948-bc79-5861043780c2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:45.731876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c411143-be5e-487a-a176-bdad6e4d6065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:45.732744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c411143-be5e-487a-a176-bdad6e4d6065 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.733195 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c411143-be5e-487a-a176-bdad6e4d6065 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.733611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c411143-be5e-487a-a176-bdad6e4d6065 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.734404 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c411143-be5e-487a-a176-bdad6e4d6065 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:45.735970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c411143-be5e-487a-a176-bdad6e4d6065 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:45.753445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 439/875] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 31 00:08:45 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:08:45.807076 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211a5c-8864-48e2-a7f5-2980a711ca20 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.807359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211a5c-8864-48e2-a7f5-2980a711ca20 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.807630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211a5c-8864-48e2-a7f5-2980a711ca20 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.809515 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 437/876] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:45.816148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605b687-0555-407b-9de5-d88e16b42906 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.816681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605b687-0555-407b-9de5-d88e16b42906 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.817123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605b687-0555-407b-9de5-d88e16b42906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.838155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-0605b687-0555-407b-9de5-d88e16b42906 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:45.839632 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0605b687-0555-407b-9de5-d88e16b42906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:45.924613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 440/877] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:45.946775 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4211a5c-8864-48e2-a7f5-2980a711ca20 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:46.056810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4211a5c-8864-48e2-a7f5-2980a711ca20 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:46.092528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f97145-f915-4480-a653-110c0fbd3c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:46.093525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f97145-f915-4480-a653-110c0fbd3c5c None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:46.094004 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f97145-f915-4480-a653-110c0fbd3c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:46.094475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f97145-f915-4480-a653-110c0fbd3c5c None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:46.095399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f97145-f915-4480-a653-110c0fbd3c5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:46.097115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f97145-f915-4480-a653-110c0fbd3c5c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:46.117973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 438/878] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 31 00:08:45 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:46.196568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605b687-0555-407b-9de5-d88e16b42906 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:46.266412 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:46.312184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605b687-0555-407b-9de5-d88e16b42906 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:46.354335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad484e2a-85fb-4f78-a2f9-369545a0147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:46.355000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad484e2a-85fb-4f78-a2f9-369545a0147c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:46.355281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad484e2a-85fb-4f78-a2f9-369545a0147c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:46.355553 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad484e2a-85fb-4f78-a2f9-369545a0147c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:46.356181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad484e2a-85fb-4f78-a2f9-369545a0147c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:46.357640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad484e2a-85fb-4f78-a2f9-369545a0147c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-ad484e2a-85fb-4f78-a2f9-369545a0147c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:46.366964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:46.368043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:46.368947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 441/879] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:46.374295 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f97145-f915-4480-a653-110c0fbd3c5c None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:46.422125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:46.484296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f97145-f915-4480-a653-110c0fbd3c5c None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:46.519325 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b5ff2-de12-4e95-8a8a-ed45795337b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:46.520273 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b5ff2-de12-4e95-8a8a-ed45795337b6 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:46.520695 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b5ff2-de12-4e95-8a8a-ed45795337b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:46.521107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b5ff2-de12-4e95-8a8a-ed45795337b6 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:46.521886 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b5ff2-de12-4e95-8a8a-ed45795337b6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:46.522364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b5ff2-de12-4e95-8a8a-ed45795337b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:46.523937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b5ff2-de12-4e95-8a8a-ed45795337b6 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:46.529309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 439/880] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:46.537779 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad484e2a-85fb-4f78-a2f9-369545a0147c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:46.647371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad484e2a-85fb-4f78-a2f9-369545a0147c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:46.671204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:46.686649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac9ea5-eec0-49a0-ab5a-757d663c6e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:46.687282 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac9ea5-eec0-49a0-ab5a-757d663c6e49 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:46.687559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac9ea5-eec0-49a0-ab5a-757d663c6e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:46.687858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac9ea5-eec0-49a0-ab5a-757d663c6e49 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:46.688497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac9ea5-eec0-49a0-ab5a-757d663c6e49 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:46.688798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac9ea5-eec0-49a0-ab5a-757d663c6e49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:46.690274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac9ea5-eec0-49a0-ab5a-757d663c6e49 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:46.695631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 442/881] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:47.633532 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a3aa-f08a-4d91-8176-ecf6ad93f975 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:47.634604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a3aa-f08a-4d91-8176-ecf6ad93f975 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:47.635096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a3aa-f08a-4d91-8176-ecf6ad93f975 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:47.637074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 440/882] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:47.642815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134f895-a390-4e59-8960-b30a24abc93c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:47.643780 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134f895-a390-4e59-8960-b30a24abc93c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:47.644284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134f895-a390-4e59-8960-b30a24abc93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:47.663629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b134f895-a390-4e59-8960-b30a24abc93c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:47.665189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b134f895-a390-4e59-8960-b30a24abc93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:47.737946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 443/883] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:47.781820 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a702bc-12e6-450b-af9d-c0ee16bff1bf None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:47.782180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a702bc-12e6-450b-af9d-c0ee16bff1bf None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:47.782374 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a702bc-12e6-450b-af9d-c0ee16bff1bf None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:47.784231 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 441/884] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:47.793506 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143afaa-a840-473b-8e9c-f2b9de97e3ef None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:47.794112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143afaa-a840-473b-8e9c-f2b9de97e3ef None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:47.794619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143afaa-a840-473b-8e9c-f2b9de97e3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:47.813586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-5143afaa-a840-473b-8e9c-f2b9de97e3ef None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:47.815183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5143afaa-a840-473b-8e9c-f2b9de97e3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:47.886362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 444/885] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:48.002971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a702bc-12e6-450b-af9d-c0ee16bff1bf None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:48.114098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a702bc-12e6-450b-af9d-c0ee16bff1bf None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:48.125782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:48.150263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb425fe2-bffd-4bd4-af66-b69e1b9609f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:48.150808 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb425fe2-bffd-4bd4-af66-b69e1b9609f8 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.151091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb425fe2-bffd-4bd4-af66-b69e1b9609f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.151367 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb425fe2-bffd-4bd4-af66-b69e1b9609f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.162810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb425fe2-bffd-4bd4-af66-b69e1b9609f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-bb425fe2-bffd-4bd4-af66-b69e1b9609f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:48.167800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:48.168740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:48.169753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:48.169753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:48.169753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:48.169753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:48.169753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:48.169753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:48.169753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:48.169753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:48.169753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:48.169753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:48.169753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:48.169753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:48.170560 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143afaa-a840-473b-8e9c-f2b9de97e3ef None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:48.170656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 442/886] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Aug 31 00:08:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:48.177689 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb425fe2-bffd-4bd4-af66-b69e1b9609f8 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:48.221623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:48.277588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143afaa-a840-473b-8e9c-f2b9de97e3ef None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:48.283440 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb425fe2-bffd-4bd4-af66-b69e1b9609f8 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:48.314831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8a5fc-ea9d-4ef8-a038-368ae43d4b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:48.315942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8a5fc-ea9d-4ef8-a038-368ae43d4b30 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.316616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8a5fc-ea9d-4ef8-a038-368ae43d4b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.316895 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8a5fc-ea9d-4ef8-a038-368ae43d4b30 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.317492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8a5fc-ea9d-4ef8-a038-368ae43d4b30 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:48.318875 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8a5fc-ea9d-4ef8-a038-368ae43d4b30 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:48.320470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdad852-3b25-4adb-ae2c-f86b2e170cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:48.321193 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdad852-3b25-4adb-ae2c-f86b2e170cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.321578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdad852-3b25-4adb-ae2c-f86b2e170cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.321857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdad852-3b25-4adb-ae2c-f86b2e170cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.322524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdad852-3b25-4adb-ae2c-f86b2e170cc7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:48.322831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdad852-3b25-4adb-ae2c-f86b2e170cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:48.324225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdad852-3b25-4adb-ae2c-f86b2e170cc7 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-d3a8a5fc-ea9d-4ef8-a038-368ae43d4b30 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:48.328152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:48.329167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:48.330066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 445/887] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:48.332332 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bd295-c69b-4209-ba1c-ff7abe874d19 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.332332 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bd295-c69b-4209-ba1c-ff7abe874d19 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.332332 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bd295-c69b-4209-ba1c-ff7abe874d19 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.332755 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 446/888] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:48.336532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bd295-c69b-4209-ba1c-ff7abe874d19 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:48.337461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 443/889] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Aug 31 00:08:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:48.342905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ec901-99f1-4571-8ec9-0de92204187f None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.343191 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ec901-99f1-4571-8ec9-0de92204187f None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.343470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ec901-99f1-4571-8ec9-0de92204187f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.361180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-329ec901-99f1-4571-8ec9-0de92204187f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:48.362403 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-329ec901-99f1-4571-8ec9-0de92204187f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:48.389161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:48.434668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 444/890] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:48.435751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ec901-99f1-4571-8ec9-0de92204187f None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:48.456070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bd295-c69b-4209-ba1c-ff7abe874d19 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:48.468285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:48.495361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0cdcf-dae3-490d-bbab-5c4318b90873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:48.496272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0cdcf-dae3-490d-bbab-5c4318b90873 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.496787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0cdcf-dae3-490d-bbab-5c4318b90873 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.497273 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0cdcf-dae3-490d-bbab-5c4318b90873 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.498120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0cdcf-dae3-490d-bbab-5c4318b90873 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:48.498627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0cdcf-dae3-490d-bbab-5c4318b90873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:48.500342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0cdcf-dae3-490d-bbab-5c4318b90873 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:48.505998 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 447/891] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:48.511260 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0cdcf-dae3-490d-bbab-5c4318b90873 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:48.558920 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ec901-99f1-4571-8ec9-0de92204187f None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:48.595249 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efea97-0ed2-4812-abc1-bc7f43867f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:48.595909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efea97-0ed2-4812-abc1-bc7f43867f06 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.596225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efea97-0ed2-4812-abc1-bc7f43867f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.596493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efea97-0ed2-4812-abc1-bc7f43867f06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.607337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efea97-0ed2-4812-abc1-bc7f43867f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:48.608851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efea97-0ed2-4812-abc1-bc7f43867f06 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:48.622668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0cdcf-dae3-490d-bbab-5c4318b90873 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-26efea97-0ed2-4812-abc1-bc7f43867f06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:48.624560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:48.625547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:48.626499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:48.626499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:48.626499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:48.627844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 445/892] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:48.630157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441114e-4ab5-45bd-8053-fd9cbcb3ba96 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.630656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441114e-4ab5-45bd-8053-fd9cbcb3ba96 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.630934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441114e-4ab5-45bd-8053-fd9cbcb3ba96 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.632410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 446/893] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:48.632970 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441114e-4ab5-45bd-8053-fd9cbcb3ba96 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:48.650818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:48.665376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54ced2-1e1b-4ce4-aa47-8f3807a679f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:48.666081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ced2-1e1b-4ce4-aa47-8f3807a679f0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.666360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ced2-1e1b-4ce4-aa47-8f3807a679f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.666632 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ced2-1e1b-4ce4-aa47-8f3807a679f0 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.667275 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54ced2-1e1b-4ce4-aa47-8f3807a679f0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:48.667575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54ced2-1e1b-4ce4-aa47-8f3807a679f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:48.668990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54ced2-1e1b-4ce4-aa47-8f3807a679f0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:48.678670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 448/894] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:48.678670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80488b44-e012-4486-9115-09f81d3cd475 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.678670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80488b44-e012-4486-9115-09f81d3cd475 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.678670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80488b44-e012-4486-9115-09f81d3cd475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.696311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-80488b44-e012-4486-9115-09f81d3cd475 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:48.697442 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-80488b44-e012-4486-9115-09f81d3cd475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:48.726329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:48.742734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441114e-4ab5-45bd-8053-fd9cbcb3ba96 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:48.766711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 449/895] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:48.767539 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80488b44-e012-4486-9115-09f81d3cd475 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:48.776039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdf252-31e7-4d9a-b9ec-fca904d556df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:48.776733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdf252-31e7-4d9a-b9ec-fca904d556df None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.777016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdf252-31e7-4d9a-b9ec-fca904d556df None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.777289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdf252-31e7-4d9a-b9ec-fca904d556df None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.777932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdf252-31e7-4d9a-b9ec-fca904d556df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:48.778235 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdf252-31e7-4d9a-b9ec-fca904d556df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:48.779646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdf252-31e7-4d9a-b9ec-fca904d556df None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:48.791612 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 447/896] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:48.792774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdf252-31e7-4d9a-b9ec-fca904d556df None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:48.869926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:48.879455 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80488b44-e012-4486-9115-09f81d3cd475 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:48.895372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdf252-31e7-4d9a-b9ec-fca904d556df None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:48.917785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942c3f9-be7b-46da-81d2-09df937e5ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:48.918396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c3f9-be7b-46da-81d2-09df937e5ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.918678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c3f9-be7b-46da-81d2-09df937e5ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.918946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c3f9-be7b-46da-81d2-09df937e5ee1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.919644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942c3f9-be7b-46da-81d2-09df937e5ee1 None admin] RBAC: Adding query filter params (interface=public, service_id=0f915d5595084b358498b1cc39443e65, region_id=RegionOne) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:48.919980 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942c3f9-be7b-46da-81d2-09df937e5ee1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:48.921343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942c3f9-be7b-46da-81d2-09df937e5ee1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:48.933572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 450/897] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 31 00:08:48 2022] GET /identity/v3/endpoints?service_id=0f915d5595084b358498b1cc39443e65&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:48.933572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942c3f9-be7b-46da-81d2-09df937e5ee1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:48.935521 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c7798-a549-4eec-bf25-a5c20abadc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:48.936196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c7798-a549-4eec-bf25-a5c20abadc14 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.936454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c7798-a549-4eec-bf25-a5c20abadc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.936734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c7798-a549-4eec-bf25-a5c20abadc14 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.937313 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c7798-a549-4eec-bf25-a5c20abadc14 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:48.938665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c7798-a549-4eec-bf25-a5c20abadc14 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-ba2c7798-a549-4eec-bf25-a5c20abadc14 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:48.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:48.949871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:48.950818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 448/898] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Aug 31 00:08:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:48.952249 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c7798-a549-4eec-bf25-a5c20abadc14 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:48.971407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:49.039778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942c3f9-be7b-46da-81d2-09df937e5ee1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:49.054316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c7798-a549-4eec-bf25-a5c20abadc14 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:49.072424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb48a7-cb18-4e37-b08b-8a8cd548a20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:49.073048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb48a7-cb18-4e37-b08b-8a8cd548a20f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:49.073326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb48a7-cb18-4e37-b08b-8a8cd548a20f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:49.073600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb48a7-cb18-4e37-b08b-8a8cd548a20f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:49.080977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb48a7-cb18-4e37-b08b-8a8cd548a20f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:49.082460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb48a7-cb18-4e37-b08b-8a8cd548a20f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:49.088857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b32df-2c16-4ed5-a0f9-6f1f2e3766e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:49.089466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b32df-2c16-4ed5-a0f9-6f1f2e3766e4 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:49.089748 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b32df-2c16-4ed5-a0f9-6f1f2e3766e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:49.090023 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b32df-2c16-4ed5-a0f9-6f1f2e3766e4 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:49.090643 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b32df-2c16-4ed5-a0f9-6f1f2e3766e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:49.092066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b32df-2c16-4ed5-a0f9-6f1f2e3766e4 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-b3bb48a7-cb18-4e37-b08b-8a8cd548a20f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:49.093507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:49.094431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:49.095389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:49.095389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:49.095389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:49.095389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:49.095389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:49.095389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:49.095389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:49.095389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:49.095389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:49.095389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:49.095389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 451/899] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 31 00:08:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:49.095389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb48a7-cb18-4e37-b08b-8a8cd548a20f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:49.102476 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 449/900] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 31 00:08:48 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:08:49.103775 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b32df-2c16-4ed5-a0f9-6f1f2e3766e4 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:49.106990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:49.210497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:49.220851 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb48a7-cb18-4e37-b08b-8a8cd548a20f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:49.236007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b32df-2c16-4ed5-a0f9-6f1f2e3766e4 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:49.258151 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f216a-0482-472e-9043-bc69b55de785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:49.258779 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f216a-0482-472e-9043-bc69b55de785 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:49.259041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f216a-0482-472e-9043-bc69b55de785 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:49.259316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f216a-0482-472e-9043-bc69b55de785 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:49.260015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f216a-0482-472e-9043-bc69b55de785 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:49.260318 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f216a-0482-472e-9043-bc69b55de785 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:49.261701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f216a-0482-472e-9043-bc69b55de785 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:49.267044 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 452/901] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:49.268088 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f216a-0482-472e-9043-bc69b55de785 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:49.276704 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc07361-2642-487d-9604-e66ac23ec65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:49.277317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07361-2642-487d-9604-e66ac23ec65b None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:49.277594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07361-2642-487d-9604-e66ac23ec65b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:49.277863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07361-2642-487d-9604-e66ac23ec65b None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:49.278515 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc07361-2642-487d-9604-e66ac23ec65b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:49.279918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc07361-2642-487d-9604-e66ac23ec65b None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:49.296663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 450/902] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 31 00:08:49 2022] POST /identity/v3/services => generated 241 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:49.297495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc07361-2642-487d-9604-e66ac23ec65b None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:49.385650 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f216a-0482-472e-9043-bc69b55de785 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:49.404157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:49.432369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76330e32-ac22-42c3-8713-fc7a2f271c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:49.433099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76330e32-ac22-42c3-8713-fc7a2f271c61 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:49.433481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76330e32-ac22-42c3-8713-fc7a2f271c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:49.433814 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76330e32-ac22-42c3-8713-fc7a2f271c61 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:49.434625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76330e32-ac22-42c3-8713-fc7a2f271c61 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:49.434999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76330e32-ac22-42c3-8713-fc7a2f271c61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:49.437002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76330e32-ac22-42c3-8713-fc7a2f271c61 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:49.453397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc07361-2642-487d-9604-e66ac23ec65b None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:49.464429 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 453/903] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Aug 31 00:08:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:49.472006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76330e32-ac22-42c3-8713-fc7a2f271c61 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:49.484795 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:49.495350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf029-91bd-4bb6-bdf3-86c777f66bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:49.496538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf029-91bd-4bb6-bdf3-86c777f66bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:49.496538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf029-91bd-4bb6-bdf3-86c777f66bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:49.496538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf029-91bd-4bb6-bdf3-86c777f66bc9 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:49.497193 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bf029-91bd-4bb6-bdf3-86c777f66bc9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:49.497858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bf029-91bd-4bb6-bdf3-86c777f66bc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:49.499244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bf029-91bd-4bb6-bdf3-86c777f66bc9 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:49.504234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 451/904] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:49.510122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf029-91bd-4bb6-bdf3-86c777f66bc9 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:49.590333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76330e32-ac22-42c3-8713-fc7a2f271c61 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:49.635271 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf029-91bd-4bb6-bdf3-86c777f66bc9 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:49.638034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beeee1-bb7a-4f51-94f4-52f9ebec730a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:49.638681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beeee1-bb7a-4f51-94f4-52f9ebec730a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:49.638957 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beeee1-bb7a-4f51-94f4-52f9ebec730a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:49.639227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beeee1-bb7a-4f51-94f4-52f9ebec730a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:49.664821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:49.674782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474217c-0fe3-4f5a-a410-86b3c8d33a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:49.675854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474217c-0fe3-4f5a-a410-86b3c8d33a26 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:49.676336 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474217c-0fe3-4f5a-a410-86b3c8d33a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:49.676824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474217c-0fe3-4f5a-a410-86b3c8d33a26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:49.677798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474217c-0fe3-4f5a-a410-86b3c8d33a26 None admin] RBAC: Adding query filter params (interface=public, service_id=31e17594e26a4f68a63a71d5f954a438, region_id=RegionOne) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:49.678370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474217c-0fe3-4f5a-a410-86b3c8d33a26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:49.680020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474217c-0fe3-4f5a-a410-86b3c8d33a26 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:49.690442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 452/905] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 31 00:08:49 2022] GET /identity/v3/endpoints?service_id=31e17594e26a4f68a63a71d5f954a438&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:49.692411 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474217c-0fe3-4f5a-a410-86b3c8d33a26 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:49.714890 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1beeee1-bb7a-4f51-94f4-52f9ebec730a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:49.716336 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1beeee1-bb7a-4f51-94f4-52f9ebec730a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:49.729195 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:49.808379 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474217c-0fe3-4f5a-a410-86b3c8d33a26 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:49.826943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 454/906] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:49 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:49.832793 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beeee1-bb7a-4f51-94f4-52f9ebec730a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:49.846569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b101e2-772c-45cf-848e-d5737c5839b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:49.847285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b101e2-772c-45cf-848e-d5737c5839b8 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:49.847632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b101e2-772c-45cf-848e-d5737c5839b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:49.848084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b101e2-772c-45cf-848e-d5737c5839b8 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:49.848762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b101e2-772c-45cf-848e-d5737c5839b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:49.850395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b101e2-772c-45cf-848e-d5737c5839b8 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:49.863959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 453/907] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 31 00:08:49 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:08:49.942733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beeee1-bb7a-4f51-94f4-52f9ebec730a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:49.956086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:49.981000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830db0dd-d682-4516-8457-19cf5a9d36f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:49.981577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830db0dd-d682-4516-8457-19cf5a9d36f1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:49.981893 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830db0dd-d682-4516-8457-19cf5a9d36f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:49.982164 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830db0dd-d682-4516-8457-19cf5a9d36f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:49.994088 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830db0dd-d682-4516-8457-19cf5a9d36f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:49.995675 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830db0dd-d682-4516-8457-19cf5a9d36f1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-830db0dd-d682-4516-8457-19cf5a9d36f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:50.012001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:50.013026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:50.013955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:50.013955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:50.013955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:50.013955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 455/908] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:50.019350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b101e2-772c-45cf-848e-d5737c5839b8 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:50.082222 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:50.128272 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b101e2-772c-45cf-848e-d5737c5839b8 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:50.179790 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d7e35-3c5c-4d7a-8a68-8d3ec314fea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:50.179790 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d7e35-3c5c-4d7a-8a68-8d3ec314fea8 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:50.179790 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d7e35-3c5c-4d7a-8a68-8d3ec314fea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:50.179790 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d7e35-3c5c-4d7a-8a68-8d3ec314fea8 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:50.180232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d7e35-3c5c-4d7a-8a68-8d3ec314fea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:50.180232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d7e35-3c5c-4d7a-8a68-8d3ec314fea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:50.180232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d7e35-3c5c-4d7a-8a68-8d3ec314fea8 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:50.195510 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 454/909] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:50.201127 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830db0dd-d682-4516-8457-19cf5a9d36f1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:50.304926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830db0dd-d682-4516-8457-19cf5a9d36f1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:50.338870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248b251-a1e1-46c6-8abf-b06ceb229866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:50.339511 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248b251-a1e1-46c6-8abf-b06ceb229866 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:50.339816 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248b251-a1e1-46c6-8abf-b06ceb229866 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:50.340080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248b251-a1e1-46c6-8abf-b06ceb229866 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:50.346995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248b251-a1e1-46c6-8abf-b06ceb229866 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:50.348437 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248b251-a1e1-46c6-8abf-b06ceb229866 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7248b251-a1e1-46c6-8abf-b06ceb229866 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:50.359646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:50.360689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:50.362148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:50.362148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:50.362148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:50.362148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:50.362148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:50.362148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:50.362148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:50.362148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:50.362148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 456/910] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:50.368810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d7e35-3c5c-4d7a-8a68-8d3ec314fea8 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:50.480110 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d7e35-3c5c-4d7a-8a68-8d3ec314fea8 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:50.500544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:50.528540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231df59-fca2-45a4-ab9a-75130aa79458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:50.529154 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231df59-fca2-45a4-ab9a-75130aa79458 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:50.529430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231df59-fca2-45a4-ab9a-75130aa79458 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:50.529706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231df59-fca2-45a4-ab9a-75130aa79458 None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:50.530412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231df59-fca2-45a4-ab9a-75130aa79458 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:50.530707 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231df59-fca2-45a4-ab9a-75130aa79458 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:50.532215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231df59-fca2-45a4-ab9a-75130aa79458 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:50.544593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 455/911] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:50.550330 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248b251-a1e1-46c6-8abf-b06ceb229866 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:50.576805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:50.653979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248b251-a1e1-46c6-8abf-b06ceb229866 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:50.688647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a3724-1248-434f-8a53-26b82063da58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:50.689262 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a3724-1248-434f-8a53-26b82063da58 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:50.689547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a3724-1248-434f-8a53-26b82063da58 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:50.689820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a3724-1248-434f-8a53-26b82063da58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:50.690622 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a3724-1248-434f-8a53-26b82063da58 None admin] RBAC: Adding query filter params (role.id=7f4c9cffd6cf443cb2c25965f0039293, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=bc55768a6d2940f8b9c406bad2c278b6) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:50.690926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a3724-1248-434f-8a53-26b82063da58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:50.692770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a3724-1248-434f-8a53-26b82063da58 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:50.698680 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 457/912] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:50 2022] GET /identity/v3/role_assignments?user.id=bc55768a6d2940f8b9c406bad2c278b6&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=7f4c9cffd6cf443cb2c25965f0039293 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:51.096218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce89b0b-31af-475d-a22d-c4e18a05a59d None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.097275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce89b0b-31af-475d-a22d-c4e18a05a59d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.097761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce89b0b-31af-475d-a22d-c4e18a05a59d None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.099580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 456/913] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:51.105038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1374d52-08bb-4979-9ef3-82d473b39b1b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.105842 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1374d52-08bb-4979-9ef3-82d473b39b1b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.106336 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1374d52-08bb-4979-9ef3-82d473b39b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.125626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f1374d52-08bb-4979-9ef3-82d473b39b1b None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:51.127143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f1374d52-08bb-4979-9ef3-82d473b39b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:51.208634 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 458/914] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:51.319604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a32f23-ce73-4726-98c4-b07dfa00be1e None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.319977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a32f23-ce73-4726-98c4-b07dfa00be1e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.320194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a32f23-ce73-4726-98c4-b07dfa00be1e None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.321828 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 457/915] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:51.327222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b274d0-6121-4c90-b2bd-2e3077f5e179 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.327513 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b274d0-6121-4c90-b2bd-2e3077f5e179 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.327821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b274d0-6121-4c90-b2bd-2e3077f5e179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.346597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-91b274d0-6121-4c90-b2bd-2e3077f5e179 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:51.347731 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-91b274d0-6121-4c90-b2bd-2e3077f5e179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:51.359214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:51.418256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 459/916] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:51.484538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a32f23-ce73-4726-98c4-b07dfa00be1e None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:51.591980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a32f23-ce73-4726-98c4-b07dfa00be1e None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:51.629645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e68bf1-4bcd-4c16-bc16-ee848db6ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:51.630661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e68bf1-4bcd-4c16-bc16-ee848db6ec19 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.631140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e68bf1-4bcd-4c16-bc16-ee848db6ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.631608 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e68bf1-4bcd-4c16-bc16-ee848db6ec19 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.632411 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e68bf1-4bcd-4c16-bc16-ee848db6ec19 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:51.633977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e68bf1-4bcd-4c16-bc16-ee848db6ec19 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-d8e68bf1-4bcd-4c16-bc16-ee848db6ec19 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:51.645590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:51.646656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:51.647553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:51.647553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:51.647553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:51.647553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:51.647553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:51.647553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:51.647553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:51.647553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:51.647553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:51.647553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:51.647553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:51.647553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:51.647553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:51.647553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:51.650417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 458/917] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:51.656577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b274d0-6121-4c90-b2bd-2e3077f5e179 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:51.690034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e68bf1-4bcd-4c16-bc16-ee848db6ec19 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:51.735298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:51.776615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b274d0-6121-4c90-b2bd-2e3077f5e179 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:51.813586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4648fc-3361-4c20-abd0-e966cbff5ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:51.814213 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4648fc-3361-4c20-abd0-e966cbff5ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.814492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4648fc-3361-4c20-abd0-e966cbff5ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.814763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4648fc-3361-4c20-abd0-e966cbff5ae5 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.815457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4648fc-3361-4c20-abd0-e966cbff5ae5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:51.815797 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4648fc-3361-4c20-abd0-e966cbff5ae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:51.817471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e68bf1-4bcd-4c16-bc16-ee848db6ec19 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:51.817601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4648fc-3361-4c20-abd0-e966cbff5ae5 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:51.827214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 460/918] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:51.828281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4648fc-3361-4c20-abd0-e966cbff5ae5 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:51.864447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a2715-ed61-4ee2-8cd4-87dab93a6bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:51.865457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a2715-ed61-4ee2-8cd4-87dab93a6bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.865935 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a2715-ed61-4ee2-8cd4-87dab93a6bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.866404 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a2715-ed61-4ee2-8cd4-87dab93a6bf9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.867186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a2715-ed61-4ee2-8cd4-87dab93a6bf9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:51.868092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:51.869465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a2715-ed61-4ee2-8cd4-87dab93a6bf9 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-4b2a2715-ed61-4ee2-8cd4-87dab93a6bf9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:51.881254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:51.882309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:51.883227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:51.883227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:51.883227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:51.883227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:51.883227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:51.883227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:51.883227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:51.883227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:51.883227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:51.883227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:51.883227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:51.883227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:51.883227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:51.883227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:51.890141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 459/919] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:51.891108 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a2715-ed61-4ee2-8cd4-87dab93a6bf9 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:51.939316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4648fc-3361-4c20-abd0-e966cbff5ae5 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:51.975469 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ab9b3-60d0-4ece-b1df-28a2a4a479d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:51.976116 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ab9b3-60d0-4ece-b1df-28a2a4a479d0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.976394 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ab9b3-60d0-4ece-b1df-28a2a4a479d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.976662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ab9b3-60d0-4ece-b1df-28a2a4a479d0 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.977292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ab9b3-60d0-4ece-b1df-28a2a4a479d0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:51.977592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ab9b3-60d0-4ece-b1df-28a2a4a479d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:51.978978 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ab9b3-60d0-4ece-b1df-28a2a4a479d0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:51.984219 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 461/920] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:51.985385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0754f6-4439-47a3-801f-6a5017e52022 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.985665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0754f6-4439-47a3-801f-6a5017e52022 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.985935 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0754f6-4439-47a3-801f-6a5017e52022 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.987739 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 462/921] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:51.989611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0754f6-4439-47a3-801f-6a5017e52022 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:52.015177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a2715-ed61-4ee2-8cd4-87dab93a6bf9 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:52.018651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:52.054166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e49ad-e7a3-461d-8ab7-97b872f99cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:52.054789 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e49ad-e7a3-461d-8ab7-97b872f99cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:52.055062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e49ad-e7a3-461d-8ab7-97b872f99cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:52.055334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e49ad-e7a3-461d-8ab7-97b872f99cb1 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:52.055998 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e49ad-e7a3-461d-8ab7-97b872f99cb1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:52.056305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e49ad-e7a3-461d-8ab7-97b872f99cb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:52.057709 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e49ad-e7a3-461d-8ab7-97b872f99cb1 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:52.067685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 460/922] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:52.067685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e3018-c1a7-4840-999f-31e1ec6fb8eb None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:52.067685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e3018-c1a7-4840-999f-31e1ec6fb8eb None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:52.067685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e3018-c1a7-4840-999f-31e1ec6fb8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:52.081166 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:52.082636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-ee9e3018-c1a7-4840-999f-31e1ec6fb8eb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:52.083925 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ee9e3018-c1a7-4840-999f-31e1ec6fb8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:52.114602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0754f6-4439-47a3-801f-6a5017e52022 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:52.163880 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 461/923] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:52.163880 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e3018-c1a7-4840-999f-31e1ec6fb8eb None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:52.168234 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953143f-1a58-42e4-9883-25fbc2a61fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:52.169045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953143f-1a58-42e4-9883-25fbc2a61fc9 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:52.169436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953143f-1a58-42e4-9883-25fbc2a61fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:52.169809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953143f-1a58-42e4-9883-25fbc2a61fc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:52.170625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953143f-1a58-42e4-9883-25fbc2a61fc9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:52.172222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953143f-1a58-42e4-9883-25fbc2a61fc9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:52.208194 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 463/924] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:08:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:52.276018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:52.284637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e3018-c1a7-4840-999f-31e1ec6fb8eb None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:52.332515 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb7afe-455a-4b2e-a3bb-70c9cc182a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:52.333141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb7afe-455a-4b2e-a3bb-70c9cc182a92 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:52.333417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb7afe-455a-4b2e-a3bb-70c9cc182a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:52.333737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb7afe-455a-4b2e-a3bb-70c9cc182a92 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:52.334946 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb7afe-455a-4b2e-a3bb-70c9cc182a92 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:52.334946 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb7afe-455a-4b2e-a3bb-70c9cc182a92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:52.336205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb7afe-455a-4b2e-a3bb-70c9cc182a92 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:52.342595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 462/925] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:52.352876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953143f-1a58-42e4-9883-25fbc2a61fc9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:52.440072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb7afe-455a-4b2e-a3bb-70c9cc182a92 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:52.463324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953143f-1a58-42e4-9883-25fbc2a61fc9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:52.498841 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:52.506093 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ffc0a-f91a-4f2a-b794-6200c072ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:52.507059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ffc0a-f91a-4f2a-b794-6200c072ccb4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:52.507642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ffc0a-f91a-4f2a-b794-6200c072ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:52.508499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ffc0a-f91a-4f2a-b794-6200c072ccb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:52.509451 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ffc0a-f91a-4f2a-b794-6200c072ccb4 None admin] RBAC: Adding query filter params (interface=public, service_id=626e4d2139284154ad194ead85541bd0, region_id=RegionOne) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:52.510018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ffc0a-f91a-4f2a-b794-6200c072ccb4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:52.511958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ffc0a-f91a-4f2a-b794-6200c072ccb4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:52.519175 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 464/926] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 31 00:08:52 2022] GET /identity/v3/endpoints?service_id=626e4d2139284154ad194ead85541bd0&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:52.525300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ffc0a-f91a-4f2a-b794-6200c072ccb4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:52.563267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb7afe-455a-4b2e-a3bb-70c9cc182a92 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:52.601967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcb88e-5448-4d18-90c6-a1ab47dfa32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:52.603065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcb88e-5448-4d18-90c6-a1ab47dfa32f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:52.603541 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcb88e-5448-4d18-90c6-a1ab47dfa32f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:52.604060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcb88e-5448-4d18-90c6-a1ab47dfa32f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:52.604976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcb88e-5448-4d18-90c6-a1ab47dfa32f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:52.606545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcb88e-5448-4d18-90c6-a1ab47dfa32f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-2abcb88e-5448-4d18-90c6-a1ab47dfa32f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:52.616906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:52.617922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:52.618879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:52.618879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:52.618879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:52.618879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:52.618879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:52.618879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:52.618879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:52.618879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:52.618879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:52.618879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:52.618879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:52.618879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:52.618879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:52.618879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:52.626680 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 463/927] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Aug 31 00:08:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:52.628257 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcb88e-5448-4d18-90c6-a1ab47dfa32f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:52.630212 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ffc0a-f91a-4f2a-b794-6200c072ccb4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:52.651959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:52.665058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192e4c4-4459-4fd5-976a-3a2b0d8e4cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:52.665681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192e4c4-4459-4fd5-976a-3a2b0d8e4cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:52.665959 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192e4c4-4459-4fd5-976a-3a2b0d8e4cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:52.666236 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192e4c4-4459-4fd5-976a-3a2b0d8e4cb9 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:52.666849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192e4c4-4459-4fd5-976a-3a2b0d8e4cb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:52.668578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192e4c4-4459-4fd5-976a-3a2b0d8e4cb9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:52.675739 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 465/928] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 31 00:08:52 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:08:52.676098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530836df-62d2-4588-89cb-ed97ca7db1e3 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:52.676333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530836df-62d2-4588-89cb-ed97ca7db1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:52.676603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530836df-62d2-4588-89cb-ed97ca7db1e3 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:52.679759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 466/929] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:52.684089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e48e7-8495-48b4-8ada-459b552acd9b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:52.684574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e48e7-8495-48b4-8ada-459b552acd9b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:52.684990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e48e7-8495-48b4-8ada-459b552acd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:52.705331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2e4e48e7-8495-48b4-8ada-459b552acd9b None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:52.706946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2e4e48e7-8495-48b4-8ada-459b552acd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:52.765536 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcb88e-5448-4d18-90c6-a1ab47dfa32f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:52.788052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:52.807775 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9606f-6723-4004-aa81-3654ce023f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:52.808803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9606f-6723-4004-aa81-3654ce023f41 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:52.809284 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9606f-6723-4004-aa81-3654ce023f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:52.809804 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9606f-6723-4004-aa81-3654ce023f41 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:52.810662 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9606f-6723-4004-aa81-3654ce023f41 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:52.811181 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9606f-6723-4004-aa81-3654ce023f41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:52.812943 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9606f-6723-4004-aa81-3654ce023f41 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:52.815073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 467/930] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:52.820484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 464/931] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:52.831742 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e48e7-8495-48b4-8ada-459b552acd9b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:52.927055 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e48e7-8495-48b4-8ada-459b552acd9b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:52.962334 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77f048-3ec8-4dfb-a3e1-699bf093e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:52.962874 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77f048-3ec8-4dfb-a3e1-699bf093e056 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:52.963151 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77f048-3ec8-4dfb-a3e1-699bf093e056 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:52.963425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77f048-3ec8-4dfb-a3e1-699bf093e056 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:52.964083 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77f048-3ec8-4dfb-a3e1-699bf093e056 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:52.964387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77f048-3ec8-4dfb-a3e1-699bf093e056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:52.965759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77f048-3ec8-4dfb-a3e1-699bf093e056 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:52.971176 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 468/932] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:52.976746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9606f-6723-4004-aa81-3654ce023f41 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:53.068079 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:53.085672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77f048-3ec8-4dfb-a3e1-699bf093e056 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:53.086026 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9606f-6723-4004-aa81-3654ce023f41 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:53.133503 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0eea0-8ba6-4b8a-bd18-7c1d747bb09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:53.134942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0eea0-8ba6-4b8a-bd18-7c1d747bb09b None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:53.135628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0eea0-8ba6-4b8a-bd18-7c1d747bb09b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:53.136107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0eea0-8ba6-4b8a-bd18-7c1d747bb09b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:53.137229 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0eea0-8ba6-4b8a-bd18-7c1d747bb09b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:53.139636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0eea0-8ba6-4b8a-bd18-7c1d747bb09b None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:53.147102 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:53.174026 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 465/933] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:08:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:08:53.214883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77f048-3ec8-4dfb-a3e1-699bf093e056 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:53.271209 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d760a2-910c-4cc1-b5bf-48e620517942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:53.272284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d760a2-910c-4cc1-b5bf-48e620517942 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:53.272876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d760a2-910c-4cc1-b5bf-48e620517942 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:53.273607 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d760a2-910c-4cc1-b5bf-48e620517942 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:53.297465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d760a2-910c-4cc1-b5bf-48e620517942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-03d760a2-910c-4cc1-b5bf-48e620517942 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:53.302495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:53.303554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:53.304517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:53.304517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:53.304517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:53.304517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:53.304517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:53.304517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:53.304517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:53.304517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:53.304517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:53.304517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:53.304517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:53.304517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:53.304517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 469/934] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Aug 31 00:08:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:53.312509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0eea0-8ba6-4b8a-bd18-7c1d747bb09b None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:53.429280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0eea0-8ba6-4b8a-bd18-7c1d747bb09b None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:53.464441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eccbe0-6baa-4e07-9f99-12a4b1fb0702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:53.465557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eccbe0-6baa-4e07-9f99-12a4b1fb0702 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:53.466042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eccbe0-6baa-4e07-9f99-12a4b1fb0702 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:53.466514 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eccbe0-6baa-4e07-9f99-12a4b1fb0702 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:53.467382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eccbe0-6baa-4e07-9f99-12a4b1fb0702 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:53.467950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eccbe0-6baa-4e07-9f99-12a4b1fb0702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:53.469553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eccbe0-6baa-4e07-9f99-12a4b1fb0702 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:53.478601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 466/935] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Aug 31 00:08:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:53.484758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d760a2-910c-4cc1-b5bf-48e620517942 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:53.589333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d760a2-910c-4cc1-b5bf-48e620517942 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:53.599141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:53.624464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbe9c1-2c57-4a5e-b9bc-062947025d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:53.625107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbe9c1-2c57-4a5e-b9bc-062947025d7c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:53.625389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbe9c1-2c57-4a5e-b9bc-062947025d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:53.625663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbe9c1-2c57-4a5e-b9bc-062947025d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:53.636278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbe9c1-2c57-4a5e-b9bc-062947025d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:53.637746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbe9c1-2c57-4a5e-b9bc-062947025d7c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7bcbe9c1-2c57-4a5e-b9bc-062947025d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:53.652768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:53.653766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:53.654728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:53.654728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:53.654728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:53.654728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 470/936] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:53.661475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eccbe0-6baa-4e07-9f99-12a4b1fb0702 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:53.664817 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:53.771635 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eccbe0-6baa-4e07-9f99-12a4b1fb0702 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:53.805572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74299231-33f0-4ad7-8a34-86ec593b19fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:53.806247 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74299231-33f0-4ad7-8a34-86ec593b19fa None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:53.806528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74299231-33f0-4ad7-8a34-86ec593b19fa None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:53.806810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74299231-33f0-4ad7-8a34-86ec593b19fa None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:53.807500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74299231-33f0-4ad7-8a34-86ec593b19fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:53.807842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74299231-33f0-4ad7-8a34-86ec593b19fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:53.809290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74299231-33f0-4ad7-8a34-86ec593b19fa None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:53.822218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 467/937] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:53.828023 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbe9c1-2c57-4a5e-b9bc-062947025d7c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:53.939121 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbe9c1-2c57-4a5e-b9bc-062947025d7c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:53.973961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ce926-7c86-4516-bae3-3bff46500585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:53.974598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce926-7c86-4516-bae3-3bff46500585 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:53.974880 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce926-7c86-4516-bae3-3bff46500585 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:53.975159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce926-7c86-4516-bae3-3bff46500585 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:53.983121 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ce926-7c86-4516-bae3-3bff46500585 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:53.984617 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ce926-7c86-4516-bae3-3bff46500585 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-d71ce926-7c86-4516-bae3-3bff46500585 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:53.995758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:53.996703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:53.997672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:53.997672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:53.997672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:53.997672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:53.997672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:53.997672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:53.997672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:53.997672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:53.997672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:53.997672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:53.997672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 471/938] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 31 00:08:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:54.008819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74299231-33f0-4ad7-8a34-86ec593b19fa None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:54.069130 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:54.111592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74299231-33f0-4ad7-8a34-86ec593b19fa None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:54.151027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad42b0-ce14-4c78-8d4e-11e8283104ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:54.151633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad42b0-ce14-4c78-8d4e-11e8283104ad None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.151929 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad42b0-ce14-4c78-8d4e-11e8283104ad None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.152197 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad42b0-ce14-4c78-8d4e-11e8283104ad None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.152930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad42b0-ce14-4c78-8d4e-11e8283104ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:54.153229 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad42b0-ce14-4c78-8d4e-11e8283104ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:54.154661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad42b0-ce14-4c78-8d4e-11e8283104ad None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:54.173399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 468/939] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Aug 31 00:08:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:54.179181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ce926-7c86-4516-bae3-3bff46500585 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:54.203319 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:54.286828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ce926-7c86-4516-bae3-3bff46500585 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:54.320078 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08be81-dc8a-4b17-bad3-75eaaa65f5a0 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.320592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08be81-dc8a-4b17-bad3-75eaaa65f5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.320592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08be81-dc8a-4b17-bad3-75eaaa65f5a0 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.322228 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 469/940] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:54.327919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1960cf1-4356-4841-94cc-dcd3e4a0e6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:54.328119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ab97c-cec2-4752-817a-6c9a93dad73e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.328278 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ab97c-cec2-4752-817a-6c9a93dad73e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.328529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ab97c-cec2-4752-817a-6c9a93dad73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.329296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1960cf1-4356-4841-94cc-dcd3e4a0e6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.329795 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1960cf1-4356-4841-94cc-dcd3e4a0e6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.330254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1960cf1-4356-4841-94cc-dcd3e4a0e6e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.345259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1960cf1-4356-4841-94cc-dcd3e4a0e6e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:54.347102 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1960cf1-4356-4841-94cc-dcd3e4a0e6e9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:54.348835 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-a58ab97c-cec2-4752-817a-6c9a93dad73e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:54.350276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a58ab97c-cec2-4752-817a-6c9a93dad73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-a1960cf1-4356-4841-94cc-dcd3e4a0e6e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:54.366075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:54.367097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:54.368077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:54.368077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:54.368077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:54.373643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 472/941] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:54.380975 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1960cf1-4356-4841-94cc-dcd3e4a0e6e9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:54.442247 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 470/942] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:54.473161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:54.504676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1960cf1-4356-4841-94cc-dcd3e4a0e6e9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:54.538934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dc744-f287-452d-b89e-738f5871eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:54.539988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dc744-f287-452d-b89e-738f5871eea8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.540733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dc744-f287-452d-b89e-738f5871eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.541200 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dc744-f287-452d-b89e-738f5871eea8 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.542226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dc744-f287-452d-b89e-738f5871eea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:54.542845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dc744-f287-452d-b89e-738f5871eea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:54.544544 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dc744-f287-452d-b89e-738f5871eea8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:54.557720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 473/943] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:54.563794 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ab97c-cec2-4752-817a-6c9a93dad73e None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:54.617085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:54.670715 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ab97c-cec2-4752-817a-6c9a93dad73e None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:54.706829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e836d6-0728-40e3-a4d6-e96880866911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:54.707905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e836d6-0728-40e3-a4d6-e96880866911 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.708399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e836d6-0728-40e3-a4d6-e96880866911 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.708885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e836d6-0728-40e3-a4d6-e96880866911 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.716338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e836d6-0728-40e3-a4d6-e96880866911 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:54.718027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e836d6-0728-40e3-a4d6-e96880866911 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-f8e836d6-0728-40e3-a4d6-e96880866911 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:54.729914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:54.730953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:54.732014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:54.732014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:54.732014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:54.732014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:54.732014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:54.732014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:54.732014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:54.732014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:54.734037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 471/944] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:54.740187 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e836d6-0728-40e3-a4d6-e96880866911 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:54.740475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe72195-f7e1-4cb0-adf4-ca0de068d8a8 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.740873 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe72195-f7e1-4cb0-adf4-ca0de068d8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.741252 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe72195-f7e1-4cb0-adf4-ca0de068d8a8 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.742785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 474/945] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:54.743462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe72195-f7e1-4cb0-adf4-ca0de068d8a8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:54.844746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e836d6-0728-40e3-a4d6-e96880866911 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:54.854077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe72195-f7e1-4cb0-adf4-ca0de068d8a8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:54.858763 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:54.886005 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:54.886839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2390d4-7bf5-43ea-8964-05f2f3e7b4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:54.887478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2390d4-7bf5-43ea-8964-05f2f3e7b4ac None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.887786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2390d4-7bf5-43ea-8964-05f2f3e7b4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.888057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2390d4-7bf5-43ea-8964-05f2f3e7b4ac None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.888693 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2390d4-7bf5-43ea-8964-05f2f3e7b4ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:54.890149 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2390d4-7bf5-43ea-8964-05f2f3e7b4ac None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:54.892816 dv-cinder-852210-5-smb devstack@keystone.service[81492]: WARNING keystone.server.flask.common [None req-9a2390d4-7bf5-43ea-8964-05f2f3e7b4ac None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 00:08:54.897480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bd116-0e0d-44ef-b4f3-4e26b7f13102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:54.898102 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bd116-0e0d-44ef-b4f3-4e26b7f13102 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.898379 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bd116-0e0d-44ef-b4f3-4e26b7f13102 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.898649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bd116-0e0d-44ef-b4f3-4e26b7f13102 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.899351 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bd116-0e0d-44ef-b4f3-4e26b7f13102 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:54.899654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bd116-0e0d-44ef-b4f3-4e26b7f13102 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:54.901558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bd116-0e0d-44ef-b4f3-4e26b7f13102 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:54.913057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.sql.core [None req-9a2390d4-7bf5-43ea-8964-05f2f3e7b4ac None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:08:54.913057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 00:08:54.913057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [parameters: {'id': '66c9b967a0234259a902fd71e5eafb42', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 00:08:54.913057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81492) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:08:54.919064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 475/946] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:54.919064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ef5ff-cb38-4590-b964-2eff6cbbf598 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.919064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ef5ff-cb38-4590-b964-2eff6cbbf598 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.919064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ef5ff-cb38-4590-b964-2eff6cbbf598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.932279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-9a2390d4-7bf5-43ea-8964-05f2f3e7b4ac None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 66c9b967a0234259a902fd71e5eafb42.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 66c9b967a0234259a902fd71e5eafb42. Aug 31 00:08:54.932279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:54.932279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:08:54.932279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:08:54.932279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:08:54.932279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:08:54.932279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:08:54.932279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:08:54.932279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:08:54.932279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:08:54.932279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:08:54.932279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:08:54.932279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application result.read() Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 00:08:54.933183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application yield resource Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise self.value Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application session.commit() Aug 31 00:08:54.934205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:08:54.935147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:08:54.936184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application result.read() Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:08:54.937013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [parameters: {'id': '66c9b967a0234259a902fd71e5eafb42', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:54.937923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:54.938776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:54.940014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:54.940014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 00:08:54.940014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 00:08:54.940014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:54.940014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:54.940014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 00:08:54.940014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 00:08:54.940014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 66c9b967a0234259a902fd71e5eafb42. Aug 31 00:08:54.940014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:54.940014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 472/947] 10.222.0.50 () {60 vars in 1140 bytes} [Wed Aug 31 00:08:54 2022] POST /identity/v3/projects => generated 262 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:54.940014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2390d4-7bf5-43ea-8964-05f2f3e7b4ac None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:54.942281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-025ef5ff-cb38-4590-b964-2eff6cbbf598 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:54.943486 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-025ef5ff-cb38-4590-b964-2eff6cbbf598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:55.013963 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 476/948] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:55.020602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ef5ff-cb38-4590-b964-2eff6cbbf598 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:55.054194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2390d4-7bf5-43ea-8964-05f2f3e7b4ac None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:55.092509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216de7d-fd1c-437a-a889-39e8eaf087b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:55.093534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216de7d-fd1c-437a-a889-39e8eaf087b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:55.094146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216de7d-fd1c-437a-a889-39e8eaf087b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:55.094751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216de7d-fd1c-437a-a889-39e8eaf087b1 None admin] PATH_INFO: `/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/bc55768a6d2940f8b9c406bad2c278b6/roles/7f4c9cffd6cf443cb2c25965f0039293` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:55.097650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216de7d-fd1c-437a-a889-39e8eaf087b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0864c2a6b50f403db79930d0869f8e23, user_id=bc55768a6d2940f8b9c406bad2c278b6, role_id=7f4c9cffd6cf443cb2c25965f0039293)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:55.099505 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216de7d-fd1c-437a-a889-39e8eaf087b1 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:55.127944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 473/949] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:54 2022] PUT /identity/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/bc55768a6d2940f8b9c406bad2c278b6/roles/7f4c9cffd6cf443cb2c25965f0039293 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:08:55.151414 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ef5ff-cb38-4590-b964-2eff6cbbf598 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:55.179381 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:55.193990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cf18d-0b6f-42cb-95bd-0a173c797f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:55.194659 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cf18d-0b6f-42cb-95bd-0a173c797f3e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:55.194935 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cf18d-0b6f-42cb-95bd-0a173c797f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:55.195209 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cf18d-0b6f-42cb-95bd-0a173c797f3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:55.203551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2cf18d-0b6f-42cb-95bd-0a173c797f3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:55.205167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2cf18d-0b6f-42cb-95bd-0a173c797f3e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7d2cf18d-0b6f-42cb-95bd-0a173c797f3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:55.218220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:55.219269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:55.220257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:55.220257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:55.220257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:55.220257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:55.220257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:55.220257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:55.220257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:55.220257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:55.223844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 477/950] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:55.226167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216de7d-fd1c-437a-a889-39e8eaf087b1 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:55.258332 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:55.273956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a10d0-5f9a-498a-a931-54e7d1d80ed6 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:55.274309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a10d0-5f9a-498a-a931-54e7d1d80ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:55.274484 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a10d0-5f9a-498a-a931-54e7d1d80ed6 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:55.276176 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 478/951] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:55.284241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b21f2-3e3e-48d0-bcb5-76712068c18d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:55.284695 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b21f2-3e3e-48d0-bcb5-76712068c18d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:55.285551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b21f2-3e3e-48d0-bcb5-76712068c18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:55.310567 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-418b21f2-3e3e-48d0-bcb5-76712068c18d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:55.311899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-418b21f2-3e3e-48d0-bcb5-76712068c18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:55.355644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216de7d-fd1c-437a-a889-39e8eaf087b1 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:55.394629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67eeeb-57fe-4bf4-b6cc-2ae5dc2d0799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:55.395723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67eeeb-57fe-4bf4-b6cc-2ae5dc2d0799 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:55.396251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67eeeb-57fe-4bf4-b6cc-2ae5dc2d0799 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:55.396746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67eeeb-57fe-4bf4-b6cc-2ae5dc2d0799 None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:55.403877 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67eeeb-57fe-4bf4-b6cc-2ae5dc2d0799 None admin] RBAC: Adding query filter params (name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:55.404033 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 479/952] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:55.404151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67eeeb-57fe-4bf4-b6cc-2ae5dc2d0799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:55.404250 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b21f2-3e3e-48d0-bcb5-76712068c18d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:55.404336 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67eeeb-57fe-4bf4-b6cc-2ae5dc2d0799 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:55.428544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 474/953] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:55.519135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b21f2-3e3e-48d0-bcb5-76712068c18d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:55.536096 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:55.558314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c20b-295c-4e90-9206-3d1ab93823b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:55.558968 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c20b-295c-4e90-9206-3d1ab93823b0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:55.559249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c20b-295c-4e90-9206-3d1ab93823b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:55.559527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c20b-295c-4e90-9206-3d1ab93823b0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:55.560167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630c20b-295c-4e90-9206-3d1ab93823b0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:55.561645 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630c20b-295c-4e90-9206-3d1ab93823b0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-b630c20b-295c-4e90-9206-3d1ab93823b0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:55.572317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:55.573474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:55.574612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:55.574612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:55.574612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:55.574612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:55.574612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:55.574612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:55.574612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:55.574612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:55.574612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:55.574612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:55.574612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:55.574612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:55.574612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:55.574612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:55.578699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 480/954] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:55.580359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67eeeb-57fe-4bf4-b6cc-2ae5dc2d0799 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:55.668883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c20b-295c-4e90-9206-3d1ab93823b0 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:55.679747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:55.697898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67eeeb-57fe-4bf4-b6cc-2ae5dc2d0799 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:55.740194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b9af9-8bf0-4b61-a15e-f101b6ba3452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:55.741198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b9af9-8bf0-4b61-a15e-f101b6ba3452 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:55.741716 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b9af9-8bf0-4b61-a15e-f101b6ba3452 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:55.742186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b9af9-8bf0-4b61-a15e-f101b6ba3452 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:55.743039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b9af9-8bf0-4b61-a15e-f101b6ba3452 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:55.743550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b9af9-8bf0-4b61-a15e-f101b6ba3452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:55.745178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b9af9-8bf0-4b61-a15e-f101b6ba3452 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:55.750698 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 475/955] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:55.756231 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b9af9-8bf0-4b61-a15e-f101b6ba3452 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:55.796554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c20b-295c-4e90-9206-3d1ab93823b0 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:55.841977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23f4c9-5eb4-416a-87d1-4cd6a90f40f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:55.843609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23f4c9-5eb4-416a-87d1-4cd6a90f40f1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:55.844393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23f4c9-5eb4-416a-87d1-4cd6a90f40f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:55.844881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23f4c9-5eb4-416a-87d1-4cd6a90f40f1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:55.845917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23f4c9-5eb4-416a-87d1-4cd6a90f40f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:55.848536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23f4c9-5eb4-416a-87d1-4cd6a90f40f1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-0a23f4c9-5eb4-416a-87d1-4cd6a90f40f1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:55.859806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:55.861081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:55.862013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:55.862013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:55.862013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:55.862013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:55.862013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:55.862013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:55.862013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:55.862013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:55.862013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:55.862013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:55.862013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:55.862013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:55.862013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:08:55.862013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:55.862821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 481/956] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:55.868693 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23f4c9-5eb4-416a-87d1-4cd6a90f40f1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:55.884483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b9af9-8bf0-4b61-a15e-f101b6ba3452 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:55.913427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:55.921072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8764e-43f2-4d79-911a-0dd28d374ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:55.921751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8764e-43f2-4d79-911a-0dd28d374ddd None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:55.922118 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8764e-43f2-4d79-911a-0dd28d374ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:55.922502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8764e-43f2-4d79-911a-0dd28d374ddd None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:55.923296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8764e-43f2-4d79-911a-0dd28d374ddd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:55.923633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8764e-43f2-4d79-911a-0dd28d374ddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:55.925269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8764e-43f2-4d79-911a-0dd28d374ddd None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:55.931029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 476/957] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:55.936574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8764e-43f2-4d79-911a-0dd28d374ddd None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:55.953648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:55.977758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23f4c9-5eb4-416a-87d1-4cd6a90f40f1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:56.015451 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470fc7a-6b4b-4148-a334-6f96a33be442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:56.016422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470fc7a-6b4b-4148-a334-6f96a33be442 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:56.016839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470fc7a-6b4b-4148-a334-6f96a33be442 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:56.017274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470fc7a-6b4b-4148-a334-6f96a33be442 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:56.018059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470fc7a-6b4b-4148-a334-6f96a33be442 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:56.018519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470fc7a-6b4b-4148-a334-6f96a33be442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:56.020179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470fc7a-6b4b-4148-a334-6f96a33be442 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:56.030208 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 482/958] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:56.031253 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470fc7a-6b4b-4148-a334-6f96a33be442 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:56.058800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8764e-43f2-4d79-911a-0dd28d374ddd None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:56.098418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4033dc-ab9f-4e34-aaed-3ded17bc9546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:56.099332 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4033dc-ab9f-4e34-aaed-3ded17bc9546 None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:56.099683 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4033dc-ab9f-4e34-aaed-3ded17bc9546 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:56.100061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4033dc-ab9f-4e34-aaed-3ded17bc9546 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:56.100805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4033dc-ab9f-4e34-aaed-3ded17bc9546 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:56.102445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4033dc-ab9f-4e34-aaed-3ded17bc9546 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:56.126531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 477/959] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:08:55 2022] POST /identity/v3/endpoints => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:08:56.160587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470fc7a-6b4b-4148-a334-6f96a33be442 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:56.166180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:56.213126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb6206-3348-4970-a20f-492852ad8c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:56.214782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6206-3348-4970-a20f-492852ad8c27 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:56.215254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6206-3348-4970-a20f-492852ad8c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:56.215841 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6206-3348-4970-a20f-492852ad8c27 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:56.216717 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb6206-3348-4970-a20f-492852ad8c27 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:56.217301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb6206-3348-4970-a20f-492852ad8c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:56.219038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb6206-3348-4970-a20f-492852ad8c27 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:56.225361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 483/960] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:57.179662 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27ea60-4f4d-4e62-900b-6f0fd1fe68de None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.180215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27ea60-4f4d-4e62-900b-6f0fd1fe68de None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.180296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27ea60-4f4d-4e62-900b-6f0fd1fe68de None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.181908 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 478/961] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:57.187385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa38a7-cc24-4b02-a7c1-4e7538eb527e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.187681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa38a7-cc24-4b02-a7c1-4e7538eb527e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.188051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa38a7-cc24-4b02-a7c1-4e7538eb527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.207206 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-10fa38a7-cc24-4b02-a7c1-4e7538eb527e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:57.208558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-10fa38a7-cc24-4b02-a7c1-4e7538eb527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:57.280419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 484/962] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:57.482604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7197000-1375-42df-8c67-4aa5acb46a1c None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.482807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7197000-1375-42df-8c67-4aa5acb46a1c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.483067 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7197000-1375-42df-8c67-4aa5acb46a1c None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.484788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 479/963] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:57.489962 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb95ab-2d4a-45a1-9f45-c90b0ddc953b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.490254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb95ab-2d4a-45a1-9f45-c90b0ddc953b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.490531 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb95ab-2d4a-45a1-9f45-c90b0ddc953b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.508975 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c9fb95ab-2d4a-45a1-9f45-c90b0ddc953b None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:57.510166 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c9fb95ab-2d4a-45a1-9f45-c90b0ddc953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:57.555540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7197000-1375-42df-8c67-4aa5acb46a1c None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:57.583535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 485/964] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:57.631520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:57.665160 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7197000-1375-42df-8c67-4aa5acb46a1c None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:57.701336 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b073267-a5d7-4ce3-aa57-5912fb0eb511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:57.701980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b073267-a5d7-4ce3-aa57-5912fb0eb511 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.702259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b073267-a5d7-4ce3-aa57-5912fb0eb511 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.702530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b073267-a5d7-4ce3-aa57-5912fb0eb511 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.713239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b073267-a5d7-4ce3-aa57-5912fb0eb511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-7b073267-a5d7-4ce3-aa57-5912fb0eb511 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:57.718105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:57.719099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:57.720027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:57.720027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:57.720027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:57.720027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:57.720027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:57.720027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:57.720027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:57.720027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:57.720027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:57.720027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:57.720027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:57.720027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:57.720027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 480/965] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Aug 31 00:08:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:57.726062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb95ab-2d4a-45a1-9f45-c90b0ddc953b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:57.751256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:57.831924 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb95ab-2d4a-45a1-9f45-c90b0ddc953b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:57.850741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b073267-a5d7-4ce3-aa57-5912fb0eb511 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:57.870903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485bcd7-4826-42d9-abd7-288580dcfb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:57.871530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485bcd7-4826-42d9-abd7-288580dcfb93 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.871851 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485bcd7-4826-42d9-abd7-288580dcfb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.872127 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485bcd7-4826-42d9-abd7-288580dcfb93 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.872806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485bcd7-4826-42d9-abd7-288580dcfb93 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:57.873111 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485bcd7-4826-42d9-abd7-288580dcfb93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:57.874497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485bcd7-4826-42d9-abd7-288580dcfb93 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:57.883581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 486/966] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Aug 31 00:08:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:57.889136 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485bcd7-4826-42d9-abd7-288580dcfb93 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:57.957127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b073267-a5d7-4ce3-aa57-5912fb0eb511 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:57.978401 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:57.988614 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:57.995064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485bcd7-4826-42d9-abd7-288580dcfb93 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:57.995949 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212be2f8-1dab-40bc-82a2-c9a0acca46ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:57.996583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212be2f8-1dab-40bc-82a2-c9a0acca46ce None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.996876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212be2f8-1dab-40bc-82a2-c9a0acca46ce None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.997140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212be2f8-1dab-40bc-82a2-c9a0acca46ce None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.997907 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212be2f8-1dab-40bc-82a2-c9a0acca46ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:57.999462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212be2f8-1dab-40bc-82a2-c9a0acca46ce None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:58.016029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.sql.core [None req-212be2f8-1dab-40bc-82a2-c9a0acca46ce None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:08:58.016029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 00:08:58.016029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [parameters: {'user_id': '61b087669f7d4ec789434d2f95ccf116', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 00:08:58.016029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81492) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-212be2f8-1dab-40bc-82a2-c9a0acca46ce None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application result.read() Aug 31 00:08:58.023143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:08:58.024279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application yield resource Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise self.value Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application session.commit() Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:08:58.025472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:08:58.026634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:08:58.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application result.read() Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:08:58.029254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [parameters: {'user_id': '61b087669f7d4ec789434d2f95ccf116', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:58.030358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 00:08:58.032086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 00:08:58.034488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 00:08:58.034488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 00:08:58.034488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:08:58.034488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:08:58.034488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 00:08:58.034488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:58.034488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 481/967] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Aug 31 00:08:57 2022] POST /identity/v3/users => generated 160 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:58.034488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212be2f8-1dab-40bc-82a2-c9a0acca46ce None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:58.045375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e546be-cf88-4695-a244-bfbaf879df6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:58.046276 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e546be-cf88-4695-a244-bfbaf879df6b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.046737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e546be-cf88-4695-a244-bfbaf879df6b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.047184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e546be-cf88-4695-a244-bfbaf879df6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.058937 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e546be-cf88-4695-a244-bfbaf879df6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:58.060682 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e546be-cf88-4695-a244-bfbaf879df6b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-47e546be-cf88-4695-a244-bfbaf879df6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:58.076727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:58.077791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:58.078719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:58.078719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:58.078719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:08:58.085274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 487/968] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:58.086335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e546be-cf88-4695-a244-bfbaf879df6b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:58.143042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212be2f8-1dab-40bc-82a2-c9a0acca46ce None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:58.181877 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92e0a1-c98f-4ce2-8d45-270e680106ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:58.182605 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92e0a1-c98f-4ce2-8d45-270e680106ec None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.182886 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92e0a1-c98f-4ce2-8d45-270e680106ec None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.183154 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92e0a1-c98f-4ce2-8d45-270e680106ec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.191450 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92e0a1-c98f-4ce2-8d45-270e680106ec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:58.193450 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92e0a1-c98f-4ce2-8d45-270e680106ec None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:58.195659 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e546be-cf88-4695-a244-bfbaf879df6b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-8b92e0a1-c98f-4ce2-8d45-270e680106ec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:58.205598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:58.206644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:58.207623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:58.207623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:58.207623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:58.207623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:58.207623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:58.207623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:58.207623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:58.207623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:58.207623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:08:58.207623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:58.207623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 482/969] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:58.208300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4e430-1598-4905-a913-a75712021336 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.208644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4e430-1598-4905-a913-a75712021336 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.208644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4e430-1598-4905-a913-a75712021336 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.213097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 483/970] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:58.214183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54689ee-1c81-47c7-849d-597c839c6ef5 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.214523 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54689ee-1c81-47c7-849d-597c839c6ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.214793 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54689ee-1c81-47c7-849d-597c839c6ef5 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.219730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 484/971] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:08:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:58.219730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54689ee-1c81-47c7-849d-597c839c6ef5 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:58.233782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b0d4e-56b3-4c67-be60-37ba6fcf2373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:58.234399 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b0d4e-56b3-4c67-be60-37ba6fcf2373 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.234672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b0d4e-56b3-4c67-be60-37ba6fcf2373 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.234939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b0d4e-56b3-4c67-be60-37ba6fcf2373 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.235596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b0d4e-56b3-4c67-be60-37ba6fcf2373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:58.235920 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b0d4e-56b3-4c67-be60-37ba6fcf2373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:58.237302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b0d4e-56b3-4c67-be60-37ba6fcf2373 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:58.244193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:58.250227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 488/972] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:58.251269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75392e34-5f46-4ae8-8ddf-4f9e871381c6 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.251554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75392e34-5f46-4ae8-8ddf-4f9e871381c6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.251859 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75392e34-5f46-4ae8-8ddf-4f9e871381c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.270493 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-75392e34-5f46-4ae8-8ddf-4f9e871381c6 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:58.271644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-75392e34-5f46-4ae8-8ddf-4f9e871381c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:58.276870 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:58.326204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54689ee-1c81-47c7-849d-597c839c6ef5 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:58.338445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 489/973] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:58.339916 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e81d65-d97d-4d06-94a3-52f8c5efe211 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.340280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e81d65-d97d-4d06-94a3-52f8c5efe211 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.340683 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e81d65-d97d-4d06-94a3-52f8c5efe211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.358713 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-93e81d65-d97d-4d06-94a3-52f8c5efe211 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:58.359919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-93e81d65-d97d-4d06-94a3-52f8c5efe211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:58.362956 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815cc7a-4a33-48de-915f-f81d3e7ee85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:58.363722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815cc7a-4a33-48de-915f-f81d3e7ee85a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.364075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815cc7a-4a33-48de-915f-f81d3e7ee85a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.364351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815cc7a-4a33-48de-915f-f81d3e7ee85a None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.365096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815cc7a-4a33-48de-915f-f81d3e7ee85a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:58.365405 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815cc7a-4a33-48de-915f-f81d3e7ee85a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:58.366913 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815cc7a-4a33-48de-915f-f81d3e7ee85a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:58.405605 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 485/974] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Aug 31 00:08:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:58.406438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815cc7a-4a33-48de-915f-f81d3e7ee85a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:58.434137 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 490/975] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:58.534351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815cc7a-4a33-48de-915f-f81d3e7ee85a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:58.547357 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:58.571965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff652c-40f9-4ac5-b9c9-f39be15f0f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:58.572634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff652c-40f9-4ac5-b9c9-f39be15f0f63 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.572909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff652c-40f9-4ac5-b9c9-f39be15f0f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.573343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff652c-40f9-4ac5-b9c9-f39be15f0f63 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.580604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff652c-40f9-4ac5-b9c9-f39be15f0f63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:58.582240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff652c-40f9-4ac5-b9c9-f39be15f0f63 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-b2ff652c-40f9-4ac5-b9c9-f39be15f0f63 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:58.594376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:58.596324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:58.598384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:58.598384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:58.598384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:58.598384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:58.598384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:58.598384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:58.598384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:58.598384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:58.598384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:58.598384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:58.598384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 486/976] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 31 00:08:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:58.609491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e81d65-d97d-4d06-94a3-52f8c5efe211 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:58.635603 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff652c-40f9-4ac5-b9c9-f39be15f0f63 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:58.676143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:58.730267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e81d65-d97d-4d06-94a3-52f8c5efe211 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:58.754694 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff652c-40f9-4ac5-b9c9-f39be15f0f63 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:58.763568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97120d0-425a-48d4-a6c5-66a342a68d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:58.764201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97120d0-425a-48d4-a6c5-66a342a68d54 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.764488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97120d0-425a-48d4-a6c5-66a342a68d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.764756 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97120d0-425a-48d4-a6c5-66a342a68d54 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.765482 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97120d0-425a-48d4-a6c5-66a342a68d54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:58.765782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97120d0-425a-48d4-a6c5-66a342a68d54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:58.767203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97120d0-425a-48d4-a6c5-66a342a68d54 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:58.784104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 491/977] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Aug 31 00:08:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:58.784970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97120d0-425a-48d4-a6c5-66a342a68d54 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:58.791187 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb6c34-7069-4c75-80d2-140f4c0a3abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:58.791880 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb6c34-7069-4c75-80d2-140f4c0a3abe None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.792161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb6c34-7069-4c75-80d2-140f4c0a3abe None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.792433 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb6c34-7069-4c75-80d2-140f4c0a3abe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.793025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb6c34-7069-4c75-80d2-140f4c0a3abe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:58.794414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb6c34-7069-4c75-80d2-140f4c0a3abe None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-dbeb6c34-7069-4c75-80d2-140f4c0a3abe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:58.803845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:58.805012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:58.805865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 487/978] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:58.806825 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb6c34-7069-4c75-80d2-140f4c0a3abe None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:58.840770 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:58.890017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97120d0-425a-48d4-a6c5-66a342a68d54 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:58.907293 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:58.908084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb6c34-7069-4c75-80d2-140f4c0a3abe None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:58.924886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3a9a6-c7ac-4336-addb-28c3b8ec3a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:58.925613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3a9a6-c7ac-4336-addb-28c3b8ec3a18 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.925957 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3a9a6-c7ac-4336-addb-28c3b8ec3a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.926291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3a9a6-c7ac-4336-addb-28c3b8ec3a18 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.927003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3a9a6-c7ac-4336-addb-28c3b8ec3a18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:58.928468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3a9a6-c7ac-4336-addb-28c3b8ec3a18 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:58.941285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3a0cf-1eb5-494a-b4db-3c8292ccb891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:58.941916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3a0cf-1eb5-494a-b4db-3c8292ccb891 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.942178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3a0cf-1eb5-494a-b4db-3c8292ccb891 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.942793 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3a0cf-1eb5-494a-b4db-3c8292ccb891 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.944007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 492/979] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 31 00:08:58 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:58.944831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3a9a6-c7ac-4336-addb-28c3b8ec3a18 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:59.027315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3a0cf-1eb5-494a-b4db-3c8292ccb891 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:59.029769 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3a0cf-1eb5-494a-b4db-3c8292ccb891 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:59.068661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:59.074766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3a9a6-c7ac-4336-addb-28c3b8ec3a18 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:59.114962 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18bc4b-c44a-4363-86ea-0dc9da1cc8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:59.115672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18bc4b-c44a-4363-86ea-0dc9da1cc8ab None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:59.116008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18bc4b-c44a-4363-86ea-0dc9da1cc8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:59.116255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18bc4b-c44a-4363-86ea-0dc9da1cc8ab None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:59.116908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18bc4b-c44a-4363-86ea-0dc9da1cc8ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:59.117211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18bc4b-c44a-4363-86ea-0dc9da1cc8ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:59.119550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18bc4b-c44a-4363-86ea-0dc9da1cc8ab None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:59.125703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 493/980] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:59.131782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18bc4b-c44a-4363-86ea-0dc9da1cc8ab None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:59.145627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 488/981] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:58 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:59.151408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3a0cf-1eb5-494a-b4db-3c8292ccb891 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:59.181002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:59.256015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18bc4b-c44a-4363-86ea-0dc9da1cc8ab None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:59.258258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3a0cf-1eb5-494a-b4db-3c8292ccb891 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:59.293371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aae2c5-9652-4345-ad5b-960b52622baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:59.293988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aae2c5-9652-4345-ad5b-960b52622baa None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:59.294268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aae2c5-9652-4345-ad5b-960b52622baa None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:59.294466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d6aab-0800-4df5-9033-406e46b8a18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:59.294579 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aae2c5-9652-4345-ad5b-960b52622baa None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:59.295137 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6aab-0800-4df5-9033-406e46b8a18d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:59.295237 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aae2c5-9652-4345-ad5b-960b52622baa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:59.295426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6aab-0800-4df5-9033-406e46b8a18d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:59.295534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aae2c5-9652-4345-ad5b-960b52622baa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:59.295737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6aab-0800-4df5-9033-406e46b8a18d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:59.296872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aae2c5-9652-4345-ad5b-960b52622baa None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:59.297766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:59.307527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 494/982] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:59.308628 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aae2c5-9652-4345-ad5b-960b52622baa None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:59.312917 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d6aab-0800-4df5-9033-406e46b8a18d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:59.314359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d6aab-0800-4df5-9033-406e46b8a18d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-a85d6aab-0800-4df5-9033-406e46b8a18d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:59.329813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:59.330861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:59.336681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:59.336681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:59.336681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:59.336681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 489/983] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:59.336681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d6aab-0800-4df5-9033-406e46b8a18d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:59.426326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:59.429767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aae2c5-9652-4345-ad5b-960b52622baa None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:59.443169 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d6aab-0800-4df5-9033-406e46b8a18d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:59.469600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d5048-1c75-49fc-a5f5-f827ffca60c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:59.470213 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d5048-1c75-49fc-a5f5-f827ffca60c4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:59.470497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d5048-1c75-49fc-a5f5-f827ffca60c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:59.470769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d5048-1c75-49fc-a5f5-f827ffca60c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:59.471478 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d5048-1c75-49fc-a5f5-f827ffca60c4 None admin] RBAC: Adding query filter params (interface=admin, service_id=626e4d2139284154ad194ead85541bd0, region_id=RegionOne) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:59.471817 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d5048-1c75-49fc-a5f5-f827ffca60c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:59.474107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d5048-1c75-49fc-a5f5-f827ffca60c4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:59.483598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 495/984] 10.222.0.50 () {56 vars in 1249 bytes} [Wed Aug 31 00:08:59 2022] GET /identity/v3/endpoints?service_id=626e4d2139284154ad194ead85541bd0&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:59.483772 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7863364-e079-434a-8375-fc28032a9ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:59.483772 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863364-e079-434a-8375-fc28032a9ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:59.483772 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863364-e079-434a-8375-fc28032a9ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:59.483772 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863364-e079-434a-8375-fc28032a9ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:59.484092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7863364-e079-434a-8375-fc28032a9ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:59.484092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7863364-e079-434a-8375-fc28032a9ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:59.484092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7863364-e079-434a-8375-fc28032a9ad3 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:59.484646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d5048-1c75-49fc-a5f5-f827ffca60c4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:59.495752 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 490/985] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:59.501189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7863364-e079-434a-8375-fc28032a9ad3 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:59.553887 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:59.592465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d5048-1c75-49fc-a5f5-f827ffca60c4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:59.613540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7863364-e079-434a-8375-fc28032a9ad3 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:59.629675 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7f879-21e6-4d75-81ad-41bb2131ade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:59.630295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7f879-21e6-4d75-81ad-41bb2131ade6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:59.630576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7f879-21e6-4d75-81ad-41bb2131ade6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:59.630849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7f879-21e6-4d75-81ad-41bb2131ade6 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:59.631460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7f879-21e6-4d75-81ad-41bb2131ade6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:59.632873 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7f879-21e6-4d75-81ad-41bb2131ade6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:59.639903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 496/986] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 31 00:08:59 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:08:59.662001 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f9c8c-f18e-4315-95c7-9c4dc6bfa23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:59.663120 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9c8c-f18e-4315-95c7-9c4dc6bfa23d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:59.663651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9c8c-f18e-4315-95c7-9c4dc6bfa23d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:59.664187 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9c8c-f18e-4315-95c7-9c4dc6bfa23d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:59.673059 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f9c8c-f18e-4315-95c7-9c4dc6bfa23d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:59.675069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f9c8c-f18e-4315-95c7-9c4dc6bfa23d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-145f9c8c-f18e-4315-95c7-9c4dc6bfa23d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:59.689445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:59.690481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:59.691866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:59.691866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:59.691866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:59.691866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:59.691866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:59.691866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:59.691866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:59.691866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:08:59.693971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 491/987] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:59.700105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7f879-21e6-4d75-81ad-41bb2131ade6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:59.732154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:59.813542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7f879-21e6-4d75-81ad-41bb2131ade6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:59.849313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bd0a5-d356-4435-a5e1-0fcc9ec93f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:59.849840 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bd0a5-d356-4435-a5e1-0fcc9ec93f7c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:59.850116 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bd0a5-d356-4435-a5e1-0fcc9ec93f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:59.850388 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bd0a5-d356-4435-a5e1-0fcc9ec93f7c None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:59.851096 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bd0a5-d356-4435-a5e1-0fcc9ec93f7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:59.851400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bd0a5-d356-4435-a5e1-0fcc9ec93f7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:59.852898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bd0a5-d356-4435-a5e1-0fcc9ec93f7c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:59.865369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 497/988] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:59.871557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f9c8c-f18e-4315-95c7-9c4dc6bfa23d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:59.977715 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f9c8c-f18e-4315-95c7-9c4dc6bfa23d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:59.985760 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:00.014577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88694345-6d79-461d-bdcd-15f47657bc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:00.015194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88694345-6d79-461d-bdcd-15f47657bc53 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:00.015473 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88694345-6d79-461d-bdcd-15f47657bc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:00.015769 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88694345-6d79-461d-bdcd-15f47657bc53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:00.016510 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88694345-6d79-461d-bdcd-15f47657bc53 None admin] RBAC: Adding query filter params (role.id=7f4c9cffd6cf443cb2c25965f0039293, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=bc55768a6d2940f8b9c406bad2c278b6) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:00.016821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88694345-6d79-461d-bdcd-15f47657bc53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:00.018256 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88694345-6d79-461d-bdcd-15f47657bc53 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:00.024584 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 492/989] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:59 2022] GET /identity/v3/role_assignments?user.id=bc55768a6d2940f8b9c406bad2c278b6&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=7f4c9cffd6cf443cb2c25965f0039293 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:00.883163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797922e-8c89-4e3b-a392-b7bf55bf0bc7 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:00.883743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797922e-8c89-4e3b-a392-b7bf55bf0bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:00.883743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797922e-8c89-4e3b-a392-b7bf55bf0bc7 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:00.885241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 498/990] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:00.890395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93818bb8-a712-4d50-9051-28210d0aeea3 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:00.890800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93818bb8-a712-4d50-9051-28210d0aeea3 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:00.890896 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93818bb8-a712-4d50-9051-28210d0aeea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:00.909938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-93818bb8-a712-4d50-9051-28210d0aeea3 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:00.911493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-93818bb8-a712-4d50-9051-28210d0aeea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:00.981929 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 493/991] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:01.242320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797922e-8c89-4e3b-a392-b7bf55bf0bc7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:01.340767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:01.355364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797922e-8c89-4e3b-a392-b7bf55bf0bc7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:01.391899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d3971-e5c3-406e-a228-7bc28343f96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:01.392568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d3971-e5c3-406e-a228-7bc28343f96c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:01.392846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d3971-e5c3-406e-a228-7bc28343f96c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:01.393117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d3971-e5c3-406e-a228-7bc28343f96c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:01.393703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d3971-e5c3-406e-a228-7bc28343f96c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:01.395148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d3971-e5c3-406e-a228-7bc28343f96c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-354d3971-e5c3-406e-a228-7bc28343f96c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:01.404233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:01.405232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:01.408760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 499/992] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:09:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:01.411915 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93818bb8-a712-4d50-9051-28210d0aeea3 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:01.511233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:01.514913 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93818bb8-a712-4d50-9051-28210d0aeea3 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:01.545643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d5a8-c7b4-4a9f-9693-7f06912d2a05 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:01.545897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d5a8-c7b4-4a9f-9693-7f06912d2a05 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:01.546185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d5a8-c7b4-4a9f-9693-7f06912d2a05 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:01.547803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 500/993] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:01.550583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e0697-5b5a-4767-b57a-ecd8468f6124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:01.551583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e0697-5b5a-4767-b57a-ecd8468f6124 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:01.552318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e0697-5b5a-4767-b57a-ecd8468f6124 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:01.553867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133193f5-31f0-456c-8d3e-3a9c95e983ba None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:01.553977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e0697-5b5a-4767-b57a-ecd8468f6124 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:01.554136 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133193f5-31f0-456c-8d3e-3a9c95e983ba None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:01.554434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133193f5-31f0-456c-8d3e-3a9c95e983ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:01.554660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e0697-5b5a-4767-b57a-ecd8468f6124 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:01.554965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e0697-5b5a-4767-b57a-ecd8468f6124 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:01.556373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e0697-5b5a-4767-b57a-ecd8468f6124 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:01.566845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 494/994] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 31 00:09:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:01.567990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e0697-5b5a-4767-b57a-ecd8468f6124 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:01.574153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-133193f5-31f0-456c-8d3e-3a9c95e983ba None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:01.575360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-133193f5-31f0-456c-8d3e-3a9c95e983ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:01.650451 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 501/995] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:09:01.675976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e0697-5b5a-4767-b57a-ecd8468f6124 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:01.709805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6962cd6-e255-483c-a0cc-63b3a8a21096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:01.710416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6962cd6-e255-483c-a0cc-63b3a8a21096 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:01.710691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6962cd6-e255-483c-a0cc-63b3a8a21096 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:01.710958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6962cd6-e255-483c-a0cc-63b3a8a21096 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:01.711583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6962cd6-e255-483c-a0cc-63b3a8a21096 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:01.711906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6962cd6-e255-483c-a0cc-63b3a8a21096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:01.713277 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6962cd6-e255-483c-a0cc-63b3a8a21096 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:01.723085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 495/996] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 31 00:09:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:01.726510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133193f5-31f0-456c-8d3e-3a9c95e983ba None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:01.805516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:01.825530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133193f5-31f0-456c-8d3e-3a9c95e983ba None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:01.863050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c20a84-7d08-4154-8598-6872b415f573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:01.863814 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c20a84-7d08-4154-8598-6872b415f573 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:01.864152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c20a84-7d08-4154-8598-6872b415f573 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:01.864503 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c20a84-7d08-4154-8598-6872b415f573 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:01.865295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c20a84-7d08-4154-8598-6872b415f573 None admin] RBAC: Adding query filter params (interface=public, service_id=783c387c49cf42f78430ce76ff47f72d, region_id=RegionOne) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:01.865672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c20a84-7d08-4154-8598-6872b415f573 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:01.867135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c20a84-7d08-4154-8598-6872b415f573 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:01.872725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 502/997] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 31 00:09:01 2022] GET /identity/v3/endpoints?service_id=783c387c49cf42f78430ce76ff47f72d&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:01.878213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6962cd6-e255-483c-a0cc-63b3a8a21096 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:01.908083 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:01.919216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c20a84-7d08-4154-8598-6872b415f573 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:01.984805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6962cd6-e255-483c-a0cc-63b3a8a21096 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:02.016935 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e60d9-9419-4009-804d-fac814ea38b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:02.017541 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e60d9-9419-4009-804d-fac814ea38b8 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:02.017819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e60d9-9419-4009-804d-fac814ea38b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:02.018100 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e60d9-9419-4009-804d-fac814ea38b8 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:02.018715 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e60d9-9419-4009-804d-fac814ea38b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:02.020218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e60d9-9419-4009-804d-fac814ea38b8 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:02.021941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c20a84-7d08-4154-8598-6872b415f573 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:02.026281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 496/998] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 31 00:09:01 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:09:02.028682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1fceb-5426-49ec-b3c1-eedc45f5f5a2 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:02.028974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1fceb-5426-49ec-b3c1-eedc45f5f5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:02.029248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1fceb-5426-49ec-b3c1-eedc45f5f5a2 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:02.030561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 497/999] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:02.045489 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910789b0-dae1-4770-96e5-0aef9382ebbc None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:02.045800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910789b0-dae1-4770-96e5-0aef9382ebbc None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:02.046047 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910789b0-dae1-4770-96e5-0aef9382ebbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:02.062872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ca968-7c22-45bb-9fb4-0877608089ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:02.063432 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ca968-7c22-45bb-9fb4-0877608089ca None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:02.063729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ca968-7c22-45bb-9fb4-0877608089ca None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:02.064003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ca968-7c22-45bb-9fb4-0877608089ca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:02.064598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ca968-7c22-45bb-9fb4-0877608089ca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:02.065319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-910789b0-dae1-4770-96e5-0aef9382ebbc None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:02.065987 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ca968-7c22-45bb-9fb4-0877608089ca None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:02.066608 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-910789b0-dae1-4770-96e5-0aef9382ebbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e80ca968-7c22-45bb-9fb4-0877608089ca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:02.076251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:02.079853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:02.080828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 503/1000] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Aug 31 00:09:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:02.084338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ca968-7c22-45bb-9fb4-0877608089ca None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:02.099057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:02.154140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 498/1001] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:09:02.203636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ca968-7c22-45bb-9fb4-0877608089ca None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:02.237801 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622f31-9427-44eb-a7b3-7d7d459d8313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:02.238468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622f31-9427-44eb-a7b3-7d7d459d8313 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:02.238746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622f31-9427-44eb-a7b3-7d7d459d8313 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:02.239016 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622f31-9427-44eb-a7b3-7d7d459d8313 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:02.239660 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39622f31-9427-44eb-a7b3-7d7d459d8313 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:02.239985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39622f31-9427-44eb-a7b3-7d7d459d8313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:02.241390 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39622f31-9427-44eb-a7b3-7d7d459d8313 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:02.246572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 504/1002] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 31 00:09:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:02.252310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910789b0-dae1-4770-96e5-0aef9382ebbc None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:02.277586 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:02.355275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910789b0-dae1-4770-96e5-0aef9382ebbc None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:02.389601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5ba40-29ff-4839-8b03-d2cb315c0b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:02.390217 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5ba40-29ff-4839-8b03-d2cb315c0b7a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:02.390488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5ba40-29ff-4839-8b03-d2cb315c0b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:02.390758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5ba40-29ff-4839-8b03-d2cb315c0b7a None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:02.391391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5ba40-29ff-4839-8b03-d2cb315c0b7a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:02.391688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5ba40-29ff-4839-8b03-d2cb315c0b7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:02.393094 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5ba40-29ff-4839-8b03-d2cb315c0b7a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:02.398302 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 499/1003] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Aug 31 00:09:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:02.404161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622f31-9427-44eb-a7b3-7d7d459d8313 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:02.413319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5ba40-29ff-4839-8b03-d2cb315c0b7a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:02.487344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:02.513563 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622f31-9427-44eb-a7b3-7d7d459d8313 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:02.514638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:02.530584 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5ba40-29ff-4839-8b03-d2cb315c0b7a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:02.552772 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68c866-dc11-4935-9a10-0d45b7e3db76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:02.553400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68c866-dc11-4935-9a10-0d45b7e3db76 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:02.553687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68c866-dc11-4935-9a10-0d45b7e3db76 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:02.553964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68c866-dc11-4935-9a10-0d45b7e3db76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:02.554687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68c866-dc11-4935-9a10-0d45b7e3db76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:02.556162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68c866-dc11-4935-9a10-0d45b7e3db76 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:02.565363 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18692c2-2a53-48b4-acb3-93a15fe268c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:02.566040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18692c2-2a53-48b4-acb3-93a15fe268c7 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:02.566321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18692c2-2a53-48b4-acb3-93a15fe268c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:02.566687 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18692c2-2a53-48b4-acb3-93a15fe268c7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:02.567359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18692c2-2a53-48b4-acb3-93a15fe268c7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:02.569241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18692c2-2a53-48b4-acb3-93a15fe268c7 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:02.574470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 505/1004] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:09:02 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-c18692c2-2a53-48b4-acb3-93a15fe268c7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:02.578359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:02.579457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:02.585234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 500/1005] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Aug 31 00:09:02 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:09:02.586088 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68c866-dc11-4935-9a10-0d45b7e3db76 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:02.715211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68c866-dc11-4935-9a10-0d45b7e3db76 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:02.749864 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:02.756669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242cdab-21c8-48fc-980c-9af3261058a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:02.757400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242cdab-21c8-48fc-980c-9af3261058a2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:02.757592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242cdab-21c8-48fc-980c-9af3261058a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:02.757877 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242cdab-21c8-48fc-980c-9af3261058a2 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:02.758772 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242cdab-21c8-48fc-980c-9af3261058a2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:02.759281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242cdab-21c8-48fc-980c-9af3261058a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:02.761825 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242cdab-21c8-48fc-980c-9af3261058a2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:02.766737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 506/1006] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:02.772861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18692c2-2a53-48b4-acb3-93a15fe268c7 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:02.876418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18692c2-2a53-48b4-acb3-93a15fe268c7 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:02.910704 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511515a2-f22c-4d45-9480-2d4af642dfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:02.911378 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511515a2-f22c-4d45-9480-2d4af642dfdd None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:02.911626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511515a2-f22c-4d45-9480-2d4af642dfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:02.911877 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511515a2-f22c-4d45-9480-2d4af642dfdd None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:02.912529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511515a2-f22c-4d45-9480-2d4af642dfdd None admin] RBAC: Adding query filter params (type=image) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:02.912827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511515a2-f22c-4d45-9480-2d4af642dfdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:02.914284 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511515a2-f22c-4d45-9480-2d4af642dfdd None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:02.927802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 501/1007] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:03.977413 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d2abd-a447-47f7-a98a-db7f1cf6b2e1 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:03.977978 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d2abd-a447-47f7-a98a-db7f1cf6b2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:03.977978 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d2abd-a447-47f7-a98a-db7f1cf6b2e1 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:03.979490 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 507/1008] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:09:03.984898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616190a-5cd5-4577-938e-901511079dd5 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:03.985364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616190a-5cd5-4577-938e-901511079dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:03.985445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616190a-5cd5-4577-938e-901511079dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:04.004387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-b616190a-5cd5-4577-938e-901511079dd5 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:04.005553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b616190a-5cd5-4577-938e-901511079dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:04.015441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:04.080044 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 502/1009] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:03 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:04.341377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d2abd-a447-47f7-a98a-db7f1cf6b2e1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:04.451077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d2abd-a447-47f7-a98a-db7f1cf6b2e1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:04.487268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609c1af-5a39-4e27-9bf2-68a247012a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:04.487955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609c1af-5a39-4e27-9bf2-68a247012a7f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:04.488218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609c1af-5a39-4e27-9bf2-68a247012a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:04.488482 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609c1af-5a39-4e27-9bf2-68a247012a7f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:04.489245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609c1af-5a39-4e27-9bf2-68a247012a7f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:04.490646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609c1af-5a39-4e27-9bf2-68a247012a7f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-6609c1af-5a39-4e27-9bf2-68a247012a7f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:04.499917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:04.500928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:04.501810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 508/1010] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:09:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:09:04.509127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616190a-5cd5-4577-938e-901511079dd5 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:04.517838 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62c63f-450d-4609-bc60-93b4549353f0 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:04.518132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62c63f-450d-4609-bc60-93b4549353f0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:04.518407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62c63f-450d-4609-bc60-93b4549353f0 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:04.519802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 509/1011] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:04.524756 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4037c-7929-49d6-9933-924a462312e1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:04.525041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4037c-7929-49d6-9933-924a462312e1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:04.525324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4037c-7929-49d6-9933-924a462312e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:04.543846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1dd4037c-7929-49d6-9933-924a462312e1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:04.545042 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1dd4037c-7929-49d6-9933-924a462312e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:04.605158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:04.619725 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616190a-5cd5-4577-938e-901511079dd5 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:04.623725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 510/1012] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:04 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:09:04.657381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6472443-d588-4f7b-85d3-4c135baeca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:04.657989 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6472443-d588-4f7b-85d3-4c135baeca4a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:04.658263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6472443-d588-4f7b-85d3-4c135baeca4a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:04.658531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6472443-d588-4f7b-85d3-4c135baeca4a None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:04.659155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6472443-d588-4f7b-85d3-4c135baeca4a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:04.659452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6472443-d588-4f7b-85d3-4c135baeca4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:04.660902 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6472443-d588-4f7b-85d3-4c135baeca4a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:04.666157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 503/1013] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 31 00:09:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:04.673845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4037c-7929-49d6-9933-924a462312e1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:04.787329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4037c-7929-49d6-9933-924a462312e1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:04.797645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7e0d6-9a79-4051-a860-cbc17843cfd0 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:04.798651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7e0d6-9a79-4051-a860-cbc17843cfd0 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:04.798937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7e0d6-9a79-4051-a860-cbc17843cfd0 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:04.801022 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 504/1014] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:04.806525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de46de-18a5-41d3-a129-9281e1ab31e4 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:04.807009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de46de-18a5-41d3-a129-9281e1ab31e4 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:04.807457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de46de-18a5-41d3-a129-9281e1ab31e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:04.824883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b114b88-d1f7-4f59-abb8-f3ec3219cf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:04.825555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b114b88-d1f7-4f59-abb8-f3ec3219cf50 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:04.825781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b114b88-d1f7-4f59-abb8-f3ec3219cf50 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:04.826050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b114b88-d1f7-4f59-abb8-f3ec3219cf50 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:04.826389 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-63de46de-18a5-41d3-a129-9281e1ab31e4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:04.826678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b114b88-d1f7-4f59-abb8-f3ec3219cf50 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:04.826983 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b114b88-d1f7-4f59-abb8-f3ec3219cf50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:04.827599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-63de46de-18a5-41d3-a129-9281e1ab31e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:04.828383 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b114b88-d1f7-4f59-abb8-f3ec3219cf50 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:04.829794 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:04.834881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 511/1015] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Aug 31 00:09:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:04.840497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b114b88-d1f7-4f59-abb8-f3ec3219cf50 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:04.898919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:04.900608 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 505/1016] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:04 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:09:04.901537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de46de-18a5-41d3-a129-9281e1ab31e4 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:04.948793 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b114b88-d1f7-4f59-abb8-f3ec3219cf50 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:04.983528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5aeaaa-bf93-45a4-83a3-788c893d882c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:04.984263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aeaaa-bf93-45a4-83a3-788c893d882c None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:04.984624 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aeaaa-bf93-45a4-83a3-788c893d882c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:04.984905 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aeaaa-bf93-45a4-83a3-788c893d882c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:04.985585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5aeaaa-bf93-45a4-83a3-788c893d882c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:04.986996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5aeaaa-bf93-45a4-83a3-788c893d882c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:05.008126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 512/1017] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:09:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:05.020852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de46de-18a5-41d3-a129-9281e1ab31e4 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:05.067383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cf6c2-eee1-4d41-8e9a-40804eacea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:05.068404 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cf6c2-eee1-4d41-8e9a-40804eacea29 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:05.068686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cf6c2-eee1-4d41-8e9a-40804eacea29 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:05.068959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cf6c2-eee1-4d41-8e9a-40804eacea29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:05.070101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64cf6c2-eee1-4d41-8e9a-40804eacea29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:05.071568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64cf6c2-eee1-4d41-8e9a-40804eacea29 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:05.073494 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 506/1018] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:05.079224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5aeaaa-bf93-45a4-83a3-788c893d882c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:05.171524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cf6c2-eee1-4d41-8e9a-40804eacea29 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:05.174742 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:05.196276 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5aeaaa-bf93-45a4-83a3-788c893d882c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:05.206527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:05.238160 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abfdab-126a-4759-88b1-6ab8bf5e758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:05.238838 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abfdab-126a-4759-88b1-6ab8bf5e758e None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:05.239138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abfdab-126a-4759-88b1-6ab8bf5e758e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:05.239410 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abfdab-126a-4759-88b1-6ab8bf5e758e None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:05.240232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abfdab-126a-4759-88b1-6ab8bf5e758e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:05.241606 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abfdab-126a-4759-88b1-6ab8bf5e758e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:05.274290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 513/1019] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 31 00:09:05 2022] POST /identity/v3/projects => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:05.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cf6c2-eee1-4d41-8e9a-40804eacea29 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:05.336447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da617de5-0daa-460b-9f7f-c94e9fef1c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:05.337110 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da617de5-0daa-460b-9f7f-c94e9fef1c7d None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:05.337390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da617de5-0daa-460b-9f7f-c94e9fef1c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:05.337662 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da617de5-0daa-460b-9f7f-c94e9fef1c7d None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:05.338337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da617de5-0daa-460b-9f7f-c94e9fef1c7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:05.339819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da617de5-0daa-460b-9f7f-c94e9fef1c7d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:05.363764 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 507/1020] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 31 00:09:05 2022] POST /identity/v3/services => generated 242 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:09:07.041212 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddf177-7aa7-41d9-bb64-ee83d22773c0 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:07.041804 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddf177-7aa7-41d9-bb64-ee83d22773c0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:07.041804 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddf177-7aa7-41d9-bb64-ee83d22773c0 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:07.043246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 514/1021] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:07.048449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa7ca0-cd66-420c-9971-a07058058372 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:07.048892 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa7ca0-cd66-420c-9971-a07058058372 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:07.048971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa7ca0-cd66-420c-9971-a07058058372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:07.067452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-50fa7ca0-cd66-420c-9971-a07058058372 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:07.069008 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-50fa7ca0-cd66-420c-9971-a07058058372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:07.127390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:07.149718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 508/1022] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:07.243180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9ca3e-dd84-4d66-a43f-f5419b3ffffa None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:07.243431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9ca3e-dd84-4d66-a43f-f5419b3ffffa None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:07.243908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9ca3e-dd84-4d66-a43f-f5419b3ffffa None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:07.245417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 515/1023] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:07.251105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955f0ec-0232-4630-8012-920a13995ab1 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:07.251393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955f0ec-0232-4630-8012-920a13995ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:07.251663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955f0ec-0232-4630-8012-920a13995ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:07.270862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-f955f0ec-0232-4630-8012-920a13995ab1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:07.272084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f955f0ec-0232-4630-8012-920a13995ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:07.288604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3ec34-8a5b-4a23-801e-ba91df55993c None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:07.289159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3ec34-8a5b-4a23-801e-ba91df55993c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:07.289423 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3ec34-8a5b-4a23-801e-ba91df55993c None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:07.290968 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 516/1024] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:09:07.296344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9a274-f64c-4481-b1b7-e8818cc640d4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:07.296699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9a274-f64c-4481-b1b7-e8818cc640d4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:07.296976 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9a274-f64c-4481-b1b7-e8818cc640d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:07.315866 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-10b9a274-f64c-4481-b1b7-e8818cc640d4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:07.317133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-10b9a274-f64c-4481-b1b7-e8818cc640d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:07.347859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 509/1025] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:07.387751 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 517/1026] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:07.412134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955f0ec-0232-4630-8012-920a13995ab1 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:07.516241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955f0ec-0232-4630-8012-920a13995ab1 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:07.533263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:07.551111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec042ea0-4861-4983-baef-d53f8d3fa465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:07.551783 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec042ea0-4861-4983-baef-d53f8d3fa465 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:07.552060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec042ea0-4861-4983-baef-d53f8d3fa465 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:07.552365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec042ea0-4861-4983-baef-d53f8d3fa465 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:07.563927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec042ea0-4861-4983-baef-d53f8d3fa465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-ec042ea0-4861-4983-baef-d53f8d3fa465 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:07.569136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:07.570091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:07.572688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:07.572688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:07.572688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:07.572688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:07.572688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:07.572688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:07.572688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:07.572688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:07.572688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:07.572688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:07.572688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:09:07.572688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:07.572688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 510/1027] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Aug 31 00:09:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:07.576424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9a274-f64c-4481-b1b7-e8818cc640d4 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:07.609574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec042ea0-4861-4983-baef-d53f8d3fa465 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:07.672241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:07.684724 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9a274-f64c-4481-b1b7-e8818cc640d4 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:07.719204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec042ea0-4861-4983-baef-d53f8d3fa465 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:07.722229 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8f883-d03c-4366-a69e-6d3397a11241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:07.722850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8f883-d03c-4366-a69e-6d3397a11241 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:07.723118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8f883-d03c-4366-a69e-6d3397a11241 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:07.723419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8f883-d03c-4366-a69e-6d3397a11241 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:07.724138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8f883-d03c-4366-a69e-6d3397a11241 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:07.724436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8f883-d03c-4366-a69e-6d3397a11241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:07.725825 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8f883-d03c-4366-a69e-6d3397a11241 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:07.734246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 518/1028] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Aug 31 00:09:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:07.735024 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8f883-d03c-4366-a69e-6d3397a11241 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:07.757305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4a3d9-f8aa-428d-a183-9f0f7c50c81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:07.757953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4a3d9-f8aa-428d-a183-9f0f7c50c81a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:07.758232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4a3d9-f8aa-428d-a183-9f0f7c50c81a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:07.758507 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4a3d9-f8aa-428d-a183-9f0f7c50c81a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:07.759670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4a3d9-f8aa-428d-a183-9f0f7c50c81a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:07.761156 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4a3d9-f8aa-428d-a183-9f0f7c50c81a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:07.762888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 511/1029] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:07.763501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4a3d9-f8aa-428d-a183-9f0f7c50c81a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:07.810243 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:07.836578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8f883-d03c-4366-a69e-6d3397a11241 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:07.864262 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4a3d9-f8aa-428d-a183-9f0f7c50c81a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:07.878520 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f143a41-45bd-4209-a9c8-f088eab8e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:07.879180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f143a41-45bd-4209-a9c8-f088eab8e2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:07.879437 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f143a41-45bd-4209-a9c8-f088eab8e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:07.879849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f143a41-45bd-4209-a9c8-f088eab8e2b8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:07.880445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f143a41-45bd-4209-a9c8-f088eab8e2b8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:07.881808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f143a41-45bd-4209-a9c8-f088eab8e2b8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-8f143a41-45bd-4209-a9c8-f088eab8e2b8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:07.890396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:07.891445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:07.892370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 519/1030] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Aug 31 00:09:07 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:07.893192 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f143a41-45bd-4209-a9c8-f088eab8e2b8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:07.903398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458f48c-03c1-468a-998a-47e4c81b7fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:07.904073 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458f48c-03c1-468a-998a-47e4c81b7fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:07.904332 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458f48c-03c1-468a-998a-47e4c81b7fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:07.904603 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458f48c-03c1-468a-998a-47e4c81b7fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:07.911326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:07.915465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458f48c-03c1-468a-998a-47e4c81b7fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:07.916967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458f48c-03c1-468a-998a-47e4c81b7fb6 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-9458f48c-03c1-468a-998a-47e4c81b7fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:07.930930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:07.932104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:07.933040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:07.933040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:07.933040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:07.933040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 512/1031] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:07.933040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458f48c-03c1-468a-998a-47e4c81b7fb6 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:07.993667 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f143a41-45bd-4209-a9c8-f088eab8e2b8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:08.026816 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcf669-9abd-46e3-9663-c6c869ac24eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:08.027430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcf669-9abd-46e3-9663-c6c869ac24eb None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:08.027736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcf669-9abd-46e3-9663-c6c869ac24eb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:08.028011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcf669-9abd-46e3-9663-c6c869ac24eb None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:08.028116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:08.028662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcf669-9abd-46e3-9663-c6c869ac24eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:08.030133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcf669-9abd-46e3-9663-c6c869ac24eb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:08.031720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458f48c-03c1-468a-998a-47e4c81b7fb6 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:08.052297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 520/1032] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:09:07 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:08.053107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcf669-9abd-46e3-9663-c6c869ac24eb None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:08.074992 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b5657-05d0-49b1-bb7a-389b6b54c40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:08.076265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b5657-05d0-49b1-bb7a-389b6b54c40d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:08.076549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b5657-05d0-49b1-bb7a-389b6b54c40d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:08.076821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b5657-05d0-49b1-bb7a-389b6b54c40d None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:08.077476 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b5657-05d0-49b1-bb7a-389b6b54c40d None admin] RBAC: Adding query filter params (name=image) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:08.077779 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b5657-05d0-49b1-bb7a-389b6b54c40d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:08.079221 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b5657-05d0-49b1-bb7a-389b6b54c40d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:08.085051 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 513/1033] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:08.091126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b5657-05d0-49b1-bb7a-389b6b54c40d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:08.133727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:08.178438 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcf669-9abd-46e3-9663-c6c869ac24eb None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:08.212206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b5657-05d0-49b1-bb7a-389b6b54c40d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:08.222073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e44187-2d7c-4188-ad96-603d6dfe120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:08.223015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e44187-2d7c-4188-ad96-603d6dfe120f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:08.223015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e44187-2d7c-4188-ad96-603d6dfe120f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:08.223278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e44187-2d7c-4188-ad96-603d6dfe120f None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:08.223962 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e44187-2d7c-4188-ad96-603d6dfe120f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:08.224902 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e44187-2d7c-4188-ad96-603d6dfe120f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:08.225655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e44187-2d7c-4188-ad96-603d6dfe120f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:08.238940 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 521/1034] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:08.244781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e44187-2d7c-4188-ad96-603d6dfe120f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:08.251162 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e071f-0b93-4a7b-ab01-06b56b420e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:08.252127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e071f-0b93-4a7b-ab01-06b56b420e2e None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:08.252127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e071f-0b93-4a7b-ab01-06b56b420e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:08.252385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e071f-0b93-4a7b-ab01-06b56b420e2e None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:08.253002 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e071f-0b93-4a7b-ab01-06b56b420e2e None admin] RBAC: Adding query filter params (type=image) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:08.254069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e071f-0b93-4a7b-ab01-06b56b420e2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:08.254741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e071f-0b93-4a7b-ab01-06b56b420e2e None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:08.262168 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 514/1035] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:08.270100 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e071f-0b93-4a7b-ab01-06b56b420e2e None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:08.298654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:08.358699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e44187-2d7c-4188-ad96-603d6dfe120f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:08.376606 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e071f-0b93-4a7b-ab01-06b56b420e2e None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:08.388591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:08.394518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd886f4-d72d-4c4d-bdba-02dd0f7cf268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:08.395160 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd886f4-d72d-4c4d-bdba-02dd0f7cf268 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:08.395507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd886f4-d72d-4c4d-bdba-02dd0f7cf268 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:08.395810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd886f4-d72d-4c4d-bdba-02dd0f7cf268 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:08.403403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd886f4-d72d-4c4d-bdba-02dd0f7cf268 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:08.405116 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd886f4-d72d-4c4d-bdba-02dd0f7cf268 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:08.414307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae3f47-75d8-491d-bac1-51cd2f4a5a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:08.414920 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae3f47-75d8-491d-bac1-51cd2f4a5a1f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:08.415201 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae3f47-75d8-491d-bac1-51cd2f4a5a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:08.415466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae3f47-75d8-491d-bac1-51cd2f4a5a1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:08.416203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae3f47-75d8-491d-bac1-51cd2f4a5a1f None admin] RBAC: Adding query filter params (interface=public, service_id=a9ae09442b9d42c0b90e766c28d60dd1, region_id=RegionOne) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:08.416507 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae3f47-75d8-491d-bac1-51cd2f4a5a1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:08.417871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae3f47-75d8-491d-bac1-51cd2f4a5a1f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-dfd886f4-d72d-4c4d-bdba-02dd0f7cf268 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:09:08.418564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:08.419720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:08.420899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:08.420899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:08.420899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:09:08.420899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:09:08.420899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:09:08.420899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:09:08.420899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:09:08.420899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:09:08.420899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:09:08.420899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:08.422790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 522/1036] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 31 00:09:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:09:08.427625 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 515/1037] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 31 00:09:08 2022] GET /identity/v3/endpoints?service_id=a9ae09442b9d42c0b90e766c28d60dd1&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:08.429053 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd886f4-d72d-4c4d-bdba-02dd0f7cf268 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:08.429174 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae3f47-75d8-491d-bac1-51cd2f4a5a1f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:08.520474 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:08.531652 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae3f47-75d8-491d-bac1-51cd2f4a5a1f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:08.533894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd886f4-d72d-4c4d-bdba-02dd0f7cf268 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:08.566143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468174d2-a53b-4dad-9873-b977c9376036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:08.566935 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468174d2-a53b-4dad-9873-b977c9376036 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:08.567469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468174d2-a53b-4dad-9873-b977c9376036 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:08.567772 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468174d2-a53b-4dad-9873-b977c9376036 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:08.568926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468174d2-a53b-4dad-9873-b977c9376036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:08.569784 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11538a-fea9-4658-8e8d-ee6e72f22f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:08.570410 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11538a-fea9-4658-8e8d-ee6e72f22f94 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:08.570520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468174d2-a53b-4dad-9873-b977c9376036 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:08.570690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11538a-fea9-4658-8e8d-ee6e72f22f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:08.570962 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11538a-fea9-4658-8e8d-ee6e72f22f94 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:08.571911 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11538a-fea9-4658-8e8d-ee6e72f22f94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:08.572530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11538a-fea9-4658-8e8d-ee6e72f22f94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:08.573939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11538a-fea9-4658-8e8d-ee6e72f22f94 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:08.577185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 516/1038] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 31 00:09:08 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:09:08.594710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 523/1039] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 31 00:09:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:08.600779 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468174d2-a53b-4dad-9873-b977c9376036 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:08.714164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468174d2-a53b-4dad-9873-b977c9376036 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:08.758145 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a65583-d446-478f-945e-55b0f4108d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:08.758776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a65583-d446-478f-945e-55b0f4108d2a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:08.759055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a65583-d446-478f-945e-55b0f4108d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:08.759328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a65583-d446-478f-945e-55b0f4108d2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:08.784020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:08.829273 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a65583-d446-478f-945e-55b0f4108d2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:08.830846 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a65583-d446-478f-945e-55b0f4108d2a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:08.935740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 517/1040] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:08 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:08.945353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11538a-fea9-4658-8e8d-ee6e72f22f94 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:09.024214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:09.059512 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11538a-fea9-4658-8e8d-ee6e72f22f94 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:09.097446 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ad255-7f7c-4d9b-b956-0f832575f871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:09.098431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ad255-7f7c-4d9b-b956-0f832575f871 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:09.098918 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ad255-7f7c-4d9b-b956-0f832575f871 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:09.099395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ad255-7f7c-4d9b-b956-0f832575f871 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:09.110863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ad255-7f7c-4d9b-b956-0f832575f871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:09.112704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ad255-7f7c-4d9b-b956-0f832575f871 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-eb7ad255-7f7c-4d9b-b956-0f832575f871 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:09.128242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:09.129290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:09.130281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:09.130281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:09.130281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:09.132452 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 524/1041] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:09.138031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a65583-d446-478f-945e-55b0f4108d2a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:09.211411 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:09.256997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a65583-d446-478f-945e-55b0f4108d2a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:09.292458 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569078c4-da46-4c47-a342-857d724154dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:09.293001 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569078c4-da46-4c47-a342-857d724154dc None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:09.293282 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569078c4-da46-4c47-a342-857d724154dc None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:09.293555 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569078c4-da46-4c47-a342-857d724154dc None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:09.294222 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569078c4-da46-4c47-a342-857d724154dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:09.294526 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569078c4-da46-4c47-a342-857d724154dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:09.296006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569078c4-da46-4c47-a342-857d724154dc None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:09.312710 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 518/1042] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:09.313893 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ad255-7f7c-4d9b-b956-0f832575f871 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:09.416132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ad255-7f7c-4d9b-b956-0f832575f871 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:09.418009 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:09.454937 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c65b6a-458f-418c-94a1-f3f7d3fd5527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:09.455578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c65b6a-458f-418c-94a1-f3f7d3fd5527 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:09.455886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c65b6a-458f-418c-94a1-f3f7d3fd5527 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:09.456160 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c65b6a-458f-418c-94a1-f3f7d3fd5527 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:09.463469 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c65b6a-458f-418c-94a1-f3f7d3fd5527 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:09.464972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c65b6a-458f-418c-94a1-f3f7d3fd5527 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-69c65b6a-458f-418c-94a1-f3f7d3fd5527 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:09:09.476582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:09.477524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:09.478533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:09:09.478533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:09:09.478533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:09:09.478533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:09:09.478533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:09:09.478533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:09:09.478533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:09.478533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:09.478533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 525/1043] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:09:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:09.485545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569078c4-da46-4c47-a342-857d724154dc None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:09.590527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569078c4-da46-4c47-a342-857d724154dc None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:09.604620 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:09.628050 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db76f7a-15dc-4d38-925f-48ad2e1c4eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:09.628666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db76f7a-15dc-4d38-925f-48ad2e1c4eca None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:09.628943 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db76f7a-15dc-4d38-925f-48ad2e1c4eca None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:09.629211 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db76f7a-15dc-4d38-925f-48ad2e1c4eca None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:09.629938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db76f7a-15dc-4d38-925f-48ad2e1c4eca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:09.630243 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db76f7a-15dc-4d38-925f-48ad2e1c4eca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:09.631673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db76f7a-15dc-4d38-925f-48ad2e1c4eca None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:09.644100 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 519/1044] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:09:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:09.650119 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c65b6a-458f-418c-94a1-f3f7d3fd5527 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:09.760538 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c65b6a-458f-418c-94a1-f3f7d3fd5527 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:09.795290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c513c-e0dd-42ea-b78c-3696fa1ee91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:09.796022 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c513c-e0dd-42ea-b78c-3696fa1ee91e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:09.796301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c513c-e0dd-42ea-b78c-3696fa1ee91e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:09.796572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c513c-e0dd-42ea-b78c-3696fa1ee91e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:09.797364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c513c-e0dd-42ea-b78c-3696fa1ee91e None admin] RBAC: Adding query filter params (role.id=7f4c9cffd6cf443cb2c25965f0039293, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=cb9ef38ec3b448828826de5f76a552d8) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:09.797677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c513c-e0dd-42ea-b78c-3696fa1ee91e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:09.799143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c513c-e0dd-42ea-b78c-3696fa1ee91e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:09.811721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 526/1045] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:09 2022] GET /identity/v3/role_assignments?user.id=cb9ef38ec3b448828826de5f76a552d8&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=7f4c9cffd6cf443cb2c25965f0039293 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:10.009715 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13f76d-3b91-45f2-a084-53ebd3902964 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:10.010018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13f76d-3b91-45f2-a084-53ebd3902964 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:10.010380 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13f76d-3b91-45f2-a084-53ebd3902964 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:10.011822 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 520/1046] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:10.017270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9fba0-e70f-4bcd-a01b-273cf913e6af None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:10.017537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9fba0-e70f-4bcd-a01b-273cf913e6af None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:10.017842 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9fba0-e70f-4bcd-a01b-273cf913e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:10.037098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7df9fba0-e70f-4bcd-a01b-273cf913e6af None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:10.038313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7df9fba0-e70f-4bcd-a01b-273cf913e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:10.059930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:10.111298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 527/1047] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:10.376492 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13f76d-3b91-45f2-a084-53ebd3902964 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:10.485326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13f76d-3b91-45f2-a084-53ebd3902964 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:10.495570 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3671ec-6cb3-44cd-943c-78d5dc150647 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:10.496332 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3671ec-6cb3-44cd-943c-78d5dc150647 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:10.496652 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3671ec-6cb3-44cd-943c-78d5dc150647 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:10.498405 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 528/1048] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:10.504282 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300c748-1481-4f6a-83f2-a26f203f9a2d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:10.504579 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300c748-1481-4f6a-83f2-a26f203f9a2d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:10.504851 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300c748-1481-4f6a-83f2-a26f203f9a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:10.521700 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2438a-8273-4500-b5b8-744922cb87db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:10.522351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2438a-8273-4500-b5b8-744922cb87db None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:10.522629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2438a-8273-4500-b5b8-744922cb87db None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:10.522898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2438a-8273-4500-b5b8-744922cb87db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:10.523429 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a300c748-1481-4f6a-83f2-a26f203f9a2d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:10.524653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a300c748-1481-4f6a-83f2-a26f203f9a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:10.533693 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2438a-8273-4500-b5b8-744922cb87db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-d5c2438a-8273-4500-b5b8-744922cb87db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:10.538661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:10.539729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:10.541329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:10.541329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:10.541329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:10.541329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:10.541329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:10.541329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:10.541329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:10.541329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:10.541329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:10.541329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:10.541329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:10.541329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:10.541329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 521/1049] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:09:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:10.545947 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2438a-8273-4500-b5b8-744922cb87db None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:10.583959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:10.600735 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 529/1050] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:09:10.657817 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2438a-8273-4500-b5b8-744922cb87db None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:10.692421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fa502-8da2-43b8-8cbc-cd6437199db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:10.693089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fa502-8da2-43b8-8cbc-cd6437199db7 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:10.693377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fa502-8da2-43b8-8cbc-cd6437199db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:10.693649 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fa502-8da2-43b8-8cbc-cd6437199db7 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:10.694657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fa502-8da2-43b8-8cbc-cd6437199db7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:10.694961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fa502-8da2-43b8-8cbc-cd6437199db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:10.696386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fa502-8da2-43b8-8cbc-cd6437199db7 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:10.705119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 522/1051] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:09:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:10.710944 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300c748-1481-4f6a-83f2-a26f203f9a2d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:10.803509 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:10.820401 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300c748-1481-4f6a-83f2-a26f203f9a2d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:10.854686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b8560-0285-4db0-8a25-ba41b58b32f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:10.855346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b8560-0285-4db0-8a25-ba41b58b32f2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:10.855625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b8560-0285-4db0-8a25-ba41b58b32f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:10.855923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b8560-0285-4db0-8a25-ba41b58b32f2 None admin] PATH_INFO: `/v3/users/638e10e1c2334207869d9a02f119d0b0` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:10.870461 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b8560-0285-4db0-8a25-ba41b58b32f2 None admin] RBAC: Authorizing `identity:get_user(user_id=638e10e1c2334207869d9a02f119d0b0)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:10.871960 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b8560-0285-4db0-8a25-ba41b58b32f2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:10.875130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 530/1052] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:10 2022] GET /identity/v3/users/638e10e1c2334207869d9a02f119d0b0 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:10.876391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fa502-8da2-43b8-8cbc-cd6437199db7 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:10.879584 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b8560-0285-4db0-8a25-ba41b58b32f2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:10.982845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b8560-0285-4db0-8a25-ba41b58b32f2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:10.984098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:10.992561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fa502-8da2-43b8-8cbc-cd6437199db7 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:11.021195 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa88528-3e85-4a39-89ea-55e866b3347d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:11.021825 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa88528-3e85-4a39-89ea-55e866b3347d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:11.022117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa88528-3e85-4a39-89ea-55e866b3347d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:11.022376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa88528-3e85-4a39-89ea-55e866b3347d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:11.027570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abd9ae-7e73-4e97-b5d3-c4f182ed6855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:11.028254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abd9ae-7e73-4e97-b5d3-c4f182ed6855 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:11.028529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abd9ae-7e73-4e97-b5d3-c4f182ed6855 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:11.028796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abd9ae-7e73-4e97-b5d3-c4f182ed6855 None admin] PATH_INFO: `/v3/services/image` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:11.029376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abd9ae-7e73-4e97-b5d3-c4f182ed6855 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:11.030760 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abd9ae-7e73-4e97-b5d3-c4f182ed6855 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:11.037545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-60abd9ae-7e73-4e97-b5d3-c4f182ed6855 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:11.039824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:11.040850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:11.041826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 523/1053] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Aug 31 00:09:10 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:11.047001 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abd9ae-7e73-4e97-b5d3-c4f182ed6855 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:11.101197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa88528-3e85-4a39-89ea-55e866b3347d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:11.103066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa88528-3e85-4a39-89ea-55e866b3347d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:11.149887 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abd9ae-7e73-4e97-b5d3-c4f182ed6855 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:11.186151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ab235-022e-4802-a5d7-cc1cd0cdb5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:11.186764 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ab235-022e-4802-a5d7-cc1cd0cdb5ee None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:11.187041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ab235-022e-4802-a5d7-cc1cd0cdb5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:11.187310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ab235-022e-4802-a5d7-cc1cd0cdb5ee None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:11.187981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ab235-022e-4802-a5d7-cc1cd0cdb5ee None admin] RBAC: Adding query filter params (name=image) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:11.188295 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ab235-022e-4802-a5d7-cc1cd0cdb5ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:11.189696 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ab235-022e-4802-a5d7-cc1cd0cdb5ee None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:11.195284 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 524/1054] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:11.200976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ab235-022e-4802-a5d7-cc1cd0cdb5ee None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:11.216137 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 531/1055] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:10 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:11.222052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa88528-3e85-4a39-89ea-55e866b3347d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:11.229532 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:11.268720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:11.312002 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ab235-022e-4802-a5d7-cc1cd0cdb5ee None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:11.328779 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa88528-3e85-4a39-89ea-55e866b3347d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:11.349491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a633630-0c6d-4dd5-a0f2-91cf68381e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:11.350096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a633630-0c6d-4dd5-a0f2-91cf68381e0d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:11.350367 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a633630-0c6d-4dd5-a0f2-91cf68381e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:11.350640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a633630-0c6d-4dd5-a0f2-91cf68381e0d None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:11.351351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a633630-0c6d-4dd5-a0f2-91cf68381e0d None admin] RBAC: Adding query filter params (type=image) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:11.351568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a633630-0c6d-4dd5-a0f2-91cf68381e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:11.352979 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a633630-0c6d-4dd5-a0f2-91cf68381e0d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:11.362431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 525/1056] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:11.363376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a633630-0c6d-4dd5-a0f2-91cf68381e0d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:11.368442 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c65e9-db1c-4ad8-9eb4-d7b08b39d260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:11.369089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c65e9-db1c-4ad8-9eb4-d7b08b39d260 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:11.369369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c65e9-db1c-4ad8-9eb4-d7b08b39d260 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:11.369640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c65e9-db1c-4ad8-9eb4-d7b08b39d260 None admin] PATH_INFO: `/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:11.370759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c65e9-db1c-4ad8-9eb4-d7b08b39d260 None admin] RBAC: Authorizing `identity:get_project(project_id=b25d9c3d7a754be5a6fb5944b8708e24)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:11.372254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c65e9-db1c-4ad8-9eb4-d7b08b39d260 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:11.374078 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 532/1057] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:09:11 2022] GET /identity/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:11.380258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c65e9-db1c-4ad8-9eb4-d7b08b39d260 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:11.454889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:11.467843 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a633630-0c6d-4dd5-a0f2-91cf68381e0d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:11.486321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c65e9-db1c-4ad8-9eb4-d7b08b39d260 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:11.499782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:11.502275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40961f9b-0ccf-407a-9b9a-f34f3835dc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:11.503089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40961f9b-0ccf-407a-9b9a-f34f3835dc14 None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:11.503365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40961f9b-0ccf-407a-9b9a-f34f3835dc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:11.503635 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40961f9b-0ccf-407a-9b9a-f34f3835dc14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:11.504403 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40961f9b-0ccf-407a-9b9a-f34f3835dc14 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:11.506001 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40961f9b-0ccf-407a-9b9a-f34f3835dc14 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:11.526858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47108fac-d8f4-4120-93ce-9d7dfd430932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:11.527414 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47108fac-d8f4-4120-93ce-9d7dfd430932 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:11.527714 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47108fac-d8f4-4120-93ce-9d7dfd430932 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:11.535771 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47108fac-d8f4-4120-93ce-9d7dfd430932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:11.535974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 526/1058] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:09:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:09:11.536100 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47108fac-d8f4-4120-93ce-9d7dfd430932 None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=b25d9c3d7a754be5a6fb5944b8708e24, user.id=638e10e1c2334207869d9a02f119d0b0) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:11.536100 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47108fac-d8f4-4120-93ce-9d7dfd430932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:11.536100 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47108fac-d8f4-4120-93ce-9d7dfd430932 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:11.541188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 533/1059] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:11 2022] GET /identity/v3/role_assignments?user.id=638e10e1c2334207869d9a02f119d0b0&scope.project.id=b25d9c3d7a754be5a6fb5944b8708e24&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:11.687371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ee411-4cfb-4ab1-9f44-d30beac6faf8 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:11.687650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ee411-4cfb-4ab1-9f44-d30beac6faf8 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:11.687951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ee411-4cfb-4ab1-9f44-d30beac6faf8 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:11.689343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 527/1060] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:11.695717 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc5520-1bd4-4791-841c-04e75fbcf010 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:11.696000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc5520-1bd4-4791-841c-04e75fbcf010 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:11.696285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc5520-1bd4-4791-841c-04e75fbcf010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:11.715726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b4cc5520-1bd4-4791-841c-04e75fbcf010 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:11.716940 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b4cc5520-1bd4-4791-841c-04e75fbcf010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:11.791001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 534/1061] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:12.058724 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ee411-4cfb-4ab1-9f44-d30beac6faf8 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:12.168930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ee411-4cfb-4ab1-9f44-d30beac6faf8 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:12.205183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a88c9-6271-4f5b-a348-43e78b348582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:12.205828 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a88c9-6271-4f5b-a348-43e78b348582 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:12.206104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a88c9-6271-4f5b-a348-43e78b348582 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:12.206369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a88c9-6271-4f5b-a348-43e78b348582 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:12.216879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a88c9-6271-4f5b-a348-43e78b348582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-531a88c9-6271-4f5b-a348-43e78b348582 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:12.221720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:12.222681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:12.223568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:12.223568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:12.223568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:12.223568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:12.223568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:12.223568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:12.223568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:12.223568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:12.223568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:12.223568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:12.223568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:09:12.223568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:12.228188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 528/1062] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Aug 31 00:09:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:12.229059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc5520-1bd4-4791-841c-04e75fbcf010 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:12.328762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc5520-1bd4-4791-841c-04e75fbcf010 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:12.330181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:12.363664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25eb204-a72a-4571-ac83-411a75e20999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:12.364295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25eb204-a72a-4571-ac83-411a75e20999 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:12.364595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25eb204-a72a-4571-ac83-411a75e20999 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:12.364865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25eb204-a72a-4571-ac83-411a75e20999 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:12.365537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25eb204-a72a-4571-ac83-411a75e20999 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:12.365836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25eb204-a72a-4571-ac83-411a75e20999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:12.367204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25eb204-a72a-4571-ac83-411a75e20999 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:12.375538 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 535/1063] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Aug 31 00:09:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:12.381248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a88c9-6271-4f5b-a348-43e78b348582 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:12.385811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:12.484333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a88c9-6271-4f5b-a348-43e78b348582 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:12.520417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1823a-83d6-47ef-aba6-8f8f360c020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:12.521191 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1823a-83d6-47ef-aba6-8f8f360c020d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:12.521468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1823a-83d6-47ef-aba6-8f8f360c020d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:12.521739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1823a-83d6-47ef-aba6-8f8f360c020d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:12.532520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1823a-83d6-47ef-aba6-8f8f360c020d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:12.534032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1823a-83d6-47ef-aba6-8f8f360c020d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-4bf1823a-83d6-47ef-aba6-8f8f360c020d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:12.548988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:12.550017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:12.551276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:12.551276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:12.551276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:12.551276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 529/1064] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:09:12.556265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25eb204-a72a-4571-ac83-411a75e20999 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:12.665630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25eb204-a72a-4571-ac83-411a75e20999 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:12.700415 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84113b1-8b55-4017-992a-f9bdfbbaa3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:12.701024 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84113b1-8b55-4017-992a-f9bdfbbaa3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:12.701298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84113b1-8b55-4017-992a-f9bdfbbaa3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:12.701559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84113b1-8b55-4017-992a-f9bdfbbaa3f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:12.702199 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84113b1-8b55-4017-992a-f9bdfbbaa3f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:12.702492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84113b1-8b55-4017-992a-f9bdfbbaa3f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:12.703916 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84113b1-8b55-4017-992a-f9bdfbbaa3f3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:12.720382 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 536/1065] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:12.721829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1823a-83d6-47ef-aba6-8f8f360c020d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:12.783138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:12.832016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1823a-83d6-47ef-aba6-8f8f360c020d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:12.870890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae7c29-d3f9-4af4-b9b3-d1157b8ccda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:12.871540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae7c29-d3f9-4af4-b9b3-d1157b8ccda2 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:12.871847 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae7c29-d3f9-4af4-b9b3-d1157b8ccda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:12.872115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae7c29-d3f9-4af4-b9b3-d1157b8ccda2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:12.879720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae7c29-d3f9-4af4-b9b3-d1157b8ccda2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:12.881240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae7c29-d3f9-4af4-b9b3-d1157b8ccda2 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-23ae7c29-d3f9-4af4-b9b3-d1157b8ccda2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:09:12.892529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:12.893539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:12.894565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:12.894565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:12.894565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:09:12.894565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:09:12.894565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:09:12.894565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:09:12.894565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:09:12.894565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:09:12.894565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:09:12.894565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:12.895899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 530/1066] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 31 00:09:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:12.899602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84113b1-8b55-4017-992a-f9bdfbbaa3f3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:12.927812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:13.005122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84113b1-8b55-4017-992a-f9bdfbbaa3f3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:13.041179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e14a7-5f4c-41ba-aec7-78cb8b587e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:13.041795 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e14a7-5f4c-41ba-aec7-78cb8b587e77 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:13.042044 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e14a7-5f4c-41ba-aec7-78cb8b587e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:13.042336 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e14a7-5f4c-41ba-aec7-78cb8b587e77 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:13.043045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e14a7-5f4c-41ba-aec7-78cb8b587e77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:13.043345 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e14a7-5f4c-41ba-aec7-78cb8b587e77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:13.044787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e14a7-5f4c-41ba-aec7-78cb8b587e77 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:13.062541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 537/1067] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 31 00:09:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:13.068349 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae7c29-d3f9-4af4-b9b3-d1157b8ccda2 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:13.180128 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae7c29-d3f9-4af4-b9b3-d1157b8ccda2 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:13.197567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:13.217219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23f8e3-3c6a-4e36-b7d0-383fd7a35113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:13.217851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23f8e3-3c6a-4e36-b7d0-383fd7a35113 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:13.218128 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23f8e3-3c6a-4e36-b7d0-383fd7a35113 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:13.218387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23f8e3-3c6a-4e36-b7d0-383fd7a35113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:13.233390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23f8e3-3c6a-4e36-b7d0-383fd7a35113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:13.234873 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23f8e3-3c6a-4e36-b7d0-383fd7a35113 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-5f23f8e3-3c6a-4e36-b7d0-383fd7a35113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:13.251205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:13.252455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:13.253482 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:13.253482 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:13.253482 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:13.253482 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 531/1068] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:13.260185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e14a7-5f4c-41ba-aec7-78cb8b587e77 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:13.346689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:13.366491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e14a7-5f4c-41ba-aec7-78cb8b587e77 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:13.400320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101df38-9244-4c87-aea6-1772dd2ab3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:13.400928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101df38-9244-4c87-aea6-1772dd2ab3ea None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:13.401200 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101df38-9244-4c87-aea6-1772dd2ab3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:13.401467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101df38-9244-4c87-aea6-1772dd2ab3ea None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:13.402099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101df38-9244-4c87-aea6-1772dd2ab3ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:13.402394 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101df38-9244-4c87-aea6-1772dd2ab3ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:13.403771 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101df38-9244-4c87-aea6-1772dd2ab3ea None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:13.415501 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 538/1069] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:13.421065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23f8e3-3c6a-4e36-b7d0-383fd7a35113 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:13.448378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2c178-7af9-4f6d-bd07-d062cc70df4b None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:13.448562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2c178-7af9-4f6d-bd07-d062cc70df4b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:13.448925 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2c178-7af9-4f6d-bd07-d062cc70df4b None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:13.450434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 539/1070] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:13.455147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013a4ad-f081-465f-a781-91bae1305c75 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:13.455441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013a4ad-f081-465f-a781-91bae1305c75 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:13.455730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013a4ad-f081-465f-a781-91bae1305c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:13.474343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-6013a4ad-f081-465f-a781-91bae1305c75 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:13.475522 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6013a4ad-f081-465f-a781-91bae1305c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:13.528345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23f8e3-3c6a-4e36-b7d0-383fd7a35113 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:13.541585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 540/1071] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:13.542881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e280a41-3e51-422e-bbbf-f31b04ec0d1b None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:13.543162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e280a41-3e51-422e-bbbf-f31b04ec0d1b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:13.543439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e280a41-3e51-422e-bbbf-f31b04ec0d1b None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:13.544769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 541/1072] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:13.550022 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1020-225a-4b1e-8188-93c46e0d951f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:13.550309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1020-225a-4b1e-8188-93c46e0d951f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:13.550589 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1020-225a-4b1e-8188-93c46e0d951f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:13.566215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a3ed6-275a-4cd3-85f7-dbb4a8207b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:13.566848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a3ed6-275a-4cd3-85f7-dbb4a8207b47 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:13.567128 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a3ed6-275a-4cd3-85f7-dbb4a8207b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:13.567391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a3ed6-275a-4cd3-85f7-dbb4a8207b47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:13.569953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-198e1020-225a-4b1e-8188-93c46e0d951f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:13.571142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-198e1020-225a-4b1e-8188-93c46e0d951f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:13.575472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a3ed6-275a-4cd3-85f7-dbb4a8207b47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:13.576952 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a3ed6-275a-4cd3-85f7-dbb4a8207b47 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-aa7a3ed6-275a-4cd3-85f7-dbb4a8207b47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:09:13.589737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:13.590660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:13.596647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:09:13.596647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:09:13.596647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:09:13.596647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:09:13.596647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:09:13.596647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:09:13.596647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:13.596647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:13.596647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 532/1073] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:13.597172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a3ed6-275a-4cd3-85f7-dbb4a8207b47 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:13.625278 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:13.641968 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 542/1074] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:13.703629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a3ed6-275a-4cd3-85f7-dbb4a8207b47 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:13.738070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131950f-eb3f-4447-bebb-4e6ac0d30b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:13.738683 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131950f-eb3f-4447-bebb-4e6ac0d30b21 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:13.738961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131950f-eb3f-4447-bebb-4e6ac0d30b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:13.739220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131950f-eb3f-4447-bebb-4e6ac0d30b21 None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:13.739981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131950f-eb3f-4447-bebb-4e6ac0d30b21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:13.740285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131950f-eb3f-4447-bebb-4e6ac0d30b21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:13.741729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131950f-eb3f-4447-bebb-4e6ac0d30b21 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:13.753959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 533/1075] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:13.760029 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e1020-225a-4b1e-8188-93c46e0d951f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:13.762844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:13.805901 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131950f-eb3f-4447-bebb-4e6ac0d30b21 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:13.870979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e1020-225a-4b1e-8188-93c46e0d951f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:13.905920 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3c569-26bb-4140-b86e-f08d591a98c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:13.906591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3c569-26bb-4140-b86e-f08d591a98c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:13.906871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3c569-26bb-4140-b86e-f08d591a98c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:13.907117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3c569-26bb-4140-b86e-f08d591a98c3 None admin] PATH_INFO: `/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/cb9ef38ec3b448828826de5f76a552d8/roles/7f4c9cffd6cf443cb2c25965f0039293` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:13.909438 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3c569-26bb-4140-b86e-f08d591a98c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0864c2a6b50f403db79930d0869f8e23, user_id=cb9ef38ec3b448828826de5f76a552d8, role_id=7f4c9cffd6cf443cb2c25965f0039293)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:13.910139 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:13.910984 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3c569-26bb-4140-b86e-f08d591a98c3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:13.922803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131950f-eb3f-4447-bebb-4e6ac0d30b21 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:13.924526 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 543/1076] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:09:13 2022] PUT /identity/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/cb9ef38ec3b448828826de5f76a552d8/roles/7f4c9cffd6cf443cb2c25965f0039293 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:09:13.925315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3c569-26bb-4140-b86e-f08d591a98c3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:13.976697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c52a5c-35f1-4605-b01b-b62d8756616f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:13.977452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c52a5c-35f1-4605-b01b-b62d8756616f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:13.977731 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c52a5c-35f1-4605-b01b-b62d8756616f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:13.978058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c52a5c-35f1-4605-b01b-b62d8756616f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:13.990656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c52a5c-35f1-4605-b01b-b62d8756616f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-e6c52a5c-35f1-4605-b01b-b62d8756616f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:13.995906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:13.997346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:13.998383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:13.998383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:13.998383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:13.998383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:13.998383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:13.998383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:13.998383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:13.998383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:13.998383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:13.998383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:13.998383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:13.998383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:13.998383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 534/1077] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:09:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:09:14.001733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:14.003780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c52a5c-35f1-4605-b01b-b62d8756616f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:14.057186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3c569-26bb-4140-b86e-f08d591a98c3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:14.099829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36228af7-2c8f-4aef-b6ba-d4d141cd71c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:14.100584 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36228af7-2c8f-4aef-b6ba-d4d141cd71c3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:14.100864 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36228af7-2c8f-4aef-b6ba-d4d141cd71c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:14.101138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36228af7-2c8f-4aef-b6ba-d4d141cd71c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:14.118398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c52a5c-35f1-4605-b01b-b62d8756616f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:14.163061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90a3ff-ca60-425b-bba4-1981f5a74bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:14.163061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90a3ff-ca60-425b-bba4-1981f5a74bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:14.163061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90a3ff-ca60-425b-bba4-1981f5a74bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:14.163061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90a3ff-ca60-425b-bba4-1981f5a74bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:14.164043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90a3ff-ca60-425b-bba4-1981f5a74bb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:14.164043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90a3ff-ca60-425b-bba4-1981f5a74bb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:14.165401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90a3ff-ca60-425b-bba4-1981f5a74bb9 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:14.176218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 535/1078] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:14.177412 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36228af7-2c8f-4aef-b6ba-d4d141cd71c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:14.178952 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36228af7-2c8f-4aef-b6ba-d4d141cd71c3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:14.181805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90a3ff-ca60-425b-bba4-1981f5a74bb9 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:14.196103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:14.246184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:14.291736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 544/1079] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:14.292709 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90a3ff-ca60-425b-bba4-1981f5a74bb9 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:14.296323 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36228af7-2c8f-4aef-b6ba-d4d141cd71c3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:14.330995 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5c8fd-df44-45fd-9f3a-47519537bfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:14.331775 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5c8fd-df44-45fd-9f3a-47519537bfae None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:14.332117 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5c8fd-df44-45fd-9f3a-47519537bfae None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:14.332455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5c8fd-df44-45fd-9f3a-47519537bfae None admin] PATH_INFO: `/v3/users/638e10e1c2334207869d9a02f119d0b0` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:14.333672 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5c8fd-df44-45fd-9f3a-47519537bfae None admin] RBAC: Authorizing `identity:get_user(user_id=638e10e1c2334207869d9a02f119d0b0)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:14.335166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5c8fd-df44-45fd-9f3a-47519537bfae None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:14.337195 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 536/1080] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:14 2022] GET /identity/v3/users/638e10e1c2334207869d9a02f119d0b0 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:14.342543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5c8fd-df44-45fd-9f3a-47519537bfae None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:14.401306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36228af7-2c8f-4aef-b6ba-d4d141cd71c3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:14.424140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:14.437492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f4598-f2fc-467e-b82e-dd46d6cd814d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:14.438135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f4598-f2fc-467e-b82e-dd46d6cd814d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:14.438409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f4598-f2fc-467e-b82e-dd46d6cd814d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:14.438678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f4598-f2fc-467e-b82e-dd46d6cd814d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:14.448601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5c8fd-df44-45fd-9f3a-47519537bfae None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:14.449727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f4598-f2fc-467e-b82e-dd46d6cd814d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:14.451178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f4598-f2fc-467e-b82e-dd46d6cd814d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-436f4598-f2fc-467e-b82e-dd46d6cd814d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:14.465377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:14.466474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:14.467997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:14.467997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:14.467997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:14.467997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 545/1081] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:09:14.472358 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f4598-f2fc-467e-b82e-dd46d6cd814d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:14.488069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:14.489229 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853efa53-127a-4857-9819-cafe43d642dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:14.489802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853efa53-127a-4857-9819-cafe43d642dd None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:14.490088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853efa53-127a-4857-9819-cafe43d642dd None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:14.490365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853efa53-127a-4857-9819-cafe43d642dd None admin] PATH_INFO: `/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:14.491587 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853efa53-127a-4857-9819-cafe43d642dd None admin] RBAC: Authorizing `identity:get_project(project_id=b25d9c3d7a754be5a6fb5944b8708e24)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:14.493080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853efa53-127a-4857-9819-cafe43d642dd None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:14.495737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 537/1082] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:09:14 2022] GET /identity/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:14.500670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853efa53-127a-4857-9819-cafe43d642dd None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:14.583275 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f4598-f2fc-467e-b82e-dd46d6cd814d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:14.606926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853efa53-127a-4857-9819-cafe43d642dd None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:14.617931 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28869b0-c401-47c4-8392-a250976f51e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:14.618511 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28869b0-c401-47c4-8392-a250976f51e1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:14.618811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28869b0-c401-47c4-8392-a250976f51e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:14.619063 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28869b0-c401-47c4-8392-a250976f51e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:14.619718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28869b0-c401-47c4-8392-a250976f51e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:14.620058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28869b0-c401-47c4-8392-a250976f51e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:14.621456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28869b0-c401-47c4-8392-a250976f51e1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:14.634438 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 546/1083] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:14.643487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b3f08-3f96-4e0d-894f-588533df2397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:14.644224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3f08-3f96-4e0d-894f-588533df2397 None admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:14.644497 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3f08-3f96-4e0d-894f-588533df2397 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:14.644773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3f08-3f96-4e0d-894f-588533df2397 None admin] PATH_INFO: `/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24/users/638e10e1c2334207869d9a02f119d0b0/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:14.646827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b3f08-3f96-4e0d-894f-588533df2397 None admin] RBAC: Authorizing `identity:create_grant(project_id=b25d9c3d7a754be5a6fb5944b8708e24, user_id=638e10e1c2334207869d9a02f119d0b0, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:14.648377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b3f08-3f96-4e0d-894f-588533df2397 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:14.675794 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 538/1084] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:09:14 2022] PUT /identity/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24/users/638e10e1c2334207869d9a02f119d0b0/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:09:15.816776 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c043a-302c-4a87-9949-2750ebe55d0c None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:15.817436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c043a-302c-4a87-9949-2750ebe55d0c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:15.817436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c043a-302c-4a87-9949-2750ebe55d0c None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:15.818644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 547/1085] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:15.824568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5e8f-1ed5-4323-a762-5c41387b0b76 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:15.824978 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5e8f-1ed5-4323-a762-5c41387b0b76 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:15.825156 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5e8f-1ed5-4323-a762-5c41387b0b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:15.839016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:15.844742 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-10ab5e8f-1ed5-4323-a762-5c41387b0b76 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:15.846734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-10ab5e8f-1ed5-4323-a762-5c41387b0b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:15.915203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 539/1086] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:16.180751 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c043a-302c-4a87-9949-2750ebe55d0c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:16.260315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:16.286852 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c043a-302c-4a87-9949-2750ebe55d0c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:16.321305 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681e6fd-d2d2-48da-ac1b-54562198eadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:16.321935 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e6fd-d2d2-48da-ac1b-54562198eadb None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:16.322188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e6fd-d2d2-48da-ac1b-54562198eadb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:16.322481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e6fd-d2d2-48da-ac1b-54562198eadb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:16.334347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681e6fd-d2d2-48da-ac1b-54562198eadb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3681e6fd-d2d2-48da-ac1b-54562198eadb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:16.339313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:16.340403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:16.341303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:16.341303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:16.341303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:16.341303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:16.341303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:16.341303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:16.341303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:16.341303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:16.341303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:16.341303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:16.341303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:09:16.341303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:16.341303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 548/1087] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Aug 31 00:09:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:16.346745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab5e8f-1ed5-4323-a762-5c41387b0b76 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:16.453490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab5e8f-1ed5-4323-a762-5c41387b0b76 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:16.487895 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8be27e-92a9-47ee-b7b3-461e8550fee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:16.488496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8be27e-92a9-47ee-b7b3-461e8550fee9 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:16.488771 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8be27e-92a9-47ee-b7b3-461e8550fee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:16.489036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8be27e-92a9-47ee-b7b3-461e8550fee9 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:16.489700 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8be27e-92a9-47ee-b7b3-461e8550fee9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:16.490059 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8be27e-92a9-47ee-b7b3-461e8550fee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:16.491469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8be27e-92a9-47ee-b7b3-461e8550fee9 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:16.493671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:16.503913 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 540/1088] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Aug 31 00:09:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:16.506794 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681e6fd-d2d2-48da-ac1b-54562198eadb None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:16.564604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209962-601c-4c22-ab17-0c82179abb31 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:16.564881 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209962-601c-4c22-ab17-0c82179abb31 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:16.565150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209962-601c-4c22-ab17-0c82179abb31 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:16.566531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 541/1089] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:09:16.572043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3ea3c-ab2d-4132-af12-198d5431f78a None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:16.572322 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3ea3c-ab2d-4132-af12-198d5431f78a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:16.572587 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3ea3c-ab2d-4132-af12-198d5431f78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:16.591074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7ed3ea3c-ab2d-4132-af12-198d5431f78a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:16.592279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7ed3ea3c-ab2d-4132-af12-198d5431f78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:16.611545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681e6fd-d2d2-48da-ac1b-54562198eadb None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:16.644930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee5561-2bcc-46d4-b64f-fc1fa8592643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:16.645560 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee5561-2bcc-46d4-b64f-fc1fa8592643 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:16.645834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee5561-2bcc-46d4-b64f-fc1fa8592643 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:16.646114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee5561-2bcc-46d4-b64f-fc1fa8592643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:16.648067 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:16.657471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee5561-2bcc-46d4-b64f-fc1fa8592643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:16.658964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee5561-2bcc-46d4-b64f-fc1fa8592643 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:16.659636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 542/1090] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-a5ee5561-2bcc-46d4-b64f-fc1fa8592643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:16.673599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:16.674601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:16.675580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:16.675580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:16.675580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:16.675580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 549/1091] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:09:16.681264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3ea3c-ab2d-4132-af12-198d5431f78a None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:16.781417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3ea3c-ab2d-4132-af12-198d5431f78a None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:16.809894 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:16.819939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b99ef-1f87-4444-88fe-b71675a0d9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:16.820587 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b99ef-1f87-4444-88fe-b71675a0d9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:16.820864 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b99ef-1f87-4444-88fe-b71675a0d9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:16.821135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b99ef-1f87-4444-88fe-b71675a0d9c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:16.821788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b99ef-1f87-4444-88fe-b71675a0d9c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:16.822092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b99ef-1f87-4444-88fe-b71675a0d9c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:16.823481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b99ef-1f87-4444-88fe-b71675a0d9c7 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:16.836490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 543/1092] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:16.842542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee5561-2bcc-46d4-b64f-fc1fa8592643 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:16.937723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b99ef-1f87-4444-88fe-b71675a0d9c7 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:16.944819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee5561-2bcc-46d4-b64f-fc1fa8592643 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:16.978701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c9bab-8ae3-46c1-943f-31d300aa6c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:16.979341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9bab-8ae3-46c1-943f-31d300aa6c9a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:16.979616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9bab-8ae3-46c1-943f-31d300aa6c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:16.979912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9bab-8ae3-46c1-943f-31d300aa6c9a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:16.987360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c9bab-8ae3-46c1-943f-31d300aa6c9a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:16.988858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c9bab-8ae3-46c1-943f-31d300aa6c9a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-6c4c9bab-8ae3-46c1-943f-31d300aa6c9a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:09:16.999766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:17.000871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:17.001912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:17.001912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:17.001912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:09:17.001912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:09:17.001912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:09:17.001912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:09:17.001912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:09:17.001912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:09:17.001912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:09:17.001912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:17.001912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 550/1093] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Aug 31 00:09:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:17.006745 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c9bab-8ae3-46c1-943f-31d300aa6c9a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:17.040841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b99ef-1f87-4444-88fe-b71675a0d9c7 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:17.051724 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:17.074528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d723806-f29c-41aa-875a-7b0dec81bb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:17.075162 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723806-f29c-41aa-875a-7b0dec81bb6b None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.075455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723806-f29c-41aa-875a-7b0dec81bb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.075799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723806-f29c-41aa-875a-7b0dec81bb6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.086362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d723806-f29c-41aa-875a-7b0dec81bb6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-8d723806-f29c-41aa-875a-7b0dec81bb6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:17.091060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:17.092035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:17.093533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:17.093533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:17.093533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:17.093533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:17.093533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:17.093533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:17.093533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:17.093533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:17.093533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:17.093533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:17.093533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:17.093533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:17.093533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 544/1094] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:09:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:09:17.098225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d723806-f29c-41aa-875a-7b0dec81bb6b None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:17.104919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c9bab-8ae3-46c1-943f-31d300aa6c9a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:17.138888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a7984-efee-477c-9fb2-c4d8d7a2d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:17.139506 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a7984-efee-477c-9fb2-c4d8d7a2d3df None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.139829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a7984-efee-477c-9fb2-c4d8d7a2d3df None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.140108 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a7984-efee-477c-9fb2-c4d8d7a2d3df None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.140843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a7984-efee-477c-9fb2-c4d8d7a2d3df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:17.141150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a7984-efee-477c-9fb2-c4d8d7a2d3df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:17.142601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a7984-efee-477c-9fb2-c4d8d7a2d3df None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:17.147569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:17.161120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 551/1095] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Aug 31 00:09:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:17.167059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a7984-efee-477c-9fb2-c4d8d7a2d3df None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:17.202693 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d723806-f29c-41aa-875a-7b0dec81bb6b None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:17.234930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abd41a-f37a-4d74-ad5c-f3d50e9aa3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:17.235528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abd41a-f37a-4d74-ad5c-f3d50e9aa3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.235836 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abd41a-f37a-4d74-ad5c-f3d50e9aa3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.236086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abd41a-f37a-4d74-ad5c-f3d50e9aa3f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.236755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abd41a-f37a-4d74-ad5c-f3d50e9aa3f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:17.237047 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abd41a-f37a-4d74-ad5c-f3d50e9aa3f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:17.238457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abd41a-f37a-4d74-ad5c-f3d50e9aa3f8 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:17.247372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 545/1096] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:09:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:17.253302 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abd41a-f37a-4d74-ad5c-f3d50e9aa3f8 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:17.267122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a7984-efee-477c-9fb2-c4d8d7a2d3df None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:17.269549 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:17.304247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7439ef-c28f-4633-8734-07a5c7545834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:17.304774 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7439ef-c28f-4633-8734-07a5c7545834 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.305052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7439ef-c28f-4633-8734-07a5c7545834 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.305317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7439ef-c28f-4633-8734-07a5c7545834 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.353340 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abd41a-f37a-4d74-ad5c-f3d50e9aa3f8 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:17.363793 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:17.373738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7439ef-c28f-4633-8734-07a5c7545834 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:17.375664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7439ef-c28f-4633-8734-07a5c7545834 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:17.388729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3c40b-562a-4dfc-bada-403219cfe049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:17.389357 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c40b-562a-4dfc-bada-403219cfe049 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.389628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c40b-562a-4dfc-bada-403219cfe049 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.389900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c40b-562a-4dfc-bada-403219cfe049 None admin] PATH_INFO: `/v3/users/638e10e1c2334207869d9a02f119d0b0` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.391035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3c40b-562a-4dfc-bada-403219cfe049 None admin] RBAC: Authorizing `identity:get_user(user_id=638e10e1c2334207869d9a02f119d0b0)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:17.392524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3c40b-562a-4dfc-bada-403219cfe049 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:17.394115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 546/1097] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:17 2022] GET /identity/v3/users/638e10e1c2334207869d9a02f119d0b0 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:17.400327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3c40b-562a-4dfc-bada-403219cfe049 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:17.472610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 552/1098] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:09:17.478552 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7439ef-c28f-4633-8734-07a5c7545834 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:17.481385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:17.497167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3c40b-562a-4dfc-bada-403219cfe049 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:17.532414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23406-4fb4-4f10-9bd4-ea331e893469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:17.533019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23406-4fb4-4f10-9bd4-ea331e893469 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.533304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23406-4fb4-4f10-9bd4-ea331e893469 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.533575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23406-4fb4-4f10-9bd4-ea331e893469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.579070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:17.580206 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7439ef-c28f-4633-8734-07a5c7545834 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:17.601811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa23406-4fb4-4f10-9bd4-ea331e893469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:17.603321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa23406-4fb4-4f10-9bd4-ea331e893469 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:17.615338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f3418-0087-41ae-b67e-b6f63e79bceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:17.616112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f3418-0087-41ae-b67e-b6f63e79bceb None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.616394 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f3418-0087-41ae-b67e-b6f63e79bceb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.616658 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f3418-0087-41ae-b67e-b6f63e79bceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.626705 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f3418-0087-41ae-b67e-b6f63e79bceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:17.628174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f3418-0087-41ae-b67e-b6f63e79bceb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2d5f3418-0087-41ae-b67e-b6f63e79bceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:17.643076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:17.649472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:09:17.650656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:17.650656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:09:17.650656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:17.650656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 553/1099] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:17.650656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f3418-0087-41ae-b67e-b6f63e79bceb None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:17.707750 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 547/1100] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:09:17.710793 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23406-4fb4-4f10-9bd4-ea331e893469 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:17.712477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:17.758207 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f3418-0087-41ae-b67e-b6f63e79bceb None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:17.785879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:17.791450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4a76e-4578-4282-9efb-f0c92a1495ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:17.792112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4a76e-4578-4282-9efb-f0c92a1495ae None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.792403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4a76e-4578-4282-9efb-f0c92a1495ae None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.792672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4a76e-4578-4282-9efb-f0c92a1495ae None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.793321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4a76e-4578-4282-9efb-f0c92a1495ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:17.793623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4a76e-4578-4282-9efb-f0c92a1495ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:17.794994 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4a76e-4578-4282-9efb-f0c92a1495ae None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:17.806718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 554/1101] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:17.807456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23406-4fb4-4f10-9bd4-ea331e893469 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:17.812489 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4a76e-4578-4282-9efb-f0c92a1495ae None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:17.843902 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc370d-64ff-4616-b2ad-70f653bd2717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:17.844485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc370d-64ff-4616-b2ad-70f653bd2717 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.844760 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc370d-64ff-4616-b2ad-70f653bd2717 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.845034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc370d-64ff-4616-b2ad-70f653bd2717 None admin] PATH_INFO: `/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.846184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc370d-64ff-4616-b2ad-70f653bd2717 None admin] RBAC: Authorizing `identity:get_project(project_id=b25d9c3d7a754be5a6fb5944b8708e24)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:17.847627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc370d-64ff-4616-b2ad-70f653bd2717 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:17.849299 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 548/1102] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:09:17 2022] GET /identity/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:17.855343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc370d-64ff-4616-b2ad-70f653bd2717 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:17.910421 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4a76e-4578-4282-9efb-f0c92a1495ae None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:17.926748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:17.945356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e9aa3-93ed-4be4-8da6-0f3a3cb86a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:17.945991 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e9aa3-93ed-4be4-8da6-0f3a3cb86a08 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.946269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e9aa3-93ed-4be4-8da6-0f3a3cb86a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.946536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e9aa3-93ed-4be4-8da6-0f3a3cb86a08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.953155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc370d-64ff-4616-b2ad-70f653bd2717 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:17.953494 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e9aa3-93ed-4be4-8da6-0f3a3cb86a08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:17.954949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e9aa3-93ed-4be4-8da6-0f3a3cb86a08 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e28e9aa3-93ed-4be4-8da6-0f3a3cb86a08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:09:17.966247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:17.967290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:17.968471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:09:17.968471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:09:17.968471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:09:17.968471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:09:17.968471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:09:17.968471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:09:17.968471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:09:17.968471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:17.968471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 555/1103] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:09:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:17.973207 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e9aa3-93ed-4be4-8da6-0f3a3cb86a08 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:17.991516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facc025-2de1-4ccf-b47a-cfc5424eed70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:17.992154 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facc025-2de1-4ccf-b47a-cfc5424eed70 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.992432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facc025-2de1-4ccf-b47a-cfc5424eed70 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.992702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facc025-2de1-4ccf-b47a-cfc5424eed70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.993410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facc025-2de1-4ccf-b47a-cfc5424eed70 None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=b25d9c3d7a754be5a6fb5944b8708e24, user.id=638e10e1c2334207869d9a02f119d0b0) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:17.993717 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facc025-2de1-4ccf-b47a-cfc5424eed70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:17.995166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facc025-2de1-4ccf-b47a-cfc5424eed70 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:18.000814 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 549/1104] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:17 2022] GET /identity/v3/role_assignments?user.id=638e10e1c2334207869d9a02f119d0b0&scope.project.id=b25d9c3d7a754be5a6fb5944b8708e24&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:18.087381 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e9aa3-93ed-4be4-8da6-0f3a3cb86a08 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:18.123230 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8fc8c-7890-4750-bcbc-dc369f0d8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:18.123913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8fc8c-7890-4750-bcbc-dc369f0d8ffd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:18.124189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8fc8c-7890-4750-bcbc-dc369f0d8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:18.124458 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8fc8c-7890-4750-bcbc-dc369f0d8ffd None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:18.125161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8fc8c-7890-4750-bcbc-dc369f0d8ffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:18.125462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8fc8c-7890-4750-bcbc-dc369f0d8ffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:18.126917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8fc8c-7890-4750-bcbc-dc369f0d8ffd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:18.140408 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 556/1105] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:09:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:18.146909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facc025-2de1-4ccf-b47a-cfc5424eed70 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:18.161220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:18.253857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facc025-2de1-4ccf-b47a-cfc5424eed70 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:18.288091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849c993-f148-411a-b566-4bf3e225419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:18.288710 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849c993-f148-411a-b566-4bf3e225419d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:18.289033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849c993-f148-411a-b566-4bf3e225419d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:18.289308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849c993-f148-411a-b566-4bf3e225419d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:18.290045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849c993-f148-411a-b566-4bf3e225419d None admin] RBAC: Adding query filter params (role.id=7f4c9cffd6cf443cb2c25965f0039293, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=cb9ef38ec3b448828826de5f76a552d8) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:18.290352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849c993-f148-411a-b566-4bf3e225419d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:18.291802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849c993-f148-411a-b566-4bf3e225419d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:18.297656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 550/1106] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:18 2022] GET /identity/v3/role_assignments?user.id=cb9ef38ec3b448828826de5f76a552d8&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=7f4c9cffd6cf443cb2c25965f0039293 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:19.924967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bffb38-7ae4-4635-a616-e0d4b701ed55 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:19.925528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bffb38-7ae4-4635-a616-e0d4b701ed55 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:19.925528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bffb38-7ae4-4635-a616-e0d4b701ed55 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:19.927598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 557/1107] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:19.936543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7e8b2-e155-4ed2-b18c-98b4d73612a6 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:19.936945 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7e8b2-e155-4ed2-b18c-98b4d73612a6 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:19.937155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7e8b2-e155-4ed2-b18c-98b4d73612a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:19.958721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-2ee7e8b2-e155-4ed2-b18c-98b4d73612a6 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:19.960108 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2ee7e8b2-e155-4ed2-b18c-98b4d73612a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:20.031844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 551/1108] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:20.309840 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bffb38-7ae4-4635-a616-e0d4b701ed55 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:20.359158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:20.431150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bffb38-7ae4-4635-a616-e0d4b701ed55 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:20.477445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91d938-64c7-4aa0-9827-246968f236ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:20.478072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91d938-64c7-4aa0-9827-246968f236ed None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:20.478348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91d938-64c7-4aa0-9827-246968f236ed None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:20.478615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91d938-64c7-4aa0-9827-246968f236ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:20.479737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91d938-64c7-4aa0-9827-246968f236ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:20.481205 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91d938-64c7-4aa0-9827-246968f236ed None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:20.482744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 558/1109] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:20.488875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7e8b2-e155-4ed2-b18c-98b4d73612a6 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:20.492451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:20.603485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7e8b2-e155-4ed2-b18c-98b4d73612a6 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:20.637858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c35c60-d47a-4248-a524-227c4058b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:20.638460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c35c60-d47a-4248-a524-227c4058b0d3 None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:20.638740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c35c60-d47a-4248-a524-227c4058b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:20.639011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c35c60-d47a-4248-a524-227c4058b0d3 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:20.639726 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c35c60-d47a-4248-a524-227c4058b0d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:20.641199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c35c60-d47a-4248-a524-227c4058b0d3 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:20.667102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 552/1110] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:09:20 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:22.627743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9859f5-7c33-465f-ba5e-3ee00c1432d4 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:22.628581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9859f5-7c33-465f-ba5e-3ee00c1432d4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:22.628581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9859f5-7c33-465f-ba5e-3ee00c1432d4 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:22.630745 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 559/1111] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:22.637143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa22b5-17a3-4921-bd7d-5963f94683e3 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:22.637568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa22b5-17a3-4921-bd7d-5963f94683e3 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:22.637726 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa22b5-17a3-4921-bd7d-5963f94683e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:22.661274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-4faa22b5-17a3-4921-bd7d-5963f94683e3 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:22.662495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-4faa22b5-17a3-4921-bd7d-5963f94683e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:22.726595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:22.739941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 553/1112] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:23.008404 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9859f5-7c33-465f-ba5e-3ee00c1432d4 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:23.122412 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9859f5-7c33-465f-ba5e-3ee00c1432d4 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:23.124793 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:23.156511 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a902ea3-192d-4958-8a01-7bbe798ea401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:23.157154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a902ea3-192d-4958-8a01-7bbe798ea401 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:23.157430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a902ea3-192d-4958-8a01-7bbe798ea401 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:23.157704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a902ea3-192d-4958-8a01-7bbe798ea401 None admin] PATH_INFO: `/v3/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:23.159187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a902ea3-192d-4958-8a01-7bbe798ea401 None admin] RBAC: Authorizing `identity:get_role(role_id=f9b0f326bcf6425d9e2aa62dc35ddbc1)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:23.160588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a902ea3-192d-4958-8a01-7bbe798ea401 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:23.161912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 560/1113] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:23 2022] GET /identity/v3/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:23.169905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa22b5-17a3-4921-bd7d-5963f94683e3 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:23.279251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa22b5-17a3-4921-bd7d-5963f94683e3 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:23.314201 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51de64e-ef18-4de3-928b-34f1abaa5fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:23.314817 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51de64e-ef18-4de3-928b-34f1abaa5fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:23.315091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51de64e-ef18-4de3-928b-34f1abaa5fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:23.315364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51de64e-ef18-4de3-928b-34f1abaa5fb2 None admin] PATH_INFO: `/v3/users/ee2ec4ee422d40288b718145ee4cd439` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:23.328731 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51de64e-ef18-4de3-928b-34f1abaa5fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=ee2ec4ee422d40288b718145ee4cd439)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:23.330187 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51de64e-ef18-4de3-928b-34f1abaa5fb2 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:23.331844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 554/1114] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:23 2022] GET /identity/v3/users/ee2ec4ee422d40288b718145ee4cd439 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:23.338267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a902ea3-192d-4958-8a01-7bbe798ea401 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:23.448407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a902ea3-192d-4958-8a01-7bbe798ea401 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:23.487147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f9102-6057-48ba-99eb-3f3b95d37b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:23.487743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f9102-6057-48ba-99eb-3f3b95d37b26 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:23.488049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f9102-6057-48ba-99eb-3f3b95d37b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:23.488322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f9102-6057-48ba-99eb-3f3b95d37b26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:23.529894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:23.565310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f9102-6057-48ba-99eb-3f3b95d37b26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:23.567534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f9102-6057-48ba-99eb-3f3b95d37b26 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:23.675273 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 561/1115] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:23.685010 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51de64e-ef18-4de3-928b-34f1abaa5fb2 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:23.740039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:23.796673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51de64e-ef18-4de3-928b-34f1abaa5fb2 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:23.833498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3eef79-ff93-45c2-ba23-f5b5a6ad6ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:23.834127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eef79-ff93-45c2-ba23-f5b5a6ad6ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:23.834412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eef79-ff93-45c2-ba23-f5b5a6ad6ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:23.834686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eef79-ff93-45c2-ba23-f5b5a6ad6ed8 None admin] PATH_INFO: `/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:23.836018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3eef79-ff93-45c2-ba23-f5b5a6ad6ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=b25d9c3d7a754be5a6fb5944b8708e24)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:23.837452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3eef79-ff93-45c2-ba23-f5b5a6ad6ed8 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:23.839178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 555/1116] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:09:23 2022] GET /identity/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:23.846026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f9102-6057-48ba-99eb-3f3b95d37b26 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:23.919984 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:23.950317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f9102-6057-48ba-99eb-3f3b95d37b26 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:23.985719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e407ba-03a3-437c-9291-c832ed8711b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:23.986315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e407ba-03a3-437c-9291-c832ed8711b6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:23.986590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e407ba-03a3-437c-9291-c832ed8711b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:23.986861 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e407ba-03a3-437c-9291-c832ed8711b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:23.987578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e407ba-03a3-437c-9291-c832ed8711b6 None admin] RBAC: Adding query filter params (role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1, scope.project.id=b25d9c3d7a754be5a6fb5944b8708e24, user.id=ee2ec4ee422d40288b718145ee4cd439) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:23.987915 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e407ba-03a3-437c-9291-c832ed8711b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:23.989364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e407ba-03a3-437c-9291-c832ed8711b6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:23.994845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 562/1117] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:23 2022] GET /identity/v3/role_assignments?user.id=ee2ec4ee422d40288b718145ee4cd439&scope.project.id=b25d9c3d7a754be5a6fb5944b8708e24&role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:25.843337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd52c0-1f59-4621-bc90-e179d82463ab None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:25.844209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd52c0-1f59-4621-bc90-e179d82463ab None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:25.844209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd52c0-1f59-4621-bc90-e179d82463ab None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:25.846370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 556/1118] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:25.851860 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df3974-6144-49de-8912-b78af27ebe32 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:25.852314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df3974-6144-49de-8912-b78af27ebe32 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:25.852423 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df3974-6144-49de-8912-b78af27ebe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:25.871901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-04df3974-6144-49de-8912-b78af27ebe32 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:25.873081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-04df3974-6144-49de-8912-b78af27ebe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:25.943579 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 563/1119] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:26.206507 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd52c0-1f59-4621-bc90-e179d82463ab None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:26.317781 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd52c0-1f59-4621-bc90-e179d82463ab None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:26.335565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:26.365565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936996d4-ddde-44d7-92c1-920b8684d49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:26.366966 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936996d4-ddde-44d7-92c1-920b8684d49c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:26.367277 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936996d4-ddde-44d7-92c1-920b8684d49c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:26.367554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936996d4-ddde-44d7-92c1-920b8684d49c None admin] PATH_INFO: `/v3/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:26.369201 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936996d4-ddde-44d7-92c1-920b8684d49c None admin] RBAC: Authorizing `identity:get_role(role_id=f9b0f326bcf6425d9e2aa62dc35ddbc1)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:26.370593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936996d4-ddde-44d7-92c1-920b8684d49c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:26.371982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 557/1120] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:26 2022] GET /identity/v3/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 223 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:26.378171 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df3974-6144-49de-8912-b78af27ebe32 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:26.447664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:26.492457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df3974-6144-49de-8912-b78af27ebe32 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:26.535773 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6d178-2bce-4d40-9e49-bd7e13e431f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:26.536730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6d178-2bce-4d40-9e49-bd7e13e431f1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:26.537108 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6d178-2bce-4d40-9e49-bd7e13e431f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:26.537453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6d178-2bce-4d40-9e49-bd7e13e431f1 None admin] PATH_INFO: `/v3/users/ee2ec4ee422d40288b718145ee4cd439` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:26.538899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6d178-2bce-4d40-9e49-bd7e13e431f1 None admin] RBAC: Authorizing `identity:get_user(user_id=ee2ec4ee422d40288b718145ee4cd439)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:26.540387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6d178-2bce-4d40-9e49-bd7e13e431f1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:26.541967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 564/1121] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:26 2022] GET /identity/v3/users/ee2ec4ee422d40288b718145ee4cd439 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:26.550433 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936996d4-ddde-44d7-92c1-920b8684d49c None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:26.667579 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936996d4-ddde-44d7-92c1-920b8684d49c None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:26.709556 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f63f19-5b37-4885-8aa7-6e92d37f29ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:26.710384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f63f19-5b37-4885-8aa7-6e92d37f29ed None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:26.710805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f63f19-5b37-4885-8aa7-6e92d37f29ed None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:26.711224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f63f19-5b37-4885-8aa7-6e92d37f29ed None admin] PATH_INFO: `/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:26.713215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f63f19-5b37-4885-8aa7-6e92d37f29ed None admin] RBAC: Authorizing `identity:get_project(project_id=b25d9c3d7a754be5a6fb5944b8708e24)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:26.715396 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f63f19-5b37-4885-8aa7-6e92d37f29ed None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:26.718032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 558/1122] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:09:26 2022] GET /identity/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:26.724451 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6d178-2bce-4d40-9e49-bd7e13e431f1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:26.839711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6d178-2bce-4d40-9e49-bd7e13e431f1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:26.876648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32afc37-77aa-415e-a4e4-6d317ad03683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:26.877310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32afc37-77aa-415e-a4e4-6d317ad03683 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:26.877573 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32afc37-77aa-415e-a4e4-6d317ad03683 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:26.877845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32afc37-77aa-415e-a4e4-6d317ad03683 None admin] PATH_INFO: `/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24/users/ee2ec4ee422d40288b718145ee4cd439/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:26.880146 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32afc37-77aa-415e-a4e4-6d317ad03683 None admin] RBAC: Authorizing `identity:create_grant(project_id=b25d9c3d7a754be5a6fb5944b8708e24, user_id=ee2ec4ee422d40288b718145ee4cd439, role_id=f9b0f326bcf6425d9e2aa62dc35ddbc1)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:26.881581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32afc37-77aa-415e-a4e4-6d317ad03683 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:26.883749 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:26.897103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 565/1123] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:09:26 2022] PUT /identity/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24/users/ee2ec4ee422d40288b718145ee4cd439/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:09:28.747638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa5027-012d-4dd0-b136-3670914505c2 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:28.748251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa5027-012d-4dd0-b136-3670914505c2 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:28.748251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa5027-012d-4dd0-b136-3670914505c2 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:28.749575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 559/1124] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:28.755691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c92b4-c680-4022-a445-c37f296688bb None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:28.756474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c92b4-c680-4022-a445-c37f296688bb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:28.756625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c92b4-c680-4022-a445-c37f296688bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:28.776960 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-870c92b4-c680-4022-a445-c37f296688bb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:28.778153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-870c92b4-c680-4022-a445-c37f296688bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:28.859949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 566/1125] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:29.133103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa5027-012d-4dd0-b136-3670914505c2 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:29.189390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:29.242175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa5027-012d-4dd0-b136-3670914505c2 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:29.277244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202d315-c93c-48ed-93ec-414c04045728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:29.277870 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d315-c93c-48ed-93ec-414c04045728 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:29.278144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d315-c93c-48ed-93ec-414c04045728 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:29.278418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d315-c93c-48ed-93ec-414c04045728 None admin] PATH_INFO: `/v3/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:29.279884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202d315-c93c-48ed-93ec-414c04045728 None admin] RBAC: Authorizing `identity:get_role(role_id=f9b0f326bcf6425d9e2aa62dc35ddbc1)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:29.281257 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202d315-c93c-48ed-93ec-414c04045728 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:29.282594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 560/1126] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:29 2022] GET /identity/v3/roles/f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:29.292003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c92b4-c680-4022-a445-c37f296688bb None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:29.411736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c92b4-c680-4022-a445-c37f296688bb None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:29.437555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:29.451139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83594dd8-6738-42ad-a4ca-04bc900fff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:29.451808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83594dd8-6738-42ad-a4ca-04bc900fff7f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:29.452116 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83594dd8-6738-42ad-a4ca-04bc900fff7f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:29.452370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83594dd8-6738-42ad-a4ca-04bc900fff7f None admin] PATH_INFO: `/v3/users/ee2ec4ee422d40288b718145ee4cd439` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:29.453521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83594dd8-6738-42ad-a4ca-04bc900fff7f None admin] RBAC: Authorizing `identity:get_user(user_id=ee2ec4ee422d40288b718145ee4cd439)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:29.454965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83594dd8-6738-42ad-a4ca-04bc900fff7f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:29.456607 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 567/1127] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:29 2022] GET /identity/v3/users/ee2ec4ee422d40288b718145ee4cd439 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:29.463266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202d315-c93c-48ed-93ec-414c04045728 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:29.568572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202d315-c93c-48ed-93ec-414c04045728 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:29.588719 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:29.607441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b5a92-f776-42cd-ae8d-4a33a9cb0c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:29.608091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b5a92-f776-42cd-ae8d-4a33a9cb0c16 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:29.608367 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b5a92-f776-42cd-ae8d-4a33a9cb0c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:29.608624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b5a92-f776-42cd-ae8d-4a33a9cb0c16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:29.680220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b5a92-f776-42cd-ae8d-4a33a9cb0c16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:29.681618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b5a92-f776-42cd-ae8d-4a33a9cb0c16 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:29.791807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 561/1128] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:29.800614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83594dd8-6738-42ad-a4ca-04bc900fff7f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:29.919064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83594dd8-6738-42ad-a4ca-04bc900fff7f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:29.957427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967e732-f132-4f27-ac71-cd5f46d5eac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:29.958255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967e732-f132-4f27-ac71-cd5f46d5eac3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:29.958534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967e732-f132-4f27-ac71-cd5f46d5eac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:29.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967e732-f132-4f27-ac71-cd5f46d5eac3 None admin] PATH_INFO: `/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:29.960013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967e732-f132-4f27-ac71-cd5f46d5eac3 None admin] RBAC: Authorizing `identity:get_project(project_id=b25d9c3d7a754be5a6fb5944b8708e24)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:29.961572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967e732-f132-4f27-ac71-cd5f46d5eac3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:29.963213 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 568/1129] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:09:29 2022] GET /identity/v3/projects/b25d9c3d7a754be5a6fb5944b8708e24 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:29.973282 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b5a92-f776-42cd-ae8d-4a33a9cb0c16 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:30.005280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:30.098301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b5a92-f776-42cd-ae8d-4a33a9cb0c16 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:30.136701 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15c973-7b11-4759-9a80-03985babbf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:30.137316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c973-7b11-4759-9a80-03985babbf98 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:30.137593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c973-7b11-4759-9a80-03985babbf98 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:30.137859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c973-7b11-4759-9a80-03985babbf98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:30.138564 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15c973-7b11-4759-9a80-03985babbf98 None admin] RBAC: Adding query filter params (role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1, scope.project.id=b25d9c3d7a754be5a6fb5944b8708e24, user.id=ee2ec4ee422d40288b718145ee4cd439) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:30.138889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15c973-7b11-4759-9a80-03985babbf98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:30.140384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15c973-7b11-4759-9a80-03985babbf98 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:30.151178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 562/1130] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:29 2022] GET /identity/v3/role_assignments?user.id=ee2ec4ee422d40288b718145ee4cd439&scope.project.id=b25d9c3d7a754be5a6fb5944b8708e24&role.id=f9b0f326bcf6425d9e2aa62dc35ddbc1 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:32.106776 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b68-8a71-4b9f-aad3-2e2a8cdf675f None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:32.107327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b68-8a71-4b9f-aad3-2e2a8cdf675f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:32.107327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b68-8a71-4b9f-aad3-2e2a8cdf675f None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:32.109389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 569/1131] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:32.114776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf0d1c-7467-4b50-b660-e79ad286659e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:32.115209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf0d1c-7467-4b50-b660-e79ad286659e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:32.115312 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf0d1c-7467-4b50-b660-e79ad286659e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:32.135077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-8ecf0d1c-7467-4b50-b660-e79ad286659e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:32.136299 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-8ecf0d1c-7467-4b50-b660-e79ad286659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:32.210100 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 563/1132] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:32.485559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909b68-8a71-4b9f-aad3-2e2a8cdf675f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:32.553660 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:32.598790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909b68-8a71-4b9f-aad3-2e2a8cdf675f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:32.635228 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f518c75-65a4-4d85-a855-7597ec4aaceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:32.635874 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f518c75-65a4-4d85-a855-7597ec4aaceb None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:32.636154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f518c75-65a4-4d85-a855-7597ec4aaceb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:32.636426 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f518c75-65a4-4d85-a855-7597ec4aaceb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:32.637574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f518c75-65a4-4d85-a855-7597ec4aaceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:32.639048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f518c75-65a4-4d85-a855-7597ec4aaceb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:32.640634 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 570/1133] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:32.646689 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf0d1c-7467-4b50-b660-e79ad286659e None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:32.668852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:32.761170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf0d1c-7467-4b50-b660-e79ad286659e None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:32.797594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b5767-f6e7-4f02-9e90-d0d4edb24179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:32.798214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b5767-f6e7-4f02-9e90-d0d4edb24179 None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:32.798488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b5767-f6e7-4f02-9e90-d0d4edb24179 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:32.798737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b5767-f6e7-4f02-9e90-d0d4edb24179 None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:32.799384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b5767-f6e7-4f02-9e90-d0d4edb24179 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:32.800874 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b5767-f6e7-4f02-9e90-d0d4edb24179 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:32.830798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 564/1134] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 31 00:09:32 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:34.751381 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9f736-ff64-4c49-9604-bf22ae4d191f None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:34.751973 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9f736-ff64-4c49-9604-bf22ae4d191f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:34.751973 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9f736-ff64-4c49-9604-bf22ae4d191f None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:34.753303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 571/1135] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:34.759596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb093a6b-20bc-4eb1-96aa-e89e02cd031b None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:34.760350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb093a6b-20bc-4eb1-96aa-e89e02cd031b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:34.760505 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb093a6b-20bc-4eb1-96aa-e89e02cd031b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:34.790861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-eb093a6b-20bc-4eb1-96aa-e89e02cd031b None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:34.792087 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-eb093a6b-20bc-4eb1-96aa-e89e02cd031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:34.863170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:34.872865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 565/1136] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:35.157561 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9f736-ff64-4c49-9604-bf22ae4d191f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:35.267721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9f736-ff64-4c49-9604-bf22ae4d191f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:35.294433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:35.302952 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ae1a2-1103-479f-b049-571a8d34f4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:35.303575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae1a2-1103-479f-b049-571a8d34f4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:35.303889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae1a2-1103-479f-b049-571a8d34f4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:35.304174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae1a2-1103-479f-b049-571a8d34f4b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:35.305410 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ae1a2-1103-479f-b049-571a8d34f4b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:35.306850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ae1a2-1103-479f-b049-571a8d34f4b4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:35.308451 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 572/1137] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:09:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:35.314571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb093a6b-20bc-4eb1-96aa-e89e02cd031b None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:35.419444 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb093a6b-20bc-4eb1-96aa-e89e02cd031b None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:35.453292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1309bf-2267-415e-ad61-42f85527e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:35.453888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1309bf-2267-415e-ad61-42f85527e124 None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:35.454169 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1309bf-2267-415e-ad61-42f85527e124 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:35.454445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1309bf-2267-415e-ad61-42f85527e124 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:35.455092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1309bf-2267-415e-ad61-42f85527e124 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:35.456551 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1309bf-2267-415e-ad61-42f85527e124 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:35.480435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 566/1138] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:09:35 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:37.403742 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358da9-7926-43d0-985d-8f02450b79e1 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:37.404624 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358da9-7926-43d0-985d-8f02450b79e1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:37.404624 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358da9-7926-43d0-985d-8f02450b79e1 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:37.406935 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 573/1139] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:37.413216 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2c0ef-b199-4dce-9256-995cce50d96d None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:37.413923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2c0ef-b199-4dce-9256-995cce50d96d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:37.414220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2c0ef-b199-4dce-9256-995cce50d96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:37.439673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-25e2c0ef-b199-4dce-9256-995cce50d96d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:37.440815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-25e2c0ef-b199-4dce-9256-995cce50d96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:37.490742 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:37.513747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 567/1140] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:37.782447 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb358da9-7926-43d0-985d-8f02450b79e1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:37.898298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb358da9-7926-43d0-985d-8f02450b79e1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:37.937046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c82de-d4d7-4a2e-a1ed-78ecbd86dbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:37.937677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c82de-d4d7-4a2e-a1ed-78ecbd86dbed None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:37.937961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c82de-d4d7-4a2e-a1ed-78ecbd86dbed None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:37.938233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c82de-d4d7-4a2e-a1ed-78ecbd86dbed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:37.949903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c82de-d4d7-4a2e-a1ed-78ecbd86dbed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-5e7c82de-d4d7-4a2e-a1ed-78ecbd86dbed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:37.954710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:37.956183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:37.957247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:37.957247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:37.957247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:37.957247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:37.957247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:37.957247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:37.957247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:37.957247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:37.957247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:37.957247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:37.957247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:37.957247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:37.957247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 574/1141] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:09:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:37.964324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2c0ef-b199-4dce-9256-995cce50d96d None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:38.076195 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2c0ef-b199-4dce-9256-995cce50d96d None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:38.113646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86efc4-5fce-4efd-8776-a50122b71267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:38.114237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86efc4-5fce-4efd-8776-a50122b71267 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:38.114508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86efc4-5fce-4efd-8776-a50122b71267 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:38.114781 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86efc4-5fce-4efd-8776-a50122b71267 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:38.115439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86efc4-5fce-4efd-8776-a50122b71267 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:38.115732 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86efc4-5fce-4efd-8776-a50122b71267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:38.117142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86efc4-5fce-4efd-8776-a50122b71267 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:38.125319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 568/1142] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:09:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:38.131947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c82de-d4d7-4a2e-a1ed-78ecbd86dbed None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:38.193713 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:38.238784 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c82de-d4d7-4a2e-a1ed-78ecbd86dbed None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:38.279173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cdafb-d4b1-4015-ba1c-22429aa1045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:38.279826 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cdafb-d4b1-4015-ba1c-22429aa1045c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:38.280104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cdafb-d4b1-4015-ba1c-22429aa1045c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:38.280378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cdafb-d4b1-4015-ba1c-22429aa1045c None admin] PATH_INFO: `/v3/users/78e3165c6b584be2865c777a0e373b0f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:38.295086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cdafb-d4b1-4015-ba1c-22429aa1045c None admin] RBAC: Authorizing `identity:get_user(user_id=78e3165c6b584be2865c777a0e373b0f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:38.296545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cdafb-d4b1-4015-ba1c-22429aa1045c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:38.298157 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 575/1143] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:38 2022] GET /identity/v3/users/78e3165c6b584be2865c777a0e373b0f => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:38.304626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86efc4-5fce-4efd-8776-a50122b71267 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:38.358601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:38.414527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86efc4-5fce-4efd-8776-a50122b71267 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:38.449718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f17c73-ecd1-4431-8c63-c50b6f23690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:38.450325 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f17c73-ecd1-4431-8c63-c50b6f23690d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:38.450604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f17c73-ecd1-4431-8c63-c50b6f23690d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:38.450873 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f17c73-ecd1-4431-8c63-c50b6f23690d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:38.523503 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f17c73-ecd1-4431-8c63-c50b6f23690d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:38.524995 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f17c73-ecd1-4431-8c63-c50b6f23690d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:38.570362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:38.629617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 569/1144] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:38.636443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cdafb-d4b1-4015-ba1c-22429aa1045c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:38.758354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cdafb-d4b1-4015-ba1c-22429aa1045c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:38.774046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:38.808118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dad4c-f0c8-4a19-a307-7f1168184dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:38.808759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dad4c-f0c8-4a19-a307-7f1168184dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:38.809080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dad4c-f0c8-4a19-a307-7f1168184dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:38.809351 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dad4c-f0c8-4a19-a307-7f1168184dd0 None admin] PATH_INFO: `/v3/projects/f0dc2bb27ad84e4a9637fab34310feab` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:38.810512 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dad4c-f0c8-4a19-a307-7f1168184dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=f0dc2bb27ad84e4a9637fab34310feab)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:38.811980 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dad4c-f0c8-4a19-a307-7f1168184dd0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:38.813615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 576/1145] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:09:38 2022] GET /identity/v3/projects/f0dc2bb27ad84e4a9637fab34310feab => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:38.820067 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f17c73-ecd1-4431-8c63-c50b6f23690d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:38.925678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f17c73-ecd1-4431-8c63-c50b6f23690d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:38.964194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103c9d7-d71d-4dee-9f5b-8b29c8eae40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:38.964811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103c9d7-d71d-4dee-9f5b-8b29c8eae40c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:38.965099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103c9d7-d71d-4dee-9f5b-8b29c8eae40c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:38.965374 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103c9d7-d71d-4dee-9f5b-8b29c8eae40c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:38.966124 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103c9d7-d71d-4dee-9f5b-8b29c8eae40c None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=f0dc2bb27ad84e4a9637fab34310feab, user.id=78e3165c6b584be2865c777a0e373b0f) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:38.966429 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103c9d7-d71d-4dee-9f5b-8b29c8eae40c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:38.967912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103c9d7-d71d-4dee-9f5b-8b29c8eae40c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:38.973516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 570/1146] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:38 2022] GET /identity/v3/role_assignments?user.id=78e3165c6b584be2865c777a0e373b0f&scope.project.id=f0dc2bb27ad84e4a9637fab34310feab&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:40.834808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b6024-6b42-4ffa-8e73-58c81b1868ba None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:40.835665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b6024-6b42-4ffa-8e73-58c81b1868ba None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:40.835665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b6024-6b42-4ffa-8e73-58c81b1868ba None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:40.837863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 577/1147] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:40.846603 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbcd52-3a6a-462e-b228-1a3b422a0c25 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:40.847369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbcd52-3a6a-462e-b228-1a3b422a0c25 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:40.847528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbcd52-3a6a-462e-b228-1a3b422a0c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:40.867945 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7afbcd52-3a6a-462e-b228-1a3b422a0c25 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:40.869129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7afbcd52-3a6a-462e-b228-1a3b422a0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:40.871107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:40.943593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 571/1148] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:09:41.220690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b6024-6b42-4ffa-8e73-58c81b1868ba None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:41.347258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b6024-6b42-4ffa-8e73-58c81b1868ba None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:41.382686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae957567-d488-488d-b608-49439bcdeefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:41.383302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae957567-d488-488d-b608-49439bcdeefe None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:41.383577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae957567-d488-488d-b608-49439bcdeefe None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:41.383911 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae957567-d488-488d-b608-49439bcdeefe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:41.394573 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae957567-d488-488d-b608-49439bcdeefe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-ae957567-d488-488d-b608-49439bcdeefe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:41.399307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:41.400481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:41.401691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:41.401691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:41.401691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:41.401691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:41.401691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:41.401691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:41.401691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:41.401691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:41.401691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:41.401691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:41.401691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:41.401691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:41.401691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 578/1149] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:09:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:41.407326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbcd52-3a6a-462e-b228-1a3b422a0c25 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:41.515123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbcd52-3a6a-462e-b228-1a3b422a0c25 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:41.550786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f16c63-09a7-45f2-a1af-7d95704935ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:41.551379 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16c63-09a7-45f2-a1af-7d95704935ee None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:41.551657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16c63-09a7-45f2-a1af-7d95704935ee None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:41.551960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16c63-09a7-45f2-a1af-7d95704935ee None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:41.552621 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f16c63-09a7-45f2-a1af-7d95704935ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:41.552925 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f16c63-09a7-45f2-a1af-7d95704935ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:41.554301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f16c63-09a7-45f2-a1af-7d95704935ee None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:41.559490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:41.565140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 572/1150] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:09:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:41.573729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae957567-d488-488d-b608-49439bcdeefe None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:41.618325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:41.675848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae957567-d488-488d-b608-49439bcdeefe None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:41.711170 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7b1f8-4b68-4c45-9dea-8d461769ae00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:41.711856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7b1f8-4b68-4c45-9dea-8d461769ae00 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:41.712139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7b1f8-4b68-4c45-9dea-8d461769ae00 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:41.712396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7b1f8-4b68-4c45-9dea-8d461769ae00 None admin] PATH_INFO: `/v3/users/78e3165c6b584be2865c777a0e373b0f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:41.713560 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7b1f8-4b68-4c45-9dea-8d461769ae00 None admin] RBAC: Authorizing `identity:get_user(user_id=78e3165c6b584be2865c777a0e373b0f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:41.714997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7b1f8-4b68-4c45-9dea-8d461769ae00 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:41.716640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 579/1151] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:41 2022] GET /identity/v3/users/78e3165c6b584be2865c777a0e373b0f => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:41.725063 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f16c63-09a7-45f2-a1af-7d95704935ee None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:41.826916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f16c63-09a7-45f2-a1af-7d95704935ee None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:41.861182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bce727-5c37-452c-9a68-246a74718eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:41.861762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce727-5c37-452c-9a68-246a74718eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:41.862061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce727-5c37-452c-9a68-246a74718eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:41.862330 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce727-5c37-452c-9a68-246a74718eb2 None admin] PATH_INFO: `/v3/projects/f0dc2bb27ad84e4a9637fab34310feab` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:41.863498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bce727-5c37-452c-9a68-246a74718eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=f0dc2bb27ad84e4a9637fab34310feab)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:41.864973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bce727-5c37-452c-9a68-246a74718eb2 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:41.866588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 573/1152] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:09:41 2022] GET /identity/v3/projects/f0dc2bb27ad84e4a9637fab34310feab => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:41.873269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7b1f8-4b68-4c45-9dea-8d461769ae00 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:41.979291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7b1f8-4b68-4c45-9dea-8d461769ae00 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:41.990046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:42.017775 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c3cdc-6379-4775-8782-1db41c93fd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:42.018933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c3cdc-6379-4775-8782-1db41c93fd99 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:42.019220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c3cdc-6379-4775-8782-1db41c93fd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:42.019498 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c3cdc-6379-4775-8782-1db41c93fd99 None admin] PATH_INFO: `/v3/projects/f0dc2bb27ad84e4a9637fab34310feab/users/78e3165c6b584be2865c777a0e373b0f/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:42.021710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c3cdc-6379-4775-8782-1db41c93fd99 None admin] RBAC: Authorizing `identity:create_grant(project_id=f0dc2bb27ad84e4a9637fab34310feab, user_id=78e3165c6b584be2865c777a0e373b0f, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:42.023154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c3cdc-6379-4775-8782-1db41c93fd99 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:42.042719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 580/1153] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:09:41 2022] PUT /identity/v3/projects/f0dc2bb27ad84e4a9637fab34310feab/users/78e3165c6b584be2865c777a0e373b0f/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:09:43.911491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f382b-bddc-4137-bbf0-c7d970c25dba None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:43.912412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f382b-bddc-4137-bbf0-c7d970c25dba None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:43.912412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f382b-bddc-4137-bbf0-c7d970c25dba None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:43.914556 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 574/1154] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:43.923363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26abea0-f571-4325-94bd-b9f154af5f6c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:43.923799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26abea0-f571-4325-94bd-b9f154af5f6c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:43.924013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26abea0-f571-4325-94bd-b9f154af5f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:43.952588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d26abea0-f571-4325-94bd-b9f154af5f6c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:43.953812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d26abea0-f571-4325-94bd-b9f154af5f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:44.024128 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 581/1155] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:44.286794 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f382b-bddc-4137-bbf0-c7d970c25dba None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:44.373502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:44.408978 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f382b-bddc-4137-bbf0-c7d970c25dba None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:44.451578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e8dce-5643-4da1-b14f-f54acb67baf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:44.452190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e8dce-5643-4da1-b14f-f54acb67baf3 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:44.452467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e8dce-5643-4da1-b14f-f54acb67baf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:44.452739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e8dce-5643-4da1-b14f-f54acb67baf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:44.463111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e8dce-5643-4da1-b14f-f54acb67baf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-5a4e8dce-5643-4da1-b14f-f54acb67baf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:44.467973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:44.469065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:44.470080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:44.470080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:44.470080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:44.470080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:44.470080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:44.470080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:44.470080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:44.470080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:44.470080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:44.470080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:44.470080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:44.470080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:44.470080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 575/1156] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:09:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:44.475864 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26abea0-f571-4325-94bd-b9f154af5f6c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:44.575018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:44.578810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26abea0-f571-4325-94bd-b9f154af5f6c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:44.613589 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dd842-a1b7-4d5a-9991-51d6b8f1396e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:44.614193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dd842-a1b7-4d5a-9991-51d6b8f1396e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:44.614476 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dd842-a1b7-4d5a-9991-51d6b8f1396e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:44.614758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dd842-a1b7-4d5a-9991-51d6b8f1396e None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:44.615456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dd842-a1b7-4d5a-9991-51d6b8f1396e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:44.615786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dd842-a1b7-4d5a-9991-51d6b8f1396e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:44.617175 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dd842-a1b7-4d5a-9991-51d6b8f1396e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:44.625346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 582/1157] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:09:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:44.631681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e8dce-5643-4da1-b14f-f54acb67baf3 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:44.739117 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e8dce-5643-4da1-b14f-f54acb67baf3 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:44.767291 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:44.776746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f43cce-ad16-4060-a43c-b5a9db21988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:44.777374 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f43cce-ad16-4060-a43c-b5a9db21988e None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:44.777651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f43cce-ad16-4060-a43c-b5a9db21988e None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:44.777931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f43cce-ad16-4060-a43c-b5a9db21988e None admin] PATH_INFO: `/v3/users/78e3165c6b584be2865c777a0e373b0f` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:44.779098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f43cce-ad16-4060-a43c-b5a9db21988e None admin] RBAC: Authorizing `identity:get_user(user_id=78e3165c6b584be2865c777a0e373b0f)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:44.780600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f43cce-ad16-4060-a43c-b5a9db21988e None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:44.782206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 576/1158] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:44 2022] GET /identity/v3/users/78e3165c6b584be2865c777a0e373b0f => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:44.788714 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dd842-a1b7-4d5a-9991-51d6b8f1396e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:44.892437 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dd842-a1b7-4d5a-9991-51d6b8f1396e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:44.938924 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4113567-f284-4938-b01b-5fc955fc4d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:44.939507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4113567-f284-4938-b01b-5fc955fc4d46 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:44.939833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4113567-f284-4938-b01b-5fc955fc4d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:44.940108 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4113567-f284-4938-b01b-5fc955fc4d46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:44.970890 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:45.022402 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4113567-f284-4938-b01b-5fc955fc4d46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:45.023812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4113567-f284-4938-b01b-5fc955fc4d46 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:45.128311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 583/1159] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:45.138812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f43cce-ad16-4060-a43c-b5a9db21988e None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:45.253991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f43cce-ad16-4060-a43c-b5a9db21988e None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:45.288464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f3238-d4b2-4c3b-8aad-18bad87785ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:45.289012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3238-d4b2-4c3b-8aad-18bad87785ba None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:45.289285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3238-d4b2-4c3b-8aad-18bad87785ba None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:45.289554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3238-d4b2-4c3b-8aad-18bad87785ba None admin] PATH_INFO: `/v3/projects/f0dc2bb27ad84e4a9637fab34310feab` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:45.290918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f3238-d4b2-4c3b-8aad-18bad87785ba None admin] RBAC: Authorizing `identity:get_project(project_id=f0dc2bb27ad84e4a9637fab34310feab)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:45.292399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f3238-d4b2-4c3b-8aad-18bad87785ba None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:45.294037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 577/1160] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:09:45 2022] GET /identity/v3/projects/f0dc2bb27ad84e4a9637fab34310feab => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:45.301114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4113567-f284-4938-b01b-5fc955fc4d46 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:45.383654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:45.427466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4113567-f284-4938-b01b-5fc955fc4d46 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:45.462923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ad588-6cc7-4530-83cf-e5cf479951ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:45.463521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ad588-6cc7-4530-83cf-e5cf479951ad None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:45.463820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ad588-6cc7-4530-83cf-e5cf479951ad None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:45.464107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ad588-6cc7-4530-83cf-e5cf479951ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:45.464824 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ad588-6cc7-4530-83cf-e5cf479951ad None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=f0dc2bb27ad84e4a9637fab34310feab, user.id=78e3165c6b584be2865c777a0e373b0f) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:45.465133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ad588-6cc7-4530-83cf-e5cf479951ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:45.466559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ad588-6cc7-4530-83cf-e5cf479951ad None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:45.476094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 584/1161] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:45 2022] GET /identity/v3/role_assignments?user.id=78e3165c6b584be2865c777a0e373b0f&scope.project.id=f0dc2bb27ad84e4a9637fab34310feab&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:47.414141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d281e-f278-45f1-bc99-075a22e10668 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:47.415047 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d281e-f278-45f1-bc99-075a22e10668 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:47.415047 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d281e-f278-45f1-bc99-075a22e10668 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:47.417240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 578/1162] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:47.425671 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db092f-3b4b-40fa-978f-3dfebaee9b31 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:47.426088 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db092f-3b4b-40fa-978f-3dfebaee9b31 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:47.426247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db092f-3b4b-40fa-978f-3dfebaee9b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:47.453820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b0db092f-3b4b-40fa-978f-3dfebaee9b31 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:47.455111 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b0db092f-3b4b-40fa-978f-3dfebaee9b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:47.525998 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 585/1163] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:47.791173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d281e-f278-45f1-bc99-075a22e10668 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:47.860254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:47.903670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d281e-f278-45f1-bc99-075a22e10668 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:47.939303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d23014-ad2e-4eb7-933a-545b8c09834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:47.939932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d23014-ad2e-4eb7-933a-545b8c09834c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:47.940206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d23014-ad2e-4eb7-933a-545b8c09834c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:47.940474 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d23014-ad2e-4eb7-933a-545b8c09834c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:48.008881 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d23014-ad2e-4eb7-933a-545b8c09834c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:48.010367 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d23014-ad2e-4eb7-933a-545b8c09834c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:48.071182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:48.110056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 579/1164] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:48.116352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db092f-3b4b-40fa-978f-3dfebaee9b31 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:48.174656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:48.225227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db092f-3b4b-40fa-978f-3dfebaee9b31 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:48.260695 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e60b6-1479-404b-a9f7-4b16119e1699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:48.261312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e60b6-1479-404b-a9f7-4b16119e1699 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:48.261590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e60b6-1479-404b-a9f7-4b16119e1699 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:48.261869 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e60b6-1479-404b-a9f7-4b16119e1699 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:48.268816 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e60b6-1479-404b-a9f7-4b16119e1699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:48.270273 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e60b6-1479-404b-a9f7-4b16119e1699 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-466e60b6-1479-404b-a9f7-4b16119e1699 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:48.281764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:48.284356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:09:48.285440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 586/1165] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 31 00:09:48 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:48.289518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d23014-ad2e-4eb7-933a-545b8c09834c None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:48.393403 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d23014-ad2e-4eb7-933a-545b8c09834c None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:48.428062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a46e7-03ca-431e-a010-2696b68c7075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:48.428743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a46e7-03ca-431e-a010-2696b68c7075 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:48.428924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a46e7-03ca-431e-a010-2696b68c7075 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:48.429189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a46e7-03ca-431e-a010-2696b68c7075 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:48.429826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a46e7-03ca-431e-a010-2696b68c7075 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:48.430126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a46e7-03ca-431e-a010-2696b68c7075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:48.431523 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a46e7-03ca-431e-a010-2696b68c7075 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:48.438664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 580/1166] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Aug 31 00:09:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:50.299922 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe4cf6-036c-431c-9764-298b5e88fe7b None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:50.300741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe4cf6-036c-431c-9764-298b5e88fe7b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:50.300741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe4cf6-036c-431c-9764-298b5e88fe7b None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:50.302905 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 587/1167] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:50.309160 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aeec3-c47b-4621-81f1-9dbdaf79723c None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:50.309588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aeec3-c47b-4621-81f1-9dbdaf79723c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:50.309728 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aeec3-c47b-4621-81f1-9dbdaf79723c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:50.339622 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-249aeec3-c47b-4621-81f1-9dbdaf79723c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:50.340843 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-249aeec3-c47b-4621-81f1-9dbdaf79723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:50.373095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:50.421151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 581/1168] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:50.682588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe4cf6-036c-431c-9764-298b5e88fe7b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:50.795338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe4cf6-036c-431c-9764-298b5e88fe7b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:50.816750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:50.837467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc880d5b-ab81-4531-820d-562e38b78bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:50.838146 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc880d5b-ab81-4531-820d-562e38b78bc6 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:50.838418 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc880d5b-ab81-4531-820d-562e38b78bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:50.838691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc880d5b-ab81-4531-820d-562e38b78bc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:50.839362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc880d5b-ab81-4531-820d-562e38b78bc6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:50.840756 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc880d5b-ab81-4531-820d-562e38b78bc6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:50.864689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 588/1169] 10.222.0.50 () {60 vars in 1138 bytes} [Wed Aug 31 00:09:50 2022] POST /identity/v3/domains => generated 267 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:52.796202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be5d3a-0d28-4d29-b951-fc3588babcff None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:52.797101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be5d3a-0d28-4d29-b951-fc3588babcff None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:52.797101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be5d3a-0d28-4d29-b951-fc3588babcff None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:52.799251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 582/1170] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:52.804767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2d3b9-8b68-4ac0-a9c5-cf4f99b00243 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:52.805180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2d3b9-8b68-4ac0-a9c5-cf4f99b00243 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:52.805291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2d3b9-8b68-4ac0-a9c5-cf4f99b00243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:52.825601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-fbd2d3b9-8b68-4ac0-a9c5-cf4f99b00243 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:52.826786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fbd2d3b9-8b68-4ac0-a9c5-cf4f99b00243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:52.907063 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 589/1171] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:53.171887 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be5d3a-0d28-4d29-b951-fc3588babcff None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:53.292337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be5d3a-0d28-4d29-b951-fc3588babcff None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:53.332178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d33ca-fe14-4930-8b24-2c74c34f60d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:53.332799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d33ca-fe14-4930-8b24-2c74c34f60d8 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:53.333080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d33ca-fe14-4930-8b24-2c74c34f60d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:53.333350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d33ca-fe14-4930-8b24-2c74c34f60d8 None admin] PATH_INFO: `/v3/domains/575d2c0960c644d3aeebf26413620e5c` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:53.344432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d33ca-fe14-4930-8b24-2c74c34f60d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=575d2c0960c644d3aeebf26413620e5c)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:53.345898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d33ca-fe14-4930-8b24-2c74c34f60d8 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:53.347495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 583/1172] 10.222.0.50 () {56 vars in 1183 bytes} [Wed Aug 31 00:09:53 2022] GET /identity/v3/domains/575d2c0960c644d3aeebf26413620e5c => generated 267 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:53.353763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2d3b9-8b68-4ac0-a9c5-cf4f99b00243 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:53.455145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2d3b9-8b68-4ac0-a9c5-cf4f99b00243 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:53.462650 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:53.492644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bc204-b4af-46ac-b032-df2847ddf517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:53.493239 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bc204-b4af-46ac-b032-df2847ddf517 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:53.493515 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bc204-b4af-46ac-b032-df2847ddf517 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:53.493808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bc204-b4af-46ac-b032-df2847ddf517 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:53.494440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bc204-b4af-46ac-b032-df2847ddf517 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:53.495888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bc204-b4af-46ac-b032-df2847ddf517 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:53.530094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 590/1173] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 31 00:09:53 2022] POST /identity/v3/projects => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:55.438155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c077ac5-68ab-4012-a518-720c1f1d6744 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:55.438693 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c077ac5-68ab-4012-a518-720c1f1d6744 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:55.438693 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c077ac5-68ab-4012-a518-720c1f1d6744 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:55.440024 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 584/1174] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:55.446369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bca19-b47c-4a10-b122-595528287b7a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:55.447072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bca19-b47c-4a10-b122-595528287b7a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:55.447368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bca19-b47c-4a10-b122-595528287b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:55.472116 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e62bca19-b47c-4a10-b122-595528287b7a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:55.473341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e62bca19-b47c-4a10-b122-595528287b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:55.544420 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 591/1175] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:55.805242 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c077ac5-68ab-4012-a518-720c1f1d6744 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:55.828227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:55.915757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c077ac5-68ab-4012-a518-720c1f1d6744 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:55.951039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ffc90-68d6-4c96-a91f-6ce0a031c21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:55.951648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ffc90-68d6-4c96-a91f-6ce0a031c21b None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:55.951927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ffc90-68d6-4c96-a91f-6ce0a031c21b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:55.952226 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ffc90-68d6-4c96-a91f-6ce0a031c21b None admin] PATH_INFO: `/v3/domains/575d2c0960c644d3aeebf26413620e5c` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:55.953447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ffc90-68d6-4c96-a91f-6ce0a031c21b None admin] RBAC: Authorizing `identity:get_domain(domain_id=575d2c0960c644d3aeebf26413620e5c)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:55.954887 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ffc90-68d6-4c96-a91f-6ce0a031c21b None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:55.956467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 585/1176] 10.222.0.50 () {56 vars in 1183 bytes} [Wed Aug 31 00:09:55 2022] GET /identity/v3/domains/575d2c0960c644d3aeebf26413620e5c => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:55.963014 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bca19-b47c-4a10-b122-595528287b7a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:56.060229 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:56.074770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bca19-b47c-4a10-b122-595528287b7a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:56.110915 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889b722-31cc-4808-ac1c-59aca58a7926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:56.111504 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889b722-31cc-4808-ac1c-59aca58a7926 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:56.111801 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889b722-31cc-4808-ac1c-59aca58a7926 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:56.112070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889b722-31cc-4808-ac1c-59aca58a7926 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:56.112705 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889b722-31cc-4808-ac1c-59aca58a7926 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:56.114117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889b722-31cc-4808-ac1c-59aca58a7926 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:56.138407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 592/1177] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:09:55 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:58.074884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a513e1-1905-49af-b8d5-4d3edbd01748 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:58.075487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a513e1-1905-49af-b8d5-4d3edbd01748 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:58.075487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a513e1-1905-49af-b8d5-4d3edbd01748 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:58.076843 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 586/1178] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:58.083089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91158c-ec30-4fb2-b48c-40b84185a3ad None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:58.083534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91158c-ec30-4fb2-b48c-40b84185a3ad None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:58.083634 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91158c-ec30-4fb2-b48c-40b84185a3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:58.108851 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-cb91158c-ec30-4fb2-b48c-40b84185a3ad None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:58.110132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cb91158c-ec30-4fb2-b48c-40b84185a3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:58.180612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 593/1179] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:58.447931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a513e1-1905-49af-b8d5-4d3edbd01748 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:58.545628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:58.561884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a513e1-1905-49af-b8d5-4d3edbd01748 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:58.597456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0eb459-372d-490d-bbe2-5373a408dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:58.598090 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eb459-372d-490d-bbe2-5373a408dffd None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:58.598364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eb459-372d-490d-bbe2-5373a408dffd None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:58.598632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eb459-372d-490d-bbe2-5373a408dffd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:58.609725 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0eb459-372d-490d-bbe2-5373a408dffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-fa0eb459-372d-490d-bbe2-5373a408dffd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:58.614486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:58.615627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:58.616629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:58.616629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:58.616629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:58.616629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:58.616629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:58.616629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:58.616629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:58.616629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:58.616629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:58.616629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:58.616629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:58.616629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:09:58.616629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 587/1180] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:09:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:58.621959 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91158c-ec30-4fb2-b48c-40b84185a3ad None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:58.703344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:58.731021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91158c-ec30-4fb2-b48c-40b84185a3ad None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:58.766133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a7b4e-9886-40a6-b270-0b783fe5e6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:58.766733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a7b4e-9886-40a6-b270-0b783fe5e6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:58.767004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a7b4e-9886-40a6-b270-0b783fe5e6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:58.767270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a7b4e-9886-40a6-b270-0b783fe5e6b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:58.767959 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a7b4e-9886-40a6-b270-0b783fe5e6b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:58.768257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a7b4e-9886-40a6-b270-0b783fe5e6b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:58.769621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a7b4e-9886-40a6-b270-0b783fe5e6b9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:58.777885 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 594/1181] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:09:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:58.784870 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0eb459-372d-490d-bbe2-5373a408dffd None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:58.896462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0eb459-372d-490d-bbe2-5373a408dffd None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:58.932266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3ec2b-0290-4096-9c8e-d1910c403737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:58.932886 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ec2b-0290-4096-9c8e-d1910c403737 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:58.933158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ec2b-0290-4096-9c8e-d1910c403737 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:58.933430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ec2b-0290-4096-9c8e-d1910c403737 None admin] PATH_INFO: `/v3/users/1a2483ff829841d3abffbdc5159e70ac` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:58.947058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3ec2b-0290-4096-9c8e-d1910c403737 None admin] RBAC: Authorizing `identity:get_user(user_id=1a2483ff829841d3abffbdc5159e70ac)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:58.948937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3ec2b-0290-4096-9c8e-d1910c403737 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:58.950617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 588/1182] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:58 2022] GET /identity/v3/users/1a2483ff829841d3abffbdc5159e70ac => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:58.957361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a7b4e-9886-40a6-b270-0b783fe5e6b9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:59.072520 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a7b4e-9886-40a6-b270-0b783fe5e6b9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:59.106936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45f0df-d969-4ed5-8986-153de43f970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:59.107561 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45f0df-d969-4ed5-8986-153de43f970d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:59.107845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45f0df-d969-4ed5-8986-153de43f970d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:59.108115 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45f0df-d969-4ed5-8986-153de43f970d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:59.111681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:59.178854 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45f0df-d969-4ed5-8986-153de43f970d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:59.180417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45f0df-d969-4ed5-8986-153de43f970d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:59.304925 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 595/1183] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:59.311825 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3ec2b-0290-4096-9c8e-d1910c403737 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:59.315982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:59.422296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3ec2b-0290-4096-9c8e-d1910c403737 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:59.457569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52171069-85e5-43d3-ab2d-5e1999903376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:59.458187 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52171069-85e5-43d3-ab2d-5e1999903376 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:59.458461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52171069-85e5-43d3-ab2d-5e1999903376 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:59.458725 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52171069-85e5-43d3-ab2d-5e1999903376 None admin] PATH_INFO: `/v3/projects/a71c1ab446d94b2e81817a06704d8cf6` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:59.459973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52171069-85e5-43d3-ab2d-5e1999903376 None admin] RBAC: Authorizing `identity:get_project(project_id=a71c1ab446d94b2e81817a06704d8cf6)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:59.461456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52171069-85e5-43d3-ab2d-5e1999903376 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:59.463126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 589/1184] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:09:59 2022] GET /identity/v3/projects/a71c1ab446d94b2e81817a06704d8cf6 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:59.469888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45f0df-d969-4ed5-8986-153de43f970d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:59.504222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:59.574834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45f0df-d969-4ed5-8986-153de43f970d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:59.609564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82567e42-f9ad-451f-b41c-2706b8df6cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:59.610168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82567e42-f9ad-451f-b41c-2706b8df6cce None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:59.610443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82567e42-f9ad-451f-b41c-2706b8df6cce None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:59.610696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82567e42-f9ad-451f-b41c-2706b8df6cce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:59.611432 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82567e42-f9ad-451f-b41c-2706b8df6cce None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=a71c1ab446d94b2e81817a06704d8cf6, user.id=1a2483ff829841d3abffbdc5159e70ac) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:59.611741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82567e42-f9ad-451f-b41c-2706b8df6cce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:59.613188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82567e42-f9ad-451f-b41c-2706b8df6cce None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:59.618627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 596/1185] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:59 2022] GET /identity/v3/role_assignments?user.id=1a2483ff829841d3abffbdc5159e70ac&scope.project.id=a71c1ab446d94b2e81817a06704d8cf6&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:01.493085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c5658-9f07-4eac-9ec1-bdd2b6262eff None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:01.493915 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c5658-9f07-4eac-9ec1-bdd2b6262eff None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:01.493915 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c5658-9f07-4eac-9ec1-bdd2b6262eff None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:01.496060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 590/1186] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:10:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:01.505409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a567e-fce1-4a09-b3e1-166883304433 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:01.505839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a567e-fce1-4a09-b3e1-166883304433 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:01.505976 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a567e-fce1-4a09-b3e1-166883304433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:01.531665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-580a567e-fce1-4a09-b3e1-166883304433 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:01.532914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-580a567e-fce1-4a09-b3e1-166883304433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:01.608919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 597/1187] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:10:01.871918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c5658-9f07-4eac-9ec1-bdd2b6262eff None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:01.950235 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:01.993906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c5658-9f07-4eac-9ec1-bdd2b6262eff None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:02.029716 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566f4bb-265d-4447-a08e-94c4f664d661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:02.030351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566f4bb-265d-4447-a08e-94c4f664d661 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:02.030630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566f4bb-265d-4447-a08e-94c4f664d661 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:02.030901 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566f4bb-265d-4447-a08e-94c4f664d661 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:02.042765 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566f4bb-265d-4447-a08e-94c4f664d661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-9566f4bb-265d-4447-a08e-94c4f664d661 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:10:02.047648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:02.048774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:02.049832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:02.049832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:02.049832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:02.049832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:02.049832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:10:02.049832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:10:02.049832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:10:02.049832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:10:02.049832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:10:02.049832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:10:02.049832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:10:02.049832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:10:02.049832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 591/1188] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:10:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:02.055990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a567e-fce1-4a09-b3e1-166883304433 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:02.087727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:02.163780 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a567e-fce1-4a09-b3e1-166883304433 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:02.198775 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b3c6e-18b2-4122-bc6a-fb758412506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:02.199388 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b3c6e-18b2-4122-bc6a-fb758412506f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:02.199664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b3c6e-18b2-4122-bc6a-fb758412506f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:02.199966 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b3c6e-18b2-4122-bc6a-fb758412506f None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:02.200633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b3c6e-18b2-4122-bc6a-fb758412506f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:02.200934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b3c6e-18b2-4122-bc6a-fb758412506f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:02.202343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b3c6e-18b2-4122-bc6a-fb758412506f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:02.210266 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 598/1189] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:10:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:02.217300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566f4bb-265d-4447-a08e-94c4f664d661 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:02.331823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566f4bb-265d-4447-a08e-94c4f664d661 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:02.361730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:02.367640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a600f49-948c-4d31-9ad5-25fd28f26451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:02.368387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a600f49-948c-4d31-9ad5-25fd28f26451 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:02.368663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a600f49-948c-4d31-9ad5-25fd28f26451 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:02.368934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a600f49-948c-4d31-9ad5-25fd28f26451 None admin] PATH_INFO: `/v3/users/1a2483ff829841d3abffbdc5159e70ac` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:02.370172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a600f49-948c-4d31-9ad5-25fd28f26451 None admin] RBAC: Authorizing `identity:get_user(user_id=1a2483ff829841d3abffbdc5159e70ac)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:02.371663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a600f49-948c-4d31-9ad5-25fd28f26451 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:02.373302 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 592/1190] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:10:02 2022] GET /identity/v3/users/1a2483ff829841d3abffbdc5159e70ac => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:02.379406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b3c6e-18b2-4122-bc6a-fb758412506f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:02.488883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:02.499175 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b3c6e-18b2-4122-bc6a-fb758412506f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:02.536717 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90444542-87ff-4b4a-b93b-832c6ddabb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:02.537336 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90444542-87ff-4b4a-b93b-832c6ddabb6d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:02.537610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90444542-87ff-4b4a-b93b-832c6ddabb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:02.537884 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90444542-87ff-4b4a-b93b-832c6ddabb6d None admin] PATH_INFO: `/v3/projects/a71c1ab446d94b2e81817a06704d8cf6` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:02.539132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90444542-87ff-4b4a-b93b-832c6ddabb6d None admin] RBAC: Authorizing `identity:get_project(project_id=a71c1ab446d94b2e81817a06704d8cf6)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:02.540661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90444542-87ff-4b4a-b93b-832c6ddabb6d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:02.542304 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 599/1191] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:10:02 2022] GET /identity/v3/projects/a71c1ab446d94b2e81817a06704d8cf6 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:02.548661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a600f49-948c-4d31-9ad5-25fd28f26451 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:02.656668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a600f49-948c-4d31-9ad5-25fd28f26451 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:02.692334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a4368-5453-41be-be5d-4e7a6acc1897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:02.693003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a4368-5453-41be-be5d-4e7a6acc1897 None admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:02.693281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a4368-5453-41be-be5d-4e7a6acc1897 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:02.693550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a4368-5453-41be-be5d-4e7a6acc1897 None admin] PATH_INFO: `/v3/projects/a71c1ab446d94b2e81817a06704d8cf6/users/1a2483ff829841d3abffbdc5159e70ac/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:02.696733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a4368-5453-41be-be5d-4e7a6acc1897 None admin] RBAC: Authorizing `identity:create_grant(project_id=a71c1ab446d94b2e81817a06704d8cf6, user_id=1a2483ff829841d3abffbdc5159e70ac, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:02.698226 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a4368-5453-41be-be5d-4e7a6acc1897 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:02.719848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 593/1192] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:10:02 2022] PUT /identity/v3/projects/a71c1ab446d94b2e81817a06704d8cf6/users/1a2483ff829841d3abffbdc5159e70ac/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:10:04.615711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771db7f8-9d72-46a3-aa18-ba486725c315 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:04.616280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771db7f8-9d72-46a3-aa18-ba486725c315 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:04.616280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771db7f8-9d72-46a3-aa18-ba486725c315 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:04.617727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 600/1193] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:04.624195 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0473cf-4304-4ea4-b97b-de5119e0fbdb None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:04.624667 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0473cf-4304-4ea4-b97b-de5119e0fbdb None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:04.624776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0473cf-4304-4ea4-b97b-de5119e0fbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:04.646814 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-3d0473cf-4304-4ea4-b97b-de5119e0fbdb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:04.648031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3d0473cf-4304-4ea4-b97b-de5119e0fbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:04.708723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:04.722157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 594/1194] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:10:04.986341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771db7f8-9d72-46a3-aa18-ba486725c315 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:05.095290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771db7f8-9d72-46a3-aa18-ba486725c315 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:05.130359 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654ec00-23d7-4b4c-99a5-869ea901398d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:05.130978 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654ec00-23d7-4b4c-99a5-869ea901398d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:05.131255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654ec00-23d7-4b4c-99a5-869ea901398d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:05.131522 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654ec00-23d7-4b4c-99a5-869ea901398d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:05.142468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654ec00-23d7-4b4c-99a5-869ea901398d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-d654ec00-23d7-4b4c-99a5-869ea901398d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:10:05.147188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:05.148317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:05.149467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:05.149467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:05.149467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:05.149467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:05.149467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:10:05.149467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:10:05.149467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:10:05.149467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:10:05.149467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:10:05.149467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:10:05.149467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:10:05.149467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:10:05.152045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 601/1195] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:10:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:05.154343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0473cf-4304-4ea4-b97b-de5119e0fbdb None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:05.257242 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0473cf-4304-4ea4-b97b-de5119e0fbdb None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:05.294324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa171f-2bcc-4251-ba34-5f2926cdeb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:05.294932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa171f-2bcc-4251-ba34-5f2926cdeb3a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:05.295208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa171f-2bcc-4251-ba34-5f2926cdeb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:05.295487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa171f-2bcc-4251-ba34-5f2926cdeb3a None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:05.296201 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa171f-2bcc-4251-ba34-5f2926cdeb3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:05.296517 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa171f-2bcc-4251-ba34-5f2926cdeb3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:05.297899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa171f-2bcc-4251-ba34-5f2926cdeb3a None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:05.306309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 595/1196] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:10:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:05.313084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654ec00-23d7-4b4c-99a5-869ea901398d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:05.348629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:05.455106 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654ec00-23d7-4b4c-99a5-869ea901398d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:05.491887 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a318c35-327e-4152-aab5-abed86a58ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:05.492560 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a318c35-327e-4152-aab5-abed86a58ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:05.492842 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a318c35-327e-4152-aab5-abed86a58ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:05.493116 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a318c35-327e-4152-aab5-abed86a58ee2 None admin] PATH_INFO: `/v3/users/1a2483ff829841d3abffbdc5159e70ac` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:05.494333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a318c35-327e-4152-aab5-abed86a58ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=1a2483ff829841d3abffbdc5159e70ac)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:05.495805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a318c35-327e-4152-aab5-abed86a58ee2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:05.497374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 602/1197] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Aug 31 00:10:05 2022] GET /identity/v3/users/1a2483ff829841d3abffbdc5159e70ac => generated 311 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:05.507074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa171f-2bcc-4251-ba34-5f2926cdeb3a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:05.567231 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:05.620978 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa171f-2bcc-4251-ba34-5f2926cdeb3a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:05.656910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b7482-dd89-4444-8d31-042d4442191f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:05.657509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b7482-dd89-4444-8d31-042d4442191f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:05.657770 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b7482-dd89-4444-8d31-042d4442191f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:05.658040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b7482-dd89-4444-8d31-042d4442191f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:05.732003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b7482-dd89-4444-8d31-042d4442191f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:05.733454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b7482-dd89-4444-8d31-042d4442191f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:05.787285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:05.838771 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 596/1198] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:10:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:10:05.845735 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a318c35-327e-4152-aab5-abed86a58ee2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:05.936673 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:05.953182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a318c35-327e-4152-aab5-abed86a58ee2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:05.996309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abf77a-6e66-4a40-8e10-d76bcfc86a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:05.996943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abf77a-6e66-4a40-8e10-d76bcfc86a26 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:05.997222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abf77a-6e66-4a40-8e10-d76bcfc86a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:05.997497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abf77a-6e66-4a40-8e10-d76bcfc86a26 None admin] PATH_INFO: `/v3/projects/a71c1ab446d94b2e81817a06704d8cf6` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:05.998762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abf77a-6e66-4a40-8e10-d76bcfc86a26 None admin] RBAC: Authorizing `identity:get_project(project_id=a71c1ab446d94b2e81817a06704d8cf6)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:06.000315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abf77a-6e66-4a40-8e10-d76bcfc86a26 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:06.001950 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 603/1199] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Aug 31 00:10:05 2022] GET /identity/v3/projects/a71c1ab446d94b2e81817a06704d8cf6 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:06.012304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b7482-dd89-4444-8d31-042d4442191f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:06.120225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b7482-dd89-4444-8d31-042d4442191f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:06.155789 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac43a4e-1f21-4601-a5a3-6d4fcd8a50ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:06.156385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac43a4e-1f21-4601-a5a3-6d4fcd8a50ce None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:06.156661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac43a4e-1f21-4601-a5a3-6d4fcd8a50ce None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:06.156933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac43a4e-1f21-4601-a5a3-6d4fcd8a50ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:06.157656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac43a4e-1f21-4601-a5a3-6d4fcd8a50ce None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=a71c1ab446d94b2e81817a06704d8cf6, user.id=1a2483ff829841d3abffbdc5159e70ac) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:06.157961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac43a4e-1f21-4601-a5a3-6d4fcd8a50ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:06.159405 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac43a4e-1f21-4601-a5a3-6d4fcd8a50ce None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:06.165948 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 597/1200] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:10:06 2022] GET /identity/v3/role_assignments?user.id=1a2483ff829841d3abffbdc5159e70ac&scope.project.id=a71c1ab446d94b2e81817a06704d8cf6&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:15.990581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=22 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:16.163364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=92 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:02.125300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1a34f-d187-4705-bb39-0f8abb4eadfa None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:02.125894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1a34f-d187-4705-bb39-0f8abb4eadfa None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:02.125894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1a34f-d187-4705-bb39-0f8abb4eadfa None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:02.127377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 604/1201] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:02.133068 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f72003-e46c-4e12-aafb-aaa5d58f790e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:02.133668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f72003-e46c-4e12-aafb-aaa5d58f790e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:02.133668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f72003-e46c-4e12-aafb-aaa5d58f790e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:02.155726 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-92f72003-e46c-4e12-aafb-aaa5d58f790e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:02.157150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-92f72003-e46c-4e12-aafb-aaa5d58f790e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:02.246965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 598/1202] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:11:02.542562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1a34f-d187-4705-bb39-0f8abb4eadfa None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:02.676330 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1a34f-d187-4705-bb39-0f8abb4eadfa None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:02.730902 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca867438-fb74-45d1-bfec-12892081faa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:02.731804 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca867438-fb74-45d1-bfec-12892081faa7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:02.732048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca867438-fb74-45d1-bfec-12892081faa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:02.732472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca867438-fb74-45d1-bfec-12892081faa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:02.748717 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca867438-fb74-45d1-bfec-12892081faa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:02.750356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca867438-fb74-45d1-bfec-12892081faa7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-ca867438-fb74-45d1-bfec-12892081faa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:11:02.771301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:02.779202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:11:02.780326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:11:02.780326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:02.780326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:02.780326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 605/1203] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:02.782104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f72003-e46c-4e12-aafb-aaa5d58f790e None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:02.931731 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f72003-e46c-4e12-aafb-aaa5d58f790e None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:02.964961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:02.973769 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb105a42-8b3c-470a-8852-8e9074446925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:02.974644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb105a42-8b3c-470a-8852-8e9074446925 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:02.975080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb105a42-8b3c-470a-8852-8e9074446925 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:02.975512 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb105a42-8b3c-470a-8852-8e9074446925 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:02.976365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb105a42-8b3c-470a-8852-8e9074446925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:02.976834 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb105a42-8b3c-470a-8852-8e9074446925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:02.978389 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb105a42-8b3c-470a-8852-8e9074446925 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:02.998645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 599/1204] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:02.999628 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca867438-fb74-45d1-bfec-12892081faa7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:03.074034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:03.138677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca867438-fb74-45d1-bfec-12892081faa7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:03.175380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965ebb2-7285-4902-b909-36f340968f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:03.176031 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965ebb2-7285-4902-b909-36f340968f9c None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:03.176307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965ebb2-7285-4902-b909-36f340968f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:03.176562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965ebb2-7285-4902-b909-36f340968f9c None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:03.177243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965ebb2-7285-4902-b909-36f340968f9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:03.178669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965ebb2-7285-4902-b909-36f340968f9c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:03.212259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 606/1205] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Aug 31 00:11:02 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:11:05.449741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2bf42-42d0-48bd-adff-7d4af79dc609 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:05.450266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2bf42-42d0-48bd-adff-7d4af79dc609 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:05.450266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2bf42-42d0-48bd-adff-7d4af79dc609 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:05.451610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 600/1206] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:05.460484 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a2f9c-9ff8-44dc-b254-39fe8bc685e5 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:05.460484 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a2f9c-9ff8-44dc-b254-39fe8bc685e5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:05.460484 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a2f9c-9ff8-44dc-b254-39fe8bc685e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:05.477823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9a9a2f9c-9ff8-44dc-b254-39fe8bc685e5 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:05.479130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9a9a2f9c-9ff8-44dc-b254-39fe8bc685e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:05.557286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 607/1207] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:11:05.844126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2bf42-42d0-48bd-adff-7d4af79dc609 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:05.968690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2bf42-42d0-48bd-adff-7d4af79dc609 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:06.006514 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b8ef0-9d55-432e-941f-4214451af76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:06.007209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b8ef0-9d55-432e-941f-4214451af76a None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:06.007507 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b8ef0-9d55-432e-941f-4214451af76a None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:06.007795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b8ef0-9d55-432e-941f-4214451af76a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:06.022339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b8ef0-9d55-432e-941f-4214451af76a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-138b8ef0-9d55-432e-941f-4214451af76a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:11:06.028186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:06.029369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:06.030275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:06.030275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:06.030275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:06.030275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:06.030275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:11:06.030275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:11:06.030275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:11:06.030275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:11:06.030275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:11:06.030275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:11:06.030275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:11:06.030275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:06.030275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 601/1208] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:11:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:06.036168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a2f9c-9ff8-44dc-b254-39fe8bc685e5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:06.086204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:06.162473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a2f9c-9ff8-44dc-b254-39fe8bc685e5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:06.207457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a64d0-c378-4359-98d2-2087dbffe39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:06.208356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a64d0-c378-4359-98d2-2087dbffe39c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:06.208662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a64d0-c378-4359-98d2-2087dbffe39c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:06.208925 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a64d0-c378-4359-98d2-2087dbffe39c None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:06.209776 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a64d0-c378-4359-98d2-2087dbffe39c None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:06.210047 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a64d0-c378-4359-98d2-2087dbffe39c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:06.211614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a64d0-c378-4359-98d2-2087dbffe39c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:06.223006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 608/1209] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:11:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:11:06.230391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b8ef0-9d55-432e-941f-4214451af76a None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:06.296890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:06.352966 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b8ef0-9d55-432e-941f-4214451af76a None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:06.390160 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f50bfe-8f79-47f3-a89c-da32da7db474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:06.390832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f50bfe-8f79-47f3-a89c-da32da7db474 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:06.391115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f50bfe-8f79-47f3-a89c-da32da7db474 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:06.391390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f50bfe-8f79-47f3-a89c-da32da7db474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:06.402505 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f50bfe-8f79-47f3-a89c-da32da7db474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:06.404029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f50bfe-8f79-47f3-a89c-da32da7db474 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-70f50bfe-8f79-47f3-a89c-da32da7db474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:11:06.421470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:06.422578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:11:06.423561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:11:06.423561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:06.423561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:06.423561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 602/1210] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:06.426984 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a64d0-c378-4359-98d2-2087dbffe39c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:06.535892 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:06.539179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a64d0-c378-4359-98d2-2087dbffe39c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:06.588801 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97758cb-3b88-4c14-bd26-36ee2c0395d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:06.589437 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97758cb-3b88-4c14-bd26-36ee2c0395d1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:06.589714 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97758cb-3b88-4c14-bd26-36ee2c0395d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:06.589965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97758cb-3b88-4c14-bd26-36ee2c0395d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:06.590639 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97758cb-3b88-4c14-bd26-36ee2c0395d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:06.590948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97758cb-3b88-4c14-bd26-36ee2c0395d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:06.592457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97758cb-3b88-4c14-bd26-36ee2c0395d1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:06.611682 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 609/1211] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:06.613131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f50bfe-8f79-47f3-a89c-da32da7db474 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:06.734046 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f50bfe-8f79-47f3-a89c-da32da7db474 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:06.735811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:06.778759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6b8ec-463f-4bdf-aced-47efa9376900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:06.779482 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6b8ec-463f-4bdf-aced-47efa9376900 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:06.779775 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6b8ec-463f-4bdf-aced-47efa9376900 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:06.780106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6b8ec-463f-4bdf-aced-47efa9376900 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:06.789233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6b8ec-463f-4bdf-aced-47efa9376900 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:06.790712 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6b8ec-463f-4bdf-aced-47efa9376900 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-64b6b8ec-463f-4bdf-aced-47efa9376900 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:11:06.803490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:06.809751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:06.811020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:06.811020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:06.811020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:11:06.811020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:11:06.811020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:11:06.811020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:11:06.811020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:11:06.811020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:11:06.811020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:11:06.811020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:06.811020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 603/1212] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:06.811824 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97758cb-3b88-4c14-bd26-36ee2c0395d1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:06.931393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97758cb-3b88-4c14-bd26-36ee2c0395d1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:06.975016 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f013981-b85a-4d12-ad76-30307f19ce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:06.975661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f013981-b85a-4d12-ad76-30307f19ce5f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:06.975978 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f013981-b85a-4d12-ad76-30307f19ce5f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:06.976254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f013981-b85a-4d12-ad76-30307f19ce5f None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:06.977010 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f013981-b85a-4d12-ad76-30307f19ce5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:06.977319 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f013981-b85a-4d12-ad76-30307f19ce5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:06.978789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f013981-b85a-4d12-ad76-30307f19ce5f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:06.999846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 610/1213] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Aug 31 00:11:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:07.005772 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6b8ec-463f-4bdf-aced-47efa9376900 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:07.128514 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6b8ec-463f-4bdf-aced-47efa9376900 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:07.172671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6efcc-ebab-4b5e-a515-c71e178a47e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:07.173305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6efcc-ebab-4b5e-a515-c71e178a47e3 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:07.173611 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6efcc-ebab-4b5e-a515-c71e178a47e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:07.173901 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6efcc-ebab-4b5e-a515-c71e178a47e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:07.207170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:07.251153 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6efcc-ebab-4b5e-a515-c71e178a47e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:07.252905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6efcc-ebab-4b5e-a515-c71e178a47e3 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:07.380837 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 604/1214] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:11:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:11:07.387459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f013981-b85a-4d12-ad76-30307f19ce5f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:07.412984 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:07.508627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f013981-b85a-4d12-ad76-30307f19ce5f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:07.550422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782b541-de99-43f5-bcea-d53aca188c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:07.551218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782b541-de99-43f5-bcea-d53aca188c31 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:07.551490 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782b541-de99-43f5-bcea-d53aca188c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:07.551783 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782b541-de99-43f5-bcea-d53aca188c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:07.563998 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782b541-de99-43f5-bcea-d53aca188c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:07.565696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782b541-de99-43f5-bcea-d53aca188c31 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-4782b541-de99-43f5-bcea-d53aca188c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:11:07.582097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:07.583488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:11:07.584630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:11:07.584630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:07.584630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:07.589029 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 611/1215] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:07.590046 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6efcc-ebab-4b5e-a515-c71e178a47e3 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:07.658992 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:07.700645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6efcc-ebab-4b5e-a515-c71e178a47e3 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:07.749268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04585d82-0dba-4a30-8259-3fdb5bc586cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:07.750507 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04585d82-0dba-4a30-8259-3fdb5bc586cb None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:07.750985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04585d82-0dba-4a30-8259-3fdb5bc586cb None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:07.751489 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04585d82-0dba-4a30-8259-3fdb5bc586cb None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:07.752617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04585d82-0dba-4a30-8259-3fdb5bc586cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:07.753116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04585d82-0dba-4a30-8259-3fdb5bc586cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:07.754773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04585d82-0dba-4a30-8259-3fdb5bc586cb None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:07.768684 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 605/1216] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:07.774477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782b541-de99-43f5-bcea-d53aca188c31 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:07.855559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:07.890481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782b541-de99-43f5-bcea-d53aca188c31 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:07.932296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96c2dc-eecc-46c3-a7bc-7a3f1adb26d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:07.933527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c2dc-eecc-46c3-a7bc-7a3f1adb26d9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:07.934045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c2dc-eecc-46c3-a7bc-7a3f1adb26d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:07.934567 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c2dc-eecc-46c3-a7bc-7a3f1adb26d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:07.944636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96c2dc-eecc-46c3-a7bc-7a3f1adb26d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:07.946112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96c2dc-eecc-46c3-a7bc-7a3f1adb26d9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-5b96c2dc-eecc-46c3-a7bc-7a3f1adb26d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:11:07.958807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:07.960182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:07.961328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:11:07.961328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:11:07.961328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:11:07.961328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:11:07.961328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:11:07.961328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:11:07.961328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:11:07.961328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:07.965301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 612/1217] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:11:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:07.966951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04585d82-0dba-4a30-8259-3fdb5bc586cb None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:08.073583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04585d82-0dba-4a30-8259-3fdb5bc586cb None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:08.104568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:08.118508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b15aa-c3c9-474d-911d-f4b11a15f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:08.119316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b15aa-c3c9-474d-911d-f4b11a15f53c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:08.119726 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b15aa-c3c9-474d-911d-f4b11a15f53c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:08.120024 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b15aa-c3c9-474d-911d-f4b11a15f53c None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:08.120735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b15aa-c3c9-474d-911d-f4b11a15f53c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:08.121047 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b15aa-c3c9-474d-911d-f4b11a15f53c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:08.122497 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b15aa-c3c9-474d-911d-f4b11a15f53c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:08.136973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 606/1218] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:11:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:08.145040 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96c2dc-eecc-46c3-a7bc-7a3f1adb26d9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:08.261440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96c2dc-eecc-46c3-a7bc-7a3f1adb26d9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:08.297936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:08.306167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63c46a-7fcf-4c9a-af7d-51b8b729a935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:08.307084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63c46a-7fcf-4c9a-af7d-51b8b729a935 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:08.307849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63c46a-7fcf-4c9a-af7d-51b8b729a935 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:08.307849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63c46a-7fcf-4c9a-af7d-51b8b729a935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:08.308543 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63c46a-7fcf-4c9a-af7d-51b8b729a935 None admin] RBAC: Adding query filter params (role.id=bf66c83a5d0f41039e44947c9fb18d3c, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=d01dd2631a81402d8a5bba7007c7fd61) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:08.308906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63c46a-7fcf-4c9a-af7d-51b8b729a935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:08.310656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63c46a-7fcf-4c9a-af7d-51b8b729a935 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:08.320198 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 613/1219] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:11:08 2022] GET /identity/v3/role_assignments?user.id=d01dd2631a81402d8a5bba7007c7fd61&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=bf66c83a5d0f41039e44947c9fb18d3c => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:10.289908 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccead87a-6061-4b0c-9f67-f6877819a58a None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:10.290475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccead87a-6061-4b0c-9f67-f6877819a58a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:10.290571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccead87a-6061-4b0c-9f67-f6877819a58a None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:10.292146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 607/1220] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:11:10.297694 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ef52c-6e19-440d-b54d-209a1d5d1676 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:10.298180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ef52c-6e19-440d-b54d-209a1d5d1676 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:10.298277 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ef52c-6e19-440d-b54d-209a1d5d1676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:10.317738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9c6ef52c-6e19-440d-b54d-209a1d5d1676 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:10.318944 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9c6ef52c-6e19-440d-b54d-209a1d5d1676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:10.398537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 614/1221] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:11:10.671778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccead87a-6061-4b0c-9f67-f6877819a58a None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:10.786873 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccead87a-6061-4b0c-9f67-f6877819a58a None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:10.826452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa1dd3-4f40-4247-b00b-c90fe33a94e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:10.827118 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa1dd3-4f40-4247-b00b-c90fe33a94e8 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:10.827394 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa1dd3-4f40-4247-b00b-c90fe33a94e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:10.827664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa1dd3-4f40-4247-b00b-c90fe33a94e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:10.837962 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa1dd3-4f40-4247-b00b-c90fe33a94e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-2dfa1dd3-4f40-4247-b00b-c90fe33a94e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:11:10.843188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:10.844399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:10.845290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:10.845290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:10.845290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:10.845290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:10.845290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:11:10.845290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:11:10.845290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:11:10.845290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:11:10.845290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:11:10.845290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:11:10.845290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:11:10.845290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:10.845290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 608/1222] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:11:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:10.851225 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ef52c-6e19-440d-b54d-209a1d5d1676 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:10.960484 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ef52c-6e19-440d-b54d-209a1d5d1676 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:10.986327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:10.999248 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c467e9-4fa7-410a-9442-a4b03fddafce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:10.999947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c467e9-4fa7-410a-9442-a4b03fddafce None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:11.000227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c467e9-4fa7-410a-9442-a4b03fddafce None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:11.000496 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c467e9-4fa7-410a-9442-a4b03fddafce None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:11.001212 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c467e9-4fa7-410a-9442-a4b03fddafce None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:11.001606 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c467e9-4fa7-410a-9442-a4b03fddafce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:11.003198 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c467e9-4fa7-410a-9442-a4b03fddafce None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:11.011239 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 615/1223] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:11:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:11.017410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa1dd3-4f40-4247-b00b-c90fe33a94e8 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:11.064378 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:11.122733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa1dd3-4f40-4247-b00b-c90fe33a94e8 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:11.161606 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465e657-442c-48a3-abc1-fb6c867674c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:11.162295 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465e657-442c-48a3-abc1-fb6c867674c0 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:11.162575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465e657-442c-48a3-abc1-fb6c867674c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:11.162842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465e657-442c-48a3-abc1-fb6c867674c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:11.174310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465e657-442c-48a3-abc1-fb6c867674c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:11.175893 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465e657-442c-48a3-abc1-fb6c867674c0 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-a465e657-442c-48a3-abc1-fb6c867674c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:11:11.192179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:11.193410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:11:11.194395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:11:11.194395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:11.194395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:11.194395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 609/1224] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:11.199601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c467e9-4fa7-410a-9442-a4b03fddafce None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:11.307607 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c467e9-4fa7-410a-9442-a4b03fddafce None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:11.346576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9a943-0079-4352-b806-bafe03ef6903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:11.347344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9a943-0079-4352-b806-bafe03ef6903 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:11.347655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9a943-0079-4352-b806-bafe03ef6903 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:11.348049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9a943-0079-4352-b806-bafe03ef6903 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:11.348744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9a943-0079-4352-b806-bafe03ef6903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:11.349171 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9a943-0079-4352-b806-bafe03ef6903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:11.350933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9a943-0079-4352-b806-bafe03ef6903 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:11.365200 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 616/1225] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:11.371995 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465e657-442c-48a3-abc1-fb6c867674c0 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:11.472625 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:11.481098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465e657-442c-48a3-abc1-fb6c867674c0 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:11.517346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6222280-ae08-4cd6-9f45-75ea7e8330d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:11.518108 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6222280-ae08-4cd6-9f45-75ea7e8330d5 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:11.518451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6222280-ae08-4cd6-9f45-75ea7e8330d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:11.518731 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6222280-ae08-4cd6-9f45-75ea7e8330d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:11.529259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6222280-ae08-4cd6-9f45-75ea7e8330d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:11.530881 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6222280-ae08-4cd6-9f45-75ea7e8330d5 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-d6222280-ae08-4cd6-9f45-75ea7e8330d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:11:11.544107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:11.545368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:11.546659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:11.546659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:11.546659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:11:11.546659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:11:11.546659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:11:11.546659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:11:11.546659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:11:11.546659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:11:11.546659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:11:11.546659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:11.546659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 610/1226] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:11.554300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9a943-0079-4352-b806-bafe03ef6903 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:11.604201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:11.664054 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9a943-0079-4352-b806-bafe03ef6903 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:11.705577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c42f8-6283-4776-b4b3-e3c237ee2e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:11.706296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c42f8-6283-4776-b4b3-e3c237ee2e09 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:11.706656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c42f8-6283-4776-b4b3-e3c237ee2e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:11.706986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c42f8-6283-4776-b4b3-e3c237ee2e09 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:11.707836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c42f8-6283-4776-b4b3-e3c237ee2e09 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:11.708321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c42f8-6283-4776-b4b3-e3c237ee2e09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:11.709733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c42f8-6283-4776-b4b3-e3c237ee2e09 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:11.735756 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 617/1227] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Aug 31 00:11:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:11.739611 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6222280-ae08-4cd6-9f45-75ea7e8330d5 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:11.849712 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6222280-ae08-4cd6-9f45-75ea7e8330d5 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:11.886499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9dcc2-2188-4812-b0e2-d4579814d357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:11.887216 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9dcc2-2188-4812-b0e2-d4579814d357 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:11.887502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9dcc2-2188-4812-b0e2-d4579814d357 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:11.887800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9dcc2-2188-4812-b0e2-d4579814d357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:11.899416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9dcc2-2188-4812-b0e2-d4579814d357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:11.900921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9dcc2-2188-4812-b0e2-d4579814d357 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-bec9dcc2-2188-4812-b0e2-d4579814d357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:11:11.916382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:11.917661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:11:11.918743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:11:11.918743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:11.918743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:11.918743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 611/1228] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:11.924296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c42f8-6283-4776-b4b3-e3c237ee2e09 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:12.042428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c42f8-6283-4776-b4b3-e3c237ee2e09 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:12.045284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:12.085598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56585e-5a5f-4872-b503-083f70e87e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:12.086311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56585e-5a5f-4872-b503-083f70e87e91 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:12.086634 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56585e-5a5f-4872-b503-083f70e87e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:12.086885 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56585e-5a5f-4872-b503-083f70e87e91 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:12.087642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56585e-5a5f-4872-b503-083f70e87e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:12.087981 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56585e-5a5f-4872-b503-083f70e87e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:12.089505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56585e-5a5f-4872-b503-083f70e87e91 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:12.105531 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 618/1229] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:12.112175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9dcc2-2188-4812-b0e2-d4579814d357 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:12.123809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:12.230255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9dcc2-2188-4812-b0e2-d4579814d357 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:12.267951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98600a-8643-417e-b941-04de146a67f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:12.268926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98600a-8643-417e-b941-04de146a67f1 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:12.269206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98600a-8643-417e-b941-04de146a67f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:12.269474 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98600a-8643-417e-b941-04de146a67f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:12.276488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98600a-8643-417e-b941-04de146a67f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:12.278069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98600a-8643-417e-b941-04de146a67f1 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-ed98600a-8643-417e-b941-04de146a67f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:11:12.289457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:12.290651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:12.291830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:11:12.291830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:11:12.291830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:11:12.291830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:11:12.291830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:11:12.291830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:11:12.291830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:11:12.291830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:12.291830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 612/1230] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:11:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:11:12.296844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56585e-5a5f-4872-b503-083f70e87e91 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:12.416157 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56585e-5a5f-4872-b503-083f70e87e91 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:12.458718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f43d4-9e95-489b-bbf2-e9c8eb007cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:12.459372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f43d4-9e95-489b-bbf2-e9c8eb007cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:12.459743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f43d4-9e95-489b-bbf2-e9c8eb007cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:12.460026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f43d4-9e95-489b-bbf2-e9c8eb007cd4 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:12.460814 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f43d4-9e95-489b-bbf2-e9c8eb007cd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:12.461124 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f43d4-9e95-489b-bbf2-e9c8eb007cd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:12.462822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f43d4-9e95-489b-bbf2-e9c8eb007cd4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:12.477769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 619/1231] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:11:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:11:12.484567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98600a-8643-417e-b941-04de146a67f1 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:12.561246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:12.600111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98600a-8643-417e-b941-04de146a67f1 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:12.641105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f416a5d-68be-44f6-b867-3bd536dfa7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:12.641811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f416a5d-68be-44f6-b867-3bd536dfa7f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:12.642192 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f416a5d-68be-44f6-b867-3bd536dfa7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:12.642535 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f416a5d-68be-44f6-b867-3bd536dfa7f4 None admin] PATH_INFO: `/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/d01dd2631a81402d8a5bba7007c7fd61/roles/bf66c83a5d0f41039e44947c9fb18d3c` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:12.659297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f416a5d-68be-44f6-b867-3bd536dfa7f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0864c2a6b50f403db79930d0869f8e23, user_id=d01dd2631a81402d8a5bba7007c7fd61, role_id=bf66c83a5d0f41039e44947c9fb18d3c)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:12.661236 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f416a5d-68be-44f6-b867-3bd536dfa7f4 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:12.675127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 613/1232] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:11:12 2022] PUT /identity/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/d01dd2631a81402d8a5bba7007c7fd61/roles/bf66c83a5d0f41039e44947c9fb18d3c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:11:14.662649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b035b7a-21e3-43b6-994a-3ab57bcbeb33 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:14.663298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b035b7a-21e3-43b6-994a-3ab57bcbeb33 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:14.663298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b035b7a-21e3-43b6-994a-3ab57bcbeb33 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:14.664579 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 620/1233] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:14.670313 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecd6a6-e364-4d0c-ab85-c373d003830d None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:14.670851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecd6a6-e364-4d0c-ab85-c373d003830d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:14.670952 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecd6a6-e364-4d0c-ab85-c373d003830d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:14.691641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-36ecd6a6-e364-4d0c-ab85-c373d003830d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:14.692894 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-36ecd6a6-e364-4d0c-ab85-c373d003830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:14.776731 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 614/1234] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:11:15.044302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b035b7a-21e3-43b6-994a-3ab57bcbeb33 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:15.072845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:15.163721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b035b7a-21e3-43b6-994a-3ab57bcbeb33 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:15.198855 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0583c1f-ec5c-47ed-bcf9-9f0810487c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:15.199523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0583c1f-ec5c-47ed-bcf9-9f0810487c19 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:15.199836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0583c1f-ec5c-47ed-bcf9-9f0810487c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:15.200109 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0583c1f-ec5c-47ed-bcf9-9f0810487c19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:15.210730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0583c1f-ec5c-47ed-bcf9-9f0810487c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-b0583c1f-ec5c-47ed-bcf9-9f0810487c19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:11:15.216143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:15.217186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:15.218092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:15.218092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:15.218092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:15.218092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:15.218092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:11:15.218092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:11:15.218092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:11:15.218092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:11:15.218092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:11:15.218092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:11:15.218092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:11:15.218092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:15.218092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 621/1235] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Aug 31 00:11:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:15.223915 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecd6a6-e364-4d0c-ab85-c373d003830d None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:15.276956 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:15.334707 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecd6a6-e364-4d0c-ab85-c373d003830d None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:15.368942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568cd2e-fcb1-4a91-aee4-c682f563619c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:15.369553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568cd2e-fcb1-4a91-aee4-c682f563619c None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:15.369826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568cd2e-fcb1-4a91-aee4-c682f563619c None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:15.370092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568cd2e-fcb1-4a91-aee4-c682f563619c None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:15.370756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568cd2e-fcb1-4a91-aee4-c682f563619c None admin] RBAC: Adding query filter params (name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:15.371054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568cd2e-fcb1-4a91-aee4-c682f563619c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:15.372513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568cd2e-fcb1-4a91-aee4-c682f563619c None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:15.381152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 615/1236] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Aug 31 00:11:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:15.387442 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0583c1f-ec5c-47ed-bcf9-9f0810487c19 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:15.481368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:15.499429 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0583c1f-ec5c-47ed-bcf9-9f0810487c19 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:15.535099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d0dc3-f80c-4e2b-a4de-af4bf7c745d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:15.535834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d0dc3-f80c-4e2b-a4de-af4bf7c745d6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:15.536125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d0dc3-f80c-4e2b-a4de-af4bf7c745d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:15.536375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d0dc3-f80c-4e2b-a4de-af4bf7c745d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:15.546994 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d0dc3-f80c-4e2b-a4de-af4bf7c745d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:15.548561 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d0dc3-f80c-4e2b-a4de-af4bf7c745d6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7a8d0dc3-f80c-4e2b-a4de-af4bf7c745d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:11:15.564600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:15.565637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:11:15.566616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:11:15.566616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:15.566616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:15.566616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 622/1237] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:15.573121 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568cd2e-fcb1-4a91-aee4-c682f563619c None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:15.689668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568cd2e-fcb1-4a91-aee4-c682f563619c None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:15.699792 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:15.729448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e24d6-697c-45b6-9734-e0b5d8b26da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:15.730142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e24d6-697c-45b6-9734-e0b5d8b26da4 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:15.730417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e24d6-697c-45b6-9734-e0b5d8b26da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:15.730756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e24d6-697c-45b6-9734-e0b5d8b26da4 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:15.731429 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e24d6-697c-45b6-9734-e0b5d8b26da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:15.731940 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e24d6-697c-45b6-9734-e0b5d8b26da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:15.733507 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e24d6-697c-45b6-9734-e0b5d8b26da4 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:15.752262 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 616/1238] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:15.753951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d0dc3-f80c-4e2b-a4de-af4bf7c745d6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:15.864299 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d0dc3-f80c-4e2b-a4de-af4bf7c745d6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:15.902066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35f3e4-609a-47b3-955e-ff9df4a0ba06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:15.902733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35f3e4-609a-47b3-955e-ff9df4a0ba06 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:15.903050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35f3e4-609a-47b3-955e-ff9df4a0ba06 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:15.903394 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35f3e4-609a-47b3-955e-ff9df4a0ba06 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:15.906515 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:15.912461 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35f3e4-609a-47b3-955e-ff9df4a0ba06 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:15.914420 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35f3e4-609a-47b3-955e-ff9df4a0ba06 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-fe35f3e4-609a-47b3-955e-ff9df4a0ba06 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:11:15.926223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:15.927480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:15.928759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:15.928759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:15.928759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:11:15.928759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:11:15.928759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:11:15.928759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:11:15.928759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:11:15.928759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:11:15.928759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:11:15.928759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:15.932576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 623/1239] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:15.933843 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e24d6-697c-45b6-9734-e0b5d8b26da4 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:16.042213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e24d6-697c-45b6-9734-e0b5d8b26da4 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:16.078893 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc3146-f261-436f-8b1a-fb39fc3a6159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:16.079539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc3146-f261-436f-8b1a-fb39fc3a6159 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:16.079905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc3146-f261-436f-8b1a-fb39fc3a6159 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:16.080176 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc3146-f261-436f-8b1a-fb39fc3a6159 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:16.080899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc3146-f261-436f-8b1a-fb39fc3a6159 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:16.081199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc3146-f261-436f-8b1a-fb39fc3a6159 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:16.082663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc3146-f261-436f-8b1a-fb39fc3a6159 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:16.100310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 617/1240] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Aug 31 00:11:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:11:16.106684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35f3e4-609a-47b3-955e-ff9df4a0ba06 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:16.241810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35f3e4-609a-47b3-955e-ff9df4a0ba06 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:16.281333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c571fef-d82e-4a48-b114-825ebd64b5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:16.281967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c571fef-d82e-4a48-b114-825ebd64b5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:16.282246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c571fef-d82e-4a48-b114-825ebd64b5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:16.282678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c571fef-d82e-4a48-b114-825ebd64b5a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:16.355566 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:16.367105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c571fef-d82e-4a48-b114-825ebd64b5a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:16.368645 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c571fef-d82e-4a48-b114-825ebd64b5a1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:16.487311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 624/1241] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:11:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:11:16.488670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc3146-f261-436f-8b1a-fb39fc3a6159 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:16.520086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:16.601537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc3146-f261-436f-8b1a-fb39fc3a6159 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:16.645309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ea804-9d28-4e9d-86c8-9fe7b3f7e862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:16.645933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ea804-9d28-4e9d-86c8-9fe7b3f7e862 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:16.646227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ea804-9d28-4e9d-86c8-9fe7b3f7e862 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:16.646478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ea804-9d28-4e9d-86c8-9fe7b3f7e862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:16.657833 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ea804-9d28-4e9d-86c8-9fe7b3f7e862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:16.659320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ea804-9d28-4e9d-86c8-9fe7b3f7e862 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-7d4ea804-9d28-4e9d-86c8-9fe7b3f7e862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:11:16.676417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:16.677518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:11:16.678481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:11:16.678481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:16.678481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:16.678481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 618/1242] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:16.683650 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c571fef-d82e-4a48-b114-825ebd64b5a1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:16.797096 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:16.803718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c571fef-d82e-4a48-b114-825ebd64b5a1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:16.841586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd07d6-1c6b-4dc9-8c49-ad2d77566530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:16.842210 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd07d6-1c6b-4dc9-8c49-ad2d77566530 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:16.842480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd07d6-1c6b-4dc9-8c49-ad2d77566530 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:16.842758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd07d6-1c6b-4dc9-8c49-ad2d77566530 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:16.843400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd07d6-1c6b-4dc9-8c49-ad2d77566530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:16.843781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd07d6-1c6b-4dc9-8c49-ad2d77566530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:16.845307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd07d6-1c6b-4dc9-8c49-ad2d77566530 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:16.859623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 625/1243] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:16.866038 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ea804-9d28-4e9d-86c8-9fe7b3f7e862 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:16.952207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:16.975966 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ea804-9d28-4e9d-86c8-9fe7b3f7e862 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:17.016787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d94631-12a2-4886-bd4e-c34a348064a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:17.017495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94631-12a2-4886-bd4e-c34a348064a2 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:17.017773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94631-12a2-4886-bd4e-c34a348064a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:17.018089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94631-12a2-4886-bd4e-c34a348064a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:17.025997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d94631-12a2-4886-bd4e-c34a348064a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:17.027775 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d94631-12a2-4886-bd4e-c34a348064a2 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-72d94631-12a2-4886-bd4e-c34a348064a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:11:17.040202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:17.041565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:17.042805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:11:17.042805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:11:17.042805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:11:17.042805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:11:17.042805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:11:17.042805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:11:17.042805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:11:17.042805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:17.042805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 619/1244] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:11:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:11:17.048378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd07d6-1c6b-4dc9-8c49-ad2d77566530 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:17.168019 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd07d6-1c6b-4dc9-8c49-ad2d77566530 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:17.207648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cbdd7-aa1f-480c-a6ef-d9d31d9517eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:17.208401 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cbdd7-aa1f-480c-a6ef-d9d31d9517eb None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:17.208744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cbdd7-aa1f-480c-a6ef-d9d31d9517eb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:17.209078 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cbdd7-aa1f-480c-a6ef-d9d31d9517eb None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:17.209842 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cbdd7-aa1f-480c-a6ef-d9d31d9517eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:17.210215 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cbdd7-aa1f-480c-a6ef-d9d31d9517eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:17.211764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cbdd7-aa1f-480c-a6ef-d9d31d9517eb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:17.226518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 626/1245] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:17.232951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d94631-12a2-4886-bd4e-c34a348064a2 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:17.343087 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d94631-12a2-4886-bd4e-c34a348064a2 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:17.377380 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f93e4-ab96-421c-aee5-262102680077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:17.377982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f93e4-ab96-421c-aee5-262102680077 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:17.378256 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f93e4-ab96-421c-aee5-262102680077 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:17.378518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f93e4-ab96-421c-aee5-262102680077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:17.379244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f93e4-ab96-421c-aee5-262102680077 None admin] RBAC: Adding query filter params (role.id=bf66c83a5d0f41039e44947c9fb18d3c, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=d01dd2631a81402d8a5bba7007c7fd61) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:17.379542 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f93e4-ab96-421c-aee5-262102680077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:17.381036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f93e4-ab96-421c-aee5-262102680077 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:17.387498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 620/1246] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:11:17 2022] GET /identity/v3/role_assignments?user.id=d01dd2631a81402d8a5bba7007c7fd61&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=bf66c83a5d0f41039e44947c9fb18d3c => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:11:19.395368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aef15-d64f-4e5d-b57b-0880bd974e11 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:19.395956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aef15-d64f-4e5d-b57b-0880bd974e11 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:19.395956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aef15-d64f-4e5d-b57b-0880bd974e11 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:19.397311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 627/1247] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:19.403026 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380db0ba-6f87-4c0c-8c5f-e67b3dd579c1 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:19.403483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380db0ba-6f87-4c0c-8c5f-e67b3dd579c1 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:19.403576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380db0ba-6f87-4c0c-8c5f-e67b3dd579c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:19.411795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:19.425659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-380db0ba-6f87-4c0c-8c5f-e67b3dd579c1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:19.426920 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-380db0ba-6f87-4c0c-8c5f-e67b3dd579c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:19.503467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 621/1248] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:11:19.787650 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aef15-d64f-4e5d-b57b-0880bd974e11 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:19.810928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:19.907440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aef15-d64f-4e5d-b57b-0880bd974e11 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:19.946657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788e991-dd9f-4156-9e0a-ee5075662b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:19.947307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e991-dd9f-4156-9e0a-ee5075662b3e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:19.947568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e991-dd9f-4156-9e0a-ee5075662b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:19.947934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e991-dd9f-4156-9e0a-ee5075662b3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:19.961214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788e991-dd9f-4156-9e0a-ee5075662b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-b788e991-dd9f-4156-9e0a-ee5075662b3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:11:19.966629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:19.967664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:19.968610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:19.968610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:19.968610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:19.968610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:19.968610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:11:19.968610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:11:19.968610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:11:19.968610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:11:19.968610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:11:19.968610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:11:19.968610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:11:19.968610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:19.968610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 628/1249] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:11:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:19.974859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380db0ba-6f87-4c0c-8c5f-e67b3dd579c1 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:20.083967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380db0ba-6f87-4c0c-8c5f-e67b3dd579c1 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:20.116646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:20.122859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4053b-987d-4bf6-b19c-ff0a39454b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:20.123865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4053b-987d-4bf6-b19c-ff0a39454b13 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:20.124211 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4053b-987d-4bf6-b19c-ff0a39454b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:20.124521 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4053b-987d-4bf6-b19c-ff0a39454b13 None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:20.125298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4053b-987d-4bf6-b19c-ff0a39454b13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:20.125656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4053b-987d-4bf6-b19c-ff0a39454b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:20.127308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4053b-987d-4bf6-b19c-ff0a39454b13 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:20.136914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 622/1250] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:11:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:11:20.143307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788e991-dd9f-4156-9e0a-ee5075662b3e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:20.238031 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:20.264784 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788e991-dd9f-4156-9e0a-ee5075662b3e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:20.308309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc285a5-bf78-448f-9f63-73d5a0ba93d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:20.309269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc285a5-bf78-448f-9f63-73d5a0ba93d8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:20.309638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc285a5-bf78-448f-9f63-73d5a0ba93d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:20.309912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc285a5-bf78-448f-9f63-73d5a0ba93d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:20.325123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc285a5-bf78-448f-9f63-73d5a0ba93d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:20.327518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc285a5-bf78-448f-9f63-73d5a0ba93d8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-fbc285a5-bf78-448f-9f63-73d5a0ba93d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:11:20.345654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:20.346734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:11:20.347806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:11:20.347806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:20.347806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:20.347806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 629/1251] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:11:20.353937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4053b-987d-4bf6-b19c-ff0a39454b13 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:20.464808 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4053b-987d-4bf6-b19c-ff0a39454b13 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:20.503237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa46335-158f-4d4f-83af-e007c8d3b1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:20.503871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa46335-158f-4d4f-83af-e007c8d3b1aa None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:20.504153 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa46335-158f-4d4f-83af-e007c8d3b1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:20.504422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa46335-158f-4d4f-83af-e007c8d3b1aa None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:20.505116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa46335-158f-4d4f-83af-e007c8d3b1aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:20.505556 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa46335-158f-4d4f-83af-e007c8d3b1aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:20.506883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa46335-158f-4d4f-83af-e007c8d3b1aa None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:20.520427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 623/1252] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:20.526288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc285a5-bf78-448f-9f63-73d5a0ba93d8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:20.639667 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc285a5-bf78-448f-9f63-73d5a0ba93d8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:20.670732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:20.680307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab08c4-72be-4d68-b285-096ff035a866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:20.681090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab08c4-72be-4d68-b285-096ff035a866 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:20.681369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab08c4-72be-4d68-b285-096ff035a866 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:20.681675 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab08c4-72be-4d68-b285-096ff035a866 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:20.693190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab08c4-72be-4d68-b285-096ff035a866 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:20.694723 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab08c4-72be-4d68-b285-096ff035a866 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-00ab08c4-72be-4d68-b285-096ff035a866 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:11:20.706988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:20.708593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:20.709770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:20.709770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:20.709770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:11:20.709770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:11:20.709770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:11:20.709770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:11:20.709770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:11:20.709770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:11:20.709770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:11:20.709770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:20.709770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 630/1253] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:11:20.714545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa46335-158f-4d4f-83af-e007c8d3b1aa None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:20.781222 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:20.830576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa46335-158f-4d4f-83af-e007c8d3b1aa None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:20.868343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ba5ae-c9a9-4d3d-bb62-8ad52d6c3810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:20.869042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ba5ae-c9a9-4d3d-bb62-8ad52d6c3810 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:20.869313 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ba5ae-c9a9-4d3d-bb62-8ad52d6c3810 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:20.869579 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ba5ae-c9a9-4d3d-bb62-8ad52d6c3810 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:20.870356 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ba5ae-c9a9-4d3d-bb62-8ad52d6c3810 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:20.870631 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ba5ae-c9a9-4d3d-bb62-8ad52d6c3810 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:20.872259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ba5ae-c9a9-4d3d-bb62-8ad52d6c3810 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:20.892537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 624/1254] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Aug 31 00:11:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:20.898517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab08c4-72be-4d68-b285-096ff035a866 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:21.010929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab08c4-72be-4d68-b285-096ff035a866 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:21.051398 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e31eb-2026-4850-9554-6258282da4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:21.052176 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e31eb-2026-4850-9554-6258282da4ca None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:21.052437 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e31eb-2026-4850-9554-6258282da4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:21.052751 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e31eb-2026-4850-9554-6258282da4ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:21.114678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:21.129998 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e31eb-2026-4850-9554-6258282da4ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:21.131647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e31eb-2026-4850-9554-6258282da4ca None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:21.255669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 631/1255] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:11:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:11:21.264379 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ba5ae-c9a9-4d3d-bb62-8ad52d6c3810 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:21.378888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ba5ae-c9a9-4d3d-bb62-8ad52d6c3810 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:21.394673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:21.425099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44ea98-01ee-45f7-a602-a58a81ba0ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:21.425924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44ea98-01ee-45f7-a602-a58a81ba0ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:21.426400 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44ea98-01ee-45f7-a602-a58a81ba0ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:21.426957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44ea98-01ee-45f7-a602-a58a81ba0ce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:21.441814 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44ea98-01ee-45f7-a602-a58a81ba0ce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:21.443452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44ea98-01ee-45f7-a602-a58a81ba0ce5 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-aa44ea98-01ee-45f7-a602-a58a81ba0ce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:11:21.459014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:21.460238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:11:21.461555 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:11:21.461555 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:21.461555 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:21.461555 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 625/1256] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:21.466532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e31eb-2026-4850-9554-6258282da4ca None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:21.559680 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:21.573870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e31eb-2026-4850-9554-6258282da4ca None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:21.612017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249e4dd-dd8c-41a6-9397-8951c33e0008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:21.612677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249e4dd-dd8c-41a6-9397-8951c33e0008 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:21.612960 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249e4dd-dd8c-41a6-9397-8951c33e0008 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:21.613229 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249e4dd-dd8c-41a6-9397-8951c33e0008 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:21.613926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249e4dd-dd8c-41a6-9397-8951c33e0008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:21.614258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249e4dd-dd8c-41a6-9397-8951c33e0008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:21.615644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249e4dd-dd8c-41a6-9397-8951c33e0008 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:21.627796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 632/1257] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:21.634131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44ea98-01ee-45f7-a602-a58a81ba0ce5 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:21.757803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44ea98-01ee-45f7-a602-a58a81ba0ce5 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:21.794345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbe0b9-da9f-44e7-bdaf-683231324f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:21.795012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbe0b9-da9f-44e7-bdaf-683231324f20 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:21.795289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbe0b9-da9f-44e7-bdaf-683231324f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:21.795560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbe0b9-da9f-44e7-bdaf-683231324f20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:21.802831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbe0b9-da9f-44e7-bdaf-683231324f20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:21.804392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbe0b9-da9f-44e7-bdaf-683231324f20 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-5bbbe0b9-da9f-44e7-bdaf-683231324f20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:11:21.817491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:21.818659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:21.819950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:11:21.819950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:11:21.819950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:11:21.819950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:11:21.819950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:11:21.819950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:11:21.819950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:11:21.819950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:21.819950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 626/1258] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:11:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:21.825162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249e4dd-dd8c-41a6-9397-8951c33e0008 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:21.932538 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249e4dd-dd8c-41a6-9397-8951c33e0008 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:21.971322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf765e3-b49d-4f81-b210-a8d213e6c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:21.972009 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf765e3-b49d-4f81-b210-a8d213e6c0ec None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:21.972285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf765e3-b49d-4f81-b210-a8d213e6c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:21.972551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf765e3-b49d-4f81-b210-a8d213e6c0ec None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:21.973298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf765e3-b49d-4f81-b210-a8d213e6c0ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:21.973615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf765e3-b49d-4f81-b210-a8d213e6c0ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:21.975252 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf765e3-b49d-4f81-b210-a8d213e6c0ec None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:21.988323 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 633/1259] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:11:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:21.994764 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbe0b9-da9f-44e7-bdaf-683231324f20 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:22.021492 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:22.098918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbe0b9-da9f-44e7-bdaf-683231324f20 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:22.134595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0eca0b-e629-4c23-8eb0-e827211ba74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:22.135233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0eca0b-e629-4c23-8eb0-e827211ba74b None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:22.135510 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0eca0b-e629-4c23-8eb0-e827211ba74b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:22.135839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0eca0b-e629-4c23-8eb0-e827211ba74b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:22.136571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0eca0b-e629-4c23-8eb0-e827211ba74b None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=d01dd2631a81402d8a5bba7007c7fd61) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:22.136878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0eca0b-e629-4c23-8eb0-e827211ba74b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:22.138387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0eca0b-e629-4c23-8eb0-e827211ba74b None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:22.144778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 627/1260] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:11:21 2022] GET /identity/v3/role_assignments?user.id=d01dd2631a81402d8a5bba7007c7fd61&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:11:24.132805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f617a3e-4e4c-445a-aabb-ffe9d3d9eba0 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:24.133370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f617a3e-4e4c-445a-aabb-ffe9d3d9eba0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:24.133370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f617a3e-4e4c-445a-aabb-ffe9d3d9eba0 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:24.134678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 634/1261] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:24.140954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f17fa-6f0d-4e59-a7d8-991fff661482 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:24.141646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f17fa-6f0d-4e59-a7d8-991fff661482 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:24.141788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f17fa-6f0d-4e59-a7d8-991fff661482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:24.167851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-dd2f17fa-6f0d-4e59-a7d8-991fff661482 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:24.169055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-dd2f17fa-6f0d-4e59-a7d8-991fff661482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:24.244830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 628/1262] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:11:24.509349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f617a3e-4e4c-445a-aabb-ffe9d3d9eba0 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:24.521926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:24.618764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f617a3e-4e4c-445a-aabb-ffe9d3d9eba0 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:24.653897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8f788-65ce-470b-876f-038d8c34160d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:24.654512 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8f788-65ce-470b-876f-038d8c34160d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:24.654785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8f788-65ce-470b-876f-038d8c34160d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:24.655049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8f788-65ce-470b-876f-038d8c34160d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:24.666182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8f788-65ce-470b-876f-038d8c34160d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-eea8f788-65ce-470b-876f-038d8c34160d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:11:24.670941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:24.672118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:24.673149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:24.673149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:24.673149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:24.673149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:24.673149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:11:24.673149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:11:24.673149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:11:24.673149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:11:24.673149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:11:24.673149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:11:24.673149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:11:24.673149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:24.673149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 635/1263] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:11:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:24.678958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f17fa-6f0d-4e59-a7d8-991fff661482 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:24.704964 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:24.791555 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f17fa-6f0d-4e59-a7d8-991fff661482 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:24.827543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e2e65-4acf-4036-94a8-bc3a044f2e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:24.828164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e2e65-4acf-4036-94a8-bc3a044f2e1f None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:24.828436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e2e65-4acf-4036-94a8-bc3a044f2e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:24.828703 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e2e65-4acf-4036-94a8-bc3a044f2e1f None admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:24.829485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e2e65-4acf-4036-94a8-bc3a044f2e1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:24.829783 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e2e65-4acf-4036-94a8-bc3a044f2e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:24.831164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e2e65-4acf-4036-94a8-bc3a044f2e1f None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:24.839279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 629/1264] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:11:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:24.846272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8f788-65ce-470b-876f-038d8c34160d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:24.932340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:24.970704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8f788-65ce-470b-876f-038d8c34160d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:25.009736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7d59b-ee31-47c7-91f1-45b325be78ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:25.010363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7d59b-ee31-47c7-91f1-45b325be78ec None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:25.010643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7d59b-ee31-47c7-91f1-45b325be78ec None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:25.010911 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7d59b-ee31-47c7-91f1-45b325be78ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:25.021405 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7d59b-ee31-47c7-91f1-45b325be78ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:25.022848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7d59b-ee31-47c7-91f1-45b325be78ec None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-b2c7d59b-ee31-47c7-91f1-45b325be78ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:11:25.038129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:25.039191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:11:25.040232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:11:25.040232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:25.040232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:25.040232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 636/1265] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:25.048413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e2e65-4acf-4036-94a8-bc3a044f2e1f None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:25.139266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:25.159594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e2e65-4acf-4036-94a8-bc3a044f2e1f None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:25.194264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ff136-8185-4eee-85d3-110e12e31a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:25.194873 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ff136-8185-4eee-85d3-110e12e31a3b None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:25.195152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ff136-8185-4eee-85d3-110e12e31a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:25.195423 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ff136-8185-4eee-85d3-110e12e31a3b None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:25.196099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ff136-8185-4eee-85d3-110e12e31a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:25.196400 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ff136-8185-4eee-85d3-110e12e31a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:25.197791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ff136-8185-4eee-85d3-110e12e31a3b None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:25.209362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 630/1266] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:25.215884 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7d59b-ee31-47c7-91f1-45b325be78ec None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:25.329565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7d59b-ee31-47c7-91f1-45b325be78ec None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:25.349069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:25.365363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27170451-732c-43bd-89cd-fa10d7fbf191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:25.365991 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27170451-732c-43bd-89cd-fa10d7fbf191 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:25.366265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27170451-732c-43bd-89cd-fa10d7fbf191 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:25.366534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27170451-732c-43bd-89cd-fa10d7fbf191 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:25.374226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27170451-732c-43bd-89cd-fa10d7fbf191 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:25.375680 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27170451-732c-43bd-89cd-fa10d7fbf191 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-27170451-732c-43bd-89cd-fa10d7fbf191 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:11:25.387134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:25.388281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:25.389508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:25.389508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:25.389508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:11:25.389508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:11:25.389508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:11:25.389508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:11:25.389508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:11:25.389508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:11:25.389508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:11:25.389508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:25.389508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 637/1267] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:25.395115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ff136-8185-4eee-85d3-110e12e31a3b None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:25.510747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ff136-8185-4eee-85d3-110e12e31a3b None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:25.545805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bb2c6-3325-4825-81ed-ae71971a0252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:25.546395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bb2c6-3325-4825-81ed-ae71971a0252 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:25.546664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bb2c6-3325-4825-81ed-ae71971a0252 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:25.546928 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bb2c6-3325-4825-81ed-ae71971a0252 None admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:25.547730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bb2c6-3325-4825-81ed-ae71971a0252 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:25.548023 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bb2c6-3325-4825-81ed-ae71971a0252 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:25.549451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bb2c6-3325-4825-81ed-ae71971a0252 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:25.557998 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:25.571759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 631/1268] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Aug 31 00:11:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:25.577705 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27170451-732c-43bd-89cd-fa10d7fbf191 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:25.699622 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27170451-732c-43bd-89cd-fa10d7fbf191 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:25.749758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91110878-0212-4874-889c-b37b2d897465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:25.750671 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91110878-0212-4874-889c-b37b2d897465 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:25.751080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91110878-0212-4874-889c-b37b2d897465 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:25.751359 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91110878-0212-4874-889c-b37b2d897465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:25.764560 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91110878-0212-4874-889c-b37b2d897465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:25.766227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91110878-0212-4874-889c-b37b2d897465 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-91110878-0212-4874-889c-b37b2d897465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:11:25.781008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:25.782286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:11:25.783466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:11:25.783466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:25.783466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:25.787448 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 638/1269] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:25.788553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bb2c6-3325-4825-81ed-ae71971a0252 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:25.892684 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bb2c6-3325-4825-81ed-ae71971a0252 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:25.927182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb16a4-f030-4629-8505-ed981159593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:25.927870 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb16a4-f030-4629-8505-ed981159593d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:25.928121 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb16a4-f030-4629-8505-ed981159593d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:25.928392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb16a4-f030-4629-8505-ed981159593d None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:25.929032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb16a4-f030-4629-8505-ed981159593d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:25.929337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb16a4-f030-4629-8505-ed981159593d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:25.930733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb16a4-f030-4629-8505-ed981159593d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:25.943421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 632/1270] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:11:25.952833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91110878-0212-4874-889c-b37b2d897465 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:25.997191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:26.089269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91110878-0212-4874-889c-b37b2d897465 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:26.131396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555018fc-9010-489b-9147-888465b35cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:26.132074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555018fc-9010-489b-9147-888465b35cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:26.132365 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555018fc-9010-489b-9147-888465b35cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:26.132638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555018fc-9010-489b-9147-888465b35cd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:26.140184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555018fc-9010-489b-9147-888465b35cd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:26.141687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555018fc-9010-489b-9147-888465b35cd0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-555018fc-9010-489b-9147-888465b35cd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:11:26.154315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:26.155335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:26.156692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:11:26.156692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:11:26.156692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:11:26.156692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:11:26.156692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:11:26.156692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:11:26.156692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:11:26.156692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:26.156692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 639/1271] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:11:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:26.161582 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb16a4-f030-4629-8505-ed981159593d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:26.225269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:26.271685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb16a4-f030-4629-8505-ed981159593d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:26.305986 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c7e83-c0fe-49a0-b014-88bbe734afae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:26.306587 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7e83-c0fe-49a0-b014-88bbe734afae None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:26.306859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7e83-c0fe-49a0-b014-88bbe734afae None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:26.307125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7e83-c0fe-49a0-b014-88bbe734afae None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:26.307835 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c7e83-c0fe-49a0-b014-88bbe734afae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:26.308138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c7e83-c0fe-49a0-b014-88bbe734afae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:26.309554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c7e83-c0fe-49a0-b014-88bbe734afae None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:26.323138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 633/1272] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:11:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:26.331989 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555018fc-9010-489b-9147-888465b35cd0 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:26.452100 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:26.461896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555018fc-9010-489b-9147-888465b35cd0 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:26.500017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a74efa-c46e-44e6-8e1e-5cb2b6faefb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:26.500574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74efa-c46e-44e6-8e1e-5cb2b6faefb9 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:26.500975 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74efa-c46e-44e6-8e1e-5cb2b6faefb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:26.501260 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74efa-c46e-44e6-8e1e-5cb2b6faefb9 None admin] PATH_INFO: `/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/d01dd2631a81402d8a5bba7007c7fd61/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:26.503416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a74efa-c46e-44e6-8e1e-5cb2b6faefb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0864c2a6b50f403db79930d0869f8e23, user_id=d01dd2631a81402d8a5bba7007c7fd61, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:26.504896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a74efa-c46e-44e6-8e1e-5cb2b6faefb9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:26.520939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 640/1273] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Aug 31 00:11:26 2022] PUT /identity/v3/projects/0864c2a6b50f403db79930d0869f8e23/users/d01dd2631a81402d8a5bba7007c7fd61/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:11:28.396172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a8403-bb03-4a19-9f29-3398e044d804 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:28.397197 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a8403-bb03-4a19-9f29-3398e044d804 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:28.397197 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a8403-bb03-4a19-9f29-3398e044d804 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:28.399157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 634/1274] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:11:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:28.408046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e113a-07f7-47d5-84f6-6b5183359c75 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:28.408794 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e113a-07f7-47d5-84f6-6b5183359c75 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:28.408976 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e113a-07f7-47d5-84f6-6b5183359c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:28.434955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d96e113a-07f7-47d5-84f6-6b5183359c75 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:28.436114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d96e113a-07f7-47d5-84f6-6b5183359c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:28.516464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 641/1275] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:11:28.798884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a8403-bb03-4a19-9f29-3398e044d804 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:28.905857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a8403-bb03-4a19-9f29-3398e044d804 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:28.923084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:28.941798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc238d-6b3a-412f-aeb9-a0daeaccfb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:28.942418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc238d-6b3a-412f-aeb9-a0daeaccfb49 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:28.942698 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc238d-6b3a-412f-aeb9-a0daeaccfb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:28.942969 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc238d-6b3a-412f-aeb9-a0daeaccfb49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:28.954232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc238d-6b3a-412f-aeb9-a0daeaccfb49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-ddbc238d-6b3a-412f-aeb9-a0daeaccfb49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:11:28.959018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:28.960165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:28.961353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:28.961353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:28.961353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:28.961353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:28.961353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:11:28.961353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:11:28.961353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:11:28.961353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:11:28.961353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:11:28.961353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:11:28.961353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:11:28.961353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:28.961353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 635/1276] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Aug 31 00:11:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:28.966246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e113a-07f7-47d5-84f6-6b5183359c75 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:29.049575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:29.071255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e113a-07f7-47d5-84f6-6b5183359c75 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:29.107537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7edb2-2063-4c59-ad75-c9180cbe2be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:29.108189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7edb2-2063-4c59-ad75-c9180cbe2be2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:29.108461 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7edb2-2063-4c59-ad75-c9180cbe2be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:29.108741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7edb2-2063-4c59-ad75-c9180cbe2be2 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:29.109414 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7edb2-2063-4c59-ad75-c9180cbe2be2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:29.109722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7edb2-2063-4c59-ad75-c9180cbe2be2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:29.111178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7edb2-2063-4c59-ad75-c9180cbe2be2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:29.119423 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 642/1277] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Aug 31 00:11:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:29.125448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc238d-6b3a-412f-aeb9-a0daeaccfb49 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:29.232058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc238d-6b3a-412f-aeb9-a0daeaccfb49 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:29.268675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa710e6-9a08-40e3-9655-7451094368ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:29.269307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa710e6-9a08-40e3-9655-7451094368ab None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:29.269583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa710e6-9a08-40e3-9655-7451094368ab None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:29.269850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa710e6-9a08-40e3-9655-7451094368ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:29.280601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa710e6-9a08-40e3-9655-7451094368ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:29.282096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa710e6-9a08-40e3-9655-7451094368ab None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-5aa710e6-9a08-40e3-9655-7451094368ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:11:29.297031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:29.298265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:11:29.299317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:11:29.299317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:29.299317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:29.299317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 636/1278] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:29.305397 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7edb2-2063-4c59-ad75-c9180cbe2be2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:29.419193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7edb2-2063-4c59-ad75-c9180cbe2be2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:29.456914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7eea4-5ddc-4eeb-8c62-fd198cb3db2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:29.457771 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7eea4-5ddc-4eeb-8c62-fd198cb3db2d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:29.458130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7eea4-5ddc-4eeb-8c62-fd198cb3db2d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:29.458406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7eea4-5ddc-4eeb-8c62-fd198cb3db2d None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:29.459356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7eea4-5ddc-4eeb-8c62-fd198cb3db2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:29.459799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7eea4-5ddc-4eeb-8c62-fd198cb3db2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:29.461943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7eea4-5ddc-4eeb-8c62-fd198cb3db2d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:29.477194 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 643/1279] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:29.483718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa710e6-9a08-40e3-9655-7451094368ab None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:29.520321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:29.589375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa710e6-9a08-40e3-9655-7451094368ab None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:29.627225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334824f-80f4-4b06-a09b-0696ef327151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:29.627868 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334824f-80f4-4b06-a09b-0696ef327151 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:29.628143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334824f-80f4-4b06-a09b-0696ef327151 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:29.628396 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334824f-80f4-4b06-a09b-0696ef327151 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:29.635926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334824f-80f4-4b06-a09b-0696ef327151 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:29.637381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334824f-80f4-4b06-a09b-0696ef327151 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-a334824f-80f4-4b06-a09b-0696ef327151 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:11:29.648971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:29.655866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:29.657057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:29.657057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:29.657057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:11:29.657057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:11:29.657057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:11:29.657057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:11:29.657057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:11:29.657057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:11:29.657057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:11:29.657057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:29.657057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 637/1280] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:29.658498 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7eea4-5ddc-4eeb-8c62-fd198cb3db2d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:29.664483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:29.772389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7eea4-5ddc-4eeb-8c62-fd198cb3db2d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:29.807423 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f092795-335a-4103-916f-ec8884b289d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:29.808122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f092795-335a-4103-916f-ec8884b289d9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:29.808329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f092795-335a-4103-916f-ec8884b289d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:29.808606 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f092795-335a-4103-916f-ec8884b289d9 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:29.809344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f092795-335a-4103-916f-ec8884b289d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:29.809649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f092795-335a-4103-916f-ec8884b289d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:29.811114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f092795-335a-4103-916f-ec8884b289d9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:29.829517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 644/1281] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Aug 31 00:11:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:29.836372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334824f-80f4-4b06-a09b-0696ef327151 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:29.942614 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:29.954882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334824f-80f4-4b06-a09b-0696ef327151 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:29.987746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c233131-02a0-44ee-a5a5-ab2b0b80780d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:29.988385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233131-02a0-44ee-a5a5-ab2b0b80780d None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:29.988666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233131-02a0-44ee-a5a5-ab2b0b80780d None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:29.988941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233131-02a0-44ee-a5a5-ab2b0b80780d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:30.065269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c233131-02a0-44ee-a5a5-ab2b0b80780d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:30.067559 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c233131-02a0-44ee-a5a5-ab2b0b80780d None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:30.168140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:30.180052 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 638/1282] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Aug 31 00:11:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:11:30.186319 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f092795-335a-4103-916f-ec8884b289d9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:30.249672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:30.289117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f092795-335a-4103-916f-ec8884b289d9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:30.325945 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13a51f-ec32-448c-9f9d-18c53ff7ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:30.326572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13a51f-ec32-448c-9f9d-18c53ff7ea12 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:30.326847 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13a51f-ec32-448c-9f9d-18c53ff7ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:30.327114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13a51f-ec32-448c-9f9d-18c53ff7ea12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:30.340714 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13a51f-ec32-448c-9f9d-18c53ff7ea12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:30.343068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13a51f-ec32-448c-9f9d-18c53ff7ea12 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-4c13a51f-ec32-448c-9f9d-18c53ff7ea12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:11:30.359523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:30.360674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:11:30.361997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:11:30.361997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:11:30.361997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:30.361997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 645/1283] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:11:30.366607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c233131-02a0-44ee-a5a5-ab2b0b80780d None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:30.474718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c233131-02a0-44ee-a5a5-ab2b0b80780d None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:30.510388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bf754-5296-4bb3-aa09-6b9d72d63008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:30.510983 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bf754-5296-4bb3-aa09-6b9d72d63008 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:30.511186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bf754-5296-4bb3-aa09-6b9d72d63008 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:30.511453 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bf754-5296-4bb3-aa09-6b9d72d63008 None admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:30.512125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bf754-5296-4bb3-aa09-6b9d72d63008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:30.512429 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bf754-5296-4bb3-aa09-6b9d72d63008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:30.513795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bf754-5296-4bb3-aa09-6b9d72d63008 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:30.525049 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 639/1284] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Aug 31 00:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:30.530992 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13a51f-ec32-448c-9f9d-18c53ff7ea12 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:30.637148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13a51f-ec32-448c-9f9d-18c53ff7ea12 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:30.651279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:30.673183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da20e73-e019-447d-8239-817fc095786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:30.673802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da20e73-e019-447d-8239-817fc095786e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:30.674080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da20e73-e019-447d-8239-817fc095786e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:30.674351 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da20e73-e019-447d-8239-817fc095786e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:30.681252 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da20e73-e019-447d-8239-817fc095786e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:30.682702 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da20e73-e019-447d-8239-817fc095786e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2da20e73-e019-447d-8239-817fc095786e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:11:30.695038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:30.696148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:30.697535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:11:30.697535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:11:30.697535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:11:30.697535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:11:30.697535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:11:30.697535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:11:30.697535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:11:30.697535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 31 00:11:30.697535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 646/1285] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Aug 31 00:11:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:30.702421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bf754-5296-4bb3-aa09-6b9d72d63008 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:30.758165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:30.813635 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bf754-5296-4bb3-aa09-6b9d72d63008 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:30.848331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fac65-fd8e-4401-b6fb-723476d51ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:30.848942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fac65-fd8e-4401-b6fb-723476d51ece None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:30.849241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fac65-fd8e-4401-b6fb-723476d51ece None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:30.849449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fac65-fd8e-4401-b6fb-723476d51ece None admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:30.850166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fac65-fd8e-4401-b6fb-723476d51ece None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:30.850470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fac65-fd8e-4401-b6fb-723476d51ece None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:30.851954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fac65-fd8e-4401-b6fb-723476d51ece None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:30.863610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 640/1286] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Aug 31 00:11:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:30.870887 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da20e73-e019-447d-8239-817fc095786e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:30.983041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da20e73-e019-447d-8239-817fc095786e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:31.018935 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef724c4-5356-4352-b2d7-450b021c545c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:31.019533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef724c4-5356-4352-b2d7-450b021c545c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:31.019840 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef724c4-5356-4352-b2d7-450b021c545c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:31.020105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef724c4-5356-4352-b2d7-450b021c545c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:31.020981 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef724c4-5356-4352-b2d7-450b021c545c None admin] RBAC: Adding query filter params (role.id=1d8dcb6cdf6d435c8f82f63f95d79093, scope.project.id=0864c2a6b50f403db79930d0869f8e23, user.id=d01dd2631a81402d8a5bba7007c7fd61) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:31.021290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef724c4-5356-4352-b2d7-450b021c545c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:31.022706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef724c4-5356-4352-b2d7-450b021c545c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:31.028460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 647/1287] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Aug 31 00:11:30 2022] GET /identity/v3/role_assignments?user.id=d01dd2631a81402d8a5bba7007c7fd61&scope.project.id=0864c2a6b50f403db79930d0869f8e23&role.id=1d8dcb6cdf6d435c8f82f63f95d79093 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:32.960859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08836b7-6aa1-4f88-a0c3-2a2f9dfa91cc None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:32.961430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08836b7-6aa1-4f88-a0c3-2a2f9dfa91cc None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:32.961430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08836b7-6aa1-4f88-a0c3-2a2f9dfa91cc None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:32.962911 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 641/1288] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:32.969543 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bde94-83d1-42a7-9256-b9500f12dcb7 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:32.970265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bde94-83d1-42a7-9256-b9500f12dcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:32.970398 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bde94-83d1-42a7-9256-b9500f12dcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:32.995059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3c5bde94-83d1-42a7-9256-b9500f12dcb7 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:32.996344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3c5bde94-83d1-42a7-9256-b9500f12dcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:33.030744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:33.076924 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 648/1289] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:11:33.366921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08836b7-6aa1-4f88-a0c3-2a2f9dfa91cc None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:33.495812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08836b7-6aa1-4f88-a0c3-2a2f9dfa91cc None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:33.516633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:33.541860 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6ee60-3d9a-4896-8c9b-b4feaa13b442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:33.542492 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6ee60-3d9a-4896-8c9b-b4feaa13b442 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:33.542767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6ee60-3d9a-4896-8c9b-b4feaa13b442 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:33.543035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6ee60-3d9a-4896-8c9b-b4feaa13b442 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:33.543600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6ee60-3d9a-4896-8c9b-b4feaa13b442 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:33.545080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6ee60-3d9a-4896-8c9b-b4feaa13b442 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-1fd6ee60-3d9a-4896-8c9b-b4feaa13b442 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:33.554471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:33.555720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:33.557011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 642/1290] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 31 00:11:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:33.564498 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bde94-83d1-42a7-9256-b9500f12dcb7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:33.685420 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bde94-83d1-42a7-9256-b9500f12dcb7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:33.722653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0060bc8-1426-412a-8af2-72afab5f1c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:33.723297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0060bc8-1426-412a-8af2-72afab5f1c99 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:33.723647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0060bc8-1426-412a-8af2-72afab5f1c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:33.723994 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0060bc8-1426-412a-8af2-72afab5f1c99 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:33.724714 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0060bc8-1426-412a-8af2-72afab5f1c99 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:33.725097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0060bc8-1426-412a-8af2-72afab5f1c99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:33.726577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0060bc8-1426-412a-8af2-72afab5f1c99 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:33.732011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 649/1291] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Aug 31 00:11:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:33.738883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6ee60-3d9a-4896-8c9b-b4feaa13b442 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:33.843560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6ee60-3d9a-4896-8c9b-b4feaa13b442 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:33.878514 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7eac18-a5e4-4b28-8955-946543b21e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:33.879114 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eac18-a5e4-4b28-8955-946543b21e19 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:33.879392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eac18-a5e4-4b28-8955-946543b21e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:33.879663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eac18-a5e4-4b28-8955-946543b21e19 None admin] PATH_INFO: `/v3/services` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:33.880321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7eac18-a5e4-4b28-8955-946543b21e19 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:33.880624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7eac18-a5e4-4b28-8955-946543b21e19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:33.881983 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7eac18-a5e4-4b28-8955-946543b21e19 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:33.886592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 643/1292] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Aug 31 00:11:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:35.794817 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b9c3-e220-4554-ab00-601666fb3ed1 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:35.795754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b9c3-e220-4554-ab00-601666fb3ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:35.795754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b9c3-e220-4554-ab00-601666fb3ed1 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:35.797791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 650/1293] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:11:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:35.803425 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a01fa4-f886-4053-9b74-b3cc03c437ab None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:35.803908 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a01fa4-f886-4053-9b74-b3cc03c437ab None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:35.803998 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a01fa4-f886-4053-9b74-b3cc03c437ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:35.824135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e9a01fa4-f886-4053-9b74-b3cc03c437ab None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:35.825337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e9a01fa4-f886-4053-9b74-b3cc03c437ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:35.860213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:35.903554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 644/1294] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:11:36.169700 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68b9c3-e220-4554-ab00-601666fb3ed1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:36.207801 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:36.279844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68b9c3-e220-4554-ab00-601666fb3ed1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:36.315499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcad6ae-f30c-4a03-9e61-d06ab39d2dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:36.316121 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcad6ae-f30c-4a03-9e61-d06ab39d2dc0 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:36.316397 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcad6ae-f30c-4a03-9e61-d06ab39d2dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:36.316664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcad6ae-f30c-4a03-9e61-d06ab39d2dc0 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:36.317317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcad6ae-f30c-4a03-9e61-d06ab39d2dc0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:36.318864 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcad6ae-f30c-4a03-9e61-d06ab39d2dc0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:36.337807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 651/1295] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Aug 31 00:11:36 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:11:38.257203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f977-3ae7-4fad-8090-0d3907cae850 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:38.257978 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f977-3ae7-4fad-8090-0d3907cae850 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:38.258130 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f977-3ae7-4fad-8090-0d3907cae850 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:38.259944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 645/1296] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:11:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:38.267741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935909b2-40d4-469c-99de-e40833e8fd82 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:38.268155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935909b2-40d4-469c-99de-e40833e8fd82 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:38.268295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935909b2-40d4-469c-99de-e40833e8fd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:38.287979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-935909b2-40d4-469c-99de-e40833e8fd82 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:38.289173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-935909b2-40d4-469c-99de-e40833e8fd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:38.365434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 652/1297] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:38 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:11:38.632871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681f977-3ae7-4fad-8090-0d3907cae850 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:38.757832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681f977-3ae7-4fad-8090-0d3907cae850 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:38.792848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67eb07-fe7f-42dd-b070-579a3f76c3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:38.793478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67eb07-fe7f-42dd-b070-579a3f76c3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:38.793749 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67eb07-fe7f-42dd-b070-579a3f76c3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:38.794016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67eb07-fe7f-42dd-b070-579a3f76c3e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:38.794594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67eb07-fe7f-42dd-b070-579a3f76c3e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:38.796017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67eb07-fe7f-42dd-b070-579a3f76c3e1 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-bf67eb07-fe7f-42dd-b070-579a3f76c3e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:38.805048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:38.806327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:38.808159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 646/1298] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 31 00:11:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:38.815660 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935909b2-40d4-469c-99de-e40833e8fd82 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:38.834831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:38.933736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935909b2-40d4-469c-99de-e40833e8fd82 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:38.969948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a876d-8ab7-433f-b5d9-7dfb7a49f8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:38.970548 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a876d-8ab7-433f-b5d9-7dfb7a49f8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:38.970827 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a876d-8ab7-433f-b5d9-7dfb7a49f8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:38.971103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a876d-8ab7-433f-b5d9-7dfb7a49f8e1 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:38.971741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a876d-8ab7-433f-b5d9-7dfb7a49f8e1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:38.972080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a876d-8ab7-433f-b5d9-7dfb7a49f8e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:38.973476 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a876d-8ab7-433f-b5d9-7dfb7a49f8e1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:38.978746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 653/1299] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Aug 31 00:11:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:38.985281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67eb07-fe7f-42dd-b070-579a3f76c3e1 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:39.022441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:39.101489 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67eb07-fe7f-42dd-b070-579a3f76c3e1 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:39.136326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca8647-d3f2-41f8-aedb-7ffeb9ab5e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:39.136946 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca8647-d3f2-41f8-aedb-7ffeb9ab5e2b None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:39.137228 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca8647-d3f2-41f8-aedb-7ffeb9ab5e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:39.137498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca8647-d3f2-41f8-aedb-7ffeb9ab5e2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:39.138194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca8647-d3f2-41f8-aedb-7ffeb9ab5e2b None admin] RBAC: Adding query filter params (interface=public, service_id=dcf00665aace4482b536325dc1b2d743, region_id=RegionOne) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:39.138504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca8647-d3f2-41f8-aedb-7ffeb9ab5e2b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:39.139968 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca8647-d3f2-41f8-aedb-7ffeb9ab5e2b None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:39.145337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 647/1300] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Aug 31 00:11:38 2022] GET /identity/v3/endpoints?service_id=dcf00665aace4482b536325dc1b2d743&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:39.153647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a876d-8ab7-433f-b5d9-7dfb7a49f8e1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:39.241565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:39.261278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a876d-8ab7-433f-b5d9-7dfb7a49f8e1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:39.296471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fc794-3c07-4d79-9388-e24ba399ddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:39.297651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fc794-3c07-4d79-9388-e24ba399ddd2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:39.297651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fc794-3c07-4d79-9388-e24ba399ddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:39.297651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fc794-3c07-4d79-9388-e24ba399ddd2 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:39.298321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fc794-3c07-4d79-9388-e24ba399ddd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:39.299686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fc794-3c07-4d79-9388-e24ba399ddd2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:39.306601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 654/1301] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Aug 31 00:11:39 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:11:41.184124 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783763e-779b-4add-9125-9442086c05a2 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:41.184613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783763e-779b-4add-9125-9442086c05a2 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:41.184613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783763e-779b-4add-9125-9442086c05a2 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:41.186040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 648/1302] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:41.191730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f4846-040b-4ee3-9e81-be10d4ac2ae3 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:41.192169 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f4846-040b-4ee3-9e81-be10d4ac2ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:41.192270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f4846-040b-4ee3-9e81-be10d4ac2ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:41.212547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-816f4846-040b-4ee3-9e81-be10d4ac2ae3 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:41.213734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-816f4846-040b-4ee3-9e81-be10d4ac2ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:41.297982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 655/1303] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:41 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:11:41.565782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783763e-779b-4add-9125-9442086c05a2 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:41.677008 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:41.684564 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783763e-779b-4add-9125-9442086c05a2 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:41.724438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15402c2d-15de-4cc3-8edd-50a476f0e677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:41.725397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15402c2d-15de-4cc3-8edd-50a476f0e677 None admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:41.725541 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15402c2d-15de-4cc3-8edd-50a476f0e677 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:41.725750 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15402c2d-15de-4cc3-8edd-50a476f0e677 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:41.726392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15402c2d-15de-4cc3-8edd-50a476f0e677 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:41.727951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15402c2d-15de-4cc3-8edd-50a476f0e677 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application [None req-15402c2d-15de-4cc3-8edd-50a476f0e677 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:41.739276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:41.740688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: ERROR keystone.server.flask.application Aug 31 00:11:41.741785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 649/1304] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Aug 31 00:11:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:41.747102 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f4846-040b-4ee3-9e81-be10d4ac2ae3 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:41.830432 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:41.866706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f4846-040b-4ee3-9e81-be10d4ac2ae3 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:41.904183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0dfb81-d323-4e89-909d-2a3562e32f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:41.904808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dfb81-d323-4e89-909d-2a3562e32f0e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:41.905092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dfb81-d323-4e89-909d-2a3562e32f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:41.905371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dfb81-d323-4e89-909d-2a3562e32f0e None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:41.906018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0dfb81-d323-4e89-909d-2a3562e32f0e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:41.906328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0dfb81-d323-4e89-909d-2a3562e32f0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:41.907758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0dfb81-d323-4e89-909d-2a3562e32f0e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:41.913047 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 656/1305] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Aug 31 00:11:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:41.922777 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15402c2d-15de-4cc3-8edd-50a476f0e677 None admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:42.038954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15402c2d-15de-4cc3-8edd-50a476f0e677 None admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:42.073981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74326a3a-ee05-44e4-98df-ddffaa40ac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:42.074570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74326a3a-ee05-44e4-98df-ddffaa40ac31 None admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:42.074847 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74326a3a-ee05-44e4-98df-ddffaa40ac31 None admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:42.075114 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74326a3a-ee05-44e4-98df-ddffaa40ac31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:42.075799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74326a3a-ee05-44e4-98df-ddffaa40ac31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:42.077164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74326a3a-ee05-44e4-98df-ddffaa40ac31 None admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:42.101647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 650/1306] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:11:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:11:51.909872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=30 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:52.096849 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:46.677703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91740d9-6dbd-4778-89fd-9d8c3732e54a None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:46.678314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91740d9-6dbd-4778-89fd-9d8c3732e54a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:46.678394 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91740d9-6dbd-4778-89fd-9d8c3732e54a None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:46.684133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 657/1307] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:12:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:46.687129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46d13f-5482-4c3b-9a3e-9a8c32eb08be None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:46.688367 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46d13f-5482-4c3b-9a3e-9a8c32eb08be None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:46.689163 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46d13f-5482-4c3b-9a3e-9a8c32eb08be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:46.834088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-fb46d13f-5482-4c3b-9a3e-9a8c32eb08be None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:46.836293 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-fb46d13f-5482-4c3b-9a3e-9a8c32eb08be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:47.056362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 651/1308] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:47.370277 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1e67b-1f1b-4546-86ca-39db085a7c14 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:47.370558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1e67b-1f1b-4546-86ca-39db085a7c14 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:47.370832 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1e67b-1f1b-4546-86ca-39db085a7c14 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:47.372574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 658/1309] 10.222.0.50 () {54 vars in 965 bytes} [Wed Aug 31 00:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:47.379520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d65ce-ccbf-4e81-8aa5-f0dab30e5d92 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:47.379873 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d65ce-ccbf-4e81-8aa5-f0dab30e5d92 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:47.380170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d65ce-ccbf-4e81-8aa5-f0dab30e5d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:47.478847 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-365d65ce-ccbf-4e81-8aa5-f0dab30e5d92 None None] MFA Rules not processed for user `5bde943833bb43e78879748c49ce3332`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:47.480633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-365d65ce-ccbf-4e81-8aa5-f0dab30e5d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:47.504154 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:47.568767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 652/1310] 10.222.0.50 () {58 vars in 1062 bytes} [Wed Aug 31 00:12:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:12:47.577854 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1e67b-1f1b-4546-86ca-39db085a7c14 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:47.579747 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-27a1e67b-1f1b-4546-86ca-39db085a7c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:47.709360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1e67b-1f1b-4546-86ca-39db085a7c14 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:47.792789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28346cdb-ddb8-4462-9daf-006bf3f24214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:47.793415 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28346cdb-ddb8-4462-9daf-006bf3f24214 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:47.793761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28346cdb-ddb8-4462-9daf-006bf3f24214 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:47.794111 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28346cdb-ddb8-4462-9daf-006bf3f24214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:47.796165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-28346cdb-ddb8-4462-9daf-006bf3f24214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:47.858600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:47.922013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28346cdb-ddb8-4462-9daf-006bf3f24214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:47.923613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28346cdb-ddb8-4462-9daf-006bf3f24214 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:47.946899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 659/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:50.155770 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7ba9-a982-408b-bc27-c0e2e8b192fc None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:50.156362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7ba9-a982-408b-bc27-c0e2e8b192fc None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:50.156362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7ba9-a982-408b-bc27-c0e2e8b192fc None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:50.157709 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 653/1312] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:50.163950 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2406683-4585-4ef5-a909-8636c736a5f0 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:50.164801 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2406683-4585-4ef5-a909-8636c736a5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:50.165470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2406683-4585-4ef5-a909-8636c736a5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:50.248416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d2406683-4585-4ef5-a909-8636c736a5f0 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:50.249641 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d2406683-4585-4ef5-a909-8636c736a5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:50.353031 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 660/1313] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:50.654179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb3f7-ec71-4d72-9d84-36683e1493b1 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:50.654476 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb3f7-ec71-4d72-9d84-36683e1493b1 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:50.654751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb3f7-ec71-4d72-9d84-36683e1493b1 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:50.656292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 654/1314] 10.222.0.50 () {54 vars in 965 bytes} [Wed Aug 31 00:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:50.662488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41f298-048e-485f-9ad1-03bd4431d101 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:50.662773 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41f298-048e-485f-9ad1-03bd4431d101 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:50.663041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41f298-048e-485f-9ad1-03bd4431d101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:50.675204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:50.745172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ac41f298-048e-485f-9ad1-03bd4431d101 None None] MFA Rules not processed for user `5bde943833bb43e78879748c49ce3332`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:50.746417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ac41f298-048e-485f-9ad1-03bd4431d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:50.838794 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 661/1315] 10.222.0.50 () {58 vars in 1062 bytes} [Wed Aug 31 00:12:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:50.851940 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fb3f7-ec71-4d72-9d84-36683e1493b1 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:50.853598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-178fb3f7-ec71-4d72-9d84-36683e1493b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:50.968375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fb3f7-ec71-4d72-9d84-36683e1493b1 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:51.040676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:51.043175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcb945-2c9a-44d9-8cf9-7cc90e8650db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:51.043819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcb945-2c9a-44d9-8cf9-7cc90e8650db service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:51.044073 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcb945-2c9a-44d9-8cf9-7cc90e8650db service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:51.044409 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcb945-2c9a-44d9-8cf9-7cc90e8650db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:51.046605 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-8cfcb945-2c9a-44d9-8cf9-7cc90e8650db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:51.165721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcb945-2c9a-44d9-8cf9-7cc90e8650db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:51.167116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcb945-2c9a-44d9-8cf9-7cc90e8650db service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:51.187042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 655/1316] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:53.659307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2731c-8d1f-4de0-8725-82ca13c169fb None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:53.659897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2731c-8d1f-4de0-8725-82ca13c169fb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:53.659897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2731c-8d1f-4de0-8725-82ca13c169fb None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:53.661239 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 662/1317] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:53.667757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac2d6e-ea58-4d0e-a91e-3cdf24205865 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:53.668752 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac2d6e-ea58-4d0e-a91e-3cdf24205865 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:53.669224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac2d6e-ea58-4d0e-a91e-3cdf24205865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:53.744021 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-a7ac2d6e-ea58-4d0e-a91e-3cdf24205865 None None] MFA Rules not processed for user `09d7ab687f544d1faaad37cdef56ae55`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:53.745241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a7ac2d6e-ea58-4d0e-a91e-3cdf24205865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:53.801112 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:53.849706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 656/1318] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:54.136098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2731c-8d1f-4de0-8725-82ca13c169fb None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:54.138502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e2a2731c-8d1f-4de0-8725-82ca13c169fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:54.263362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2731c-8d1f-4de0-8725-82ca13c169fb None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:54.266480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:54.339985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ea9f0-35b8-4450-a866-898f090494a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:54.340594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ea9f0-35b8-4450-a866-898f090494a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:54.340870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ea9f0-35b8-4450-a866-898f090494a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:54.341140 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ea9f0-35b8-4450-a866-898f090494a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:54.342752 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-860ea9f0-35b8-4450-a866-898f090494a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:54.477233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ea9f0-35b8-4450-a866-898f090494a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:54.478602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ea9f0-35b8-4450-a866-898f090494a3 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:54.505623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 663/1319] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:57.136570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ffbb-d1d8-46e4-9f65-7a87d4277616 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:57.137198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ffbb-d1d8-46e4-9f65-7a87d4277616 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:57.137198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ffbb-d1d8-46e4-9f65-7a87d4277616 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:57.138477 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 657/1320] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:57.146979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bdd53-5f38-46cc-a439-45887f6823b1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:57.147436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bdd53-5f38-46cc-a439-45887f6823b1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:57.147533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bdd53-5f38-46cc-a439-45887f6823b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:57.191298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:57.232327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f47bdd53-5f38-46cc-a439-45887f6823b1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:57.234104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f47bdd53-5f38-46cc-a439-45887f6823b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:57.343346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 664/1321] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:57.626088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3ffbb-d1d8-46e4-9f65-7a87d4277616 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:57.628683 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-eba3ffbb-d1d8-46e4-9f65-7a87d4277616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:57.739604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3ffbb-d1d8-46e4-9f65-7a87d4277616 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:57.813865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272391d-0be0-4c00-84e8-f89504af77c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:57.814468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272391d-0be0-4c00-84e8-f89504af77c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:57.814739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272391d-0be0-4c00-84e8-f89504af77c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:57.815008 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272391d-0be0-4c00-84e8-f89504af77c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:57.816639 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a272391d-0be0-4c00-84e8-f89504af77c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:57.824433 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:57.941219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272391d-0be0-4c00-84e8-f89504af77c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:57.942576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272391d-0be0-4c00-84e8-f89504af77c1 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:57.961102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 658/1322] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:00.609587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2582e18-524f-4cff-88d4-74d5ee391b43 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:00.610221 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2582e18-524f-4cff-88d4-74d5ee391b43 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:00.610221 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2582e18-524f-4cff-88d4-74d5ee391b43 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:00.611520 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 665/1323] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:00.616904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15bd61-2da0-4ac3-88b7-dbf7e2b2f07a None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:00.617336 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15bd61-2da0-4ac3-88b7-dbf7e2b2f07a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:00.617440 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15bd61-2da0-4ac3-88b7-dbf7e2b2f07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:00.685006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-1f15bd61-2da0-4ac3-88b7-dbf7e2b2f07a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:00.686222 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-1f15bd61-2da0-4ac3-88b7-dbf7e2b2f07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:00.751076 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:00.793786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 659/1324] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:01.086816 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2582e18-524f-4cff-88d4-74d5ee391b43 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:01.088395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d2582e18-524f-4cff-88d4-74d5ee391b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:01.199971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2582e18-524f-4cff-88d4-74d5ee391b43 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:01.212122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:01.274463 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab54518-4372-4b86-a5a8-e3ac10eba59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:01.275102 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab54518-4372-4b86-a5a8-e3ac10eba59c service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:01.275383 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab54518-4372-4b86-a5a8-e3ac10eba59c service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:01.275653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab54518-4372-4b86-a5a8-e3ac10eba59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:01.277342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fab54518-4372-4b86-a5a8-e3ac10eba59c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:01.393337 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab54518-4372-4b86-a5a8-e3ac10eba59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:01.394799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab54518-4372-4b86-a5a8-e3ac10eba59c service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:01.414848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 666/1325] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:03.376194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3a5f3-bfdf-4bad-a5e4-3a0fca12ead3 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:03.376756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3a5f3-bfdf-4bad-a5e4-3a0fca12ead3 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:03.376756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3a5f3-bfdf-4bad-a5e4-3a0fca12ead3 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:03.378176 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 660/1326] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:03.384797 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda31c6-a9af-4a9b-b3dc-fe1f6f83861a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:03.385265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda31c6-a9af-4a9b-b3dc-fe1f6f83861a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:03.385389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda31c6-a9af-4a9b-b3dc-fe1f6f83861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:03.440445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:03.460103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-5dda31c6-a9af-4a9b-b3dc-fe1f6f83861a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:03.461342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5dda31c6-a9af-4a9b-b3dc-fe1f6f83861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:03.562475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 667/1327] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:03.839236 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3a5f3-bfdf-4bad-a5e4-3a0fca12ead3 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:03.840827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6dc3a5f3-bfdf-4bad-a5e4-3a0fca12ead3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:03.958958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3a5f3-bfdf-4bad-a5e4-3a0fca12ead3 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:04.040524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d981a0-9ec1-40ef-b1c7-025c6f3dc26e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:04.041144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d981a0-9ec1-40ef-b1c7-025c6f3dc26e service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:04.041416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d981a0-9ec1-40ef-b1c7-025c6f3dc26e service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:04.041682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d981a0-9ec1-40ef-b1c7-025c6f3dc26e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:04.043304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-00d981a0-9ec1-40ef-b1c7-025c6f3dc26e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:04.059984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:04.157427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d981a0-9ec1-40ef-b1c7-025c6f3dc26e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:04.159052 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d981a0-9ec1-40ef-b1c7-025c6f3dc26e service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:04.180622 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 661/1328] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:06.134574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83233eb9-6519-4e30-a195-4921516291bc None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:06.135135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83233eb9-6519-4e30-a195-4921516291bc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:06.135135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83233eb9-6519-4e30-a195-4921516291bc None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:06.136500 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 668/1329] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:06.141965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a14e65-955c-4578-873a-f1530b777db7 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:06.141965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a14e65-955c-4578-873a-f1530b777db7 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:06.142480 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a14e65-955c-4578-873a-f1530b777db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:06.214145 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-94a14e65-955c-4578-873a-f1530b777db7 None None] MFA Rules not processed for user `09d7ab687f544d1faaad37cdef56ae55`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:06.215373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-94a14e65-955c-4578-873a-f1530b777db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:06.290211 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:06.321073 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 662/1330] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:13:06.600245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83233eb9-6519-4e30-a195-4921516291bc None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:06.604354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-83233eb9-6519-4e30-a195-4921516291bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:06.719199 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83233eb9-6519-4e30-a195-4921516291bc None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:06.739789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:06.796090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7fe41-f39b-45ba-b572-61835c3d7b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:06.796701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7fe41-f39b-45ba-b572-61835c3d7b45 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:06.796982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7fe41-f39b-45ba-b572-61835c3d7b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:06.797249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7fe41-f39b-45ba-b572-61835c3d7b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:06.798844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-96f7fe41-f39b-45ba-b572-61835c3d7b45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:06.912448 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7fe41-f39b-45ba-b572-61835c3d7b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:06.913928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7fe41-f39b-45ba-b572-61835c3d7b45 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:06.932040 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 669/1331] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:06 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:09.069954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1650d-af32-46a7-854f-eaf4abc5a404 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:09.070570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1650d-af32-46a7-854f-eaf4abc5a404 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:09.070570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1650d-af32-46a7-854f-eaf4abc5a404 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:09.072699 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 663/1332] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:09.081481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3f089-b1f2-4389-887f-bd82fa12bebc None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:09.082191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3f089-b1f2-4389-887f-bd82fa12bebc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:09.082346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3f089-b1f2-4389-887f-bd82fa12bebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:09.157859 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:09.163642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-68f3f089-b1f2-4389-887f-bd82fa12bebc None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:09.163642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-68f3f089-b1f2-4389-887f-bd82fa12bebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:09.263157 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 670/1333] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:09.561542 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1650d-af32-46a7-854f-eaf4abc5a404 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:09.564452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-75b1650d-af32-46a7-854f-eaf4abc5a404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:09.684569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1650d-af32-46a7-854f-eaf4abc5a404 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:09.766688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f8fca-81a0-4383-a405-9dfad7864866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:09.767297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f8fca-81a0-4383-a405-9dfad7864866 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:09.767573 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f8fca-81a0-4383-a405-9dfad7864866 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:09.767876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f8fca-81a0-4383-a405-9dfad7864866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:09.769486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f80f8fca-81a0-4383-a405-9dfad7864866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:09.800180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:09.898446 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f8fca-81a0-4383-a405-9dfad7864866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:09.899941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f8fca-81a0-4383-a405-9dfad7864866 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:09.918292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 664/1334] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:11.879463 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3425ff-bd3b-4869-bb07-88ef60e8eb92 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:11.880079 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3425ff-bd3b-4869-bb07-88ef60e8eb92 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:11.880079 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3425ff-bd3b-4869-bb07-88ef60e8eb92 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:11.881824 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 671/1335] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:11.887485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5687710-a773-4de8-9338-a9459deef4e0 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:11.887990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5687710-a773-4de8-9338-a9459deef4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:11.888088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5687710-a773-4de8-9338-a9459deef4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:11.956817 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-a5687710-a773-4de8-9338-a9459deef4e0 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:11.958054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a5687710-a773-4de8-9338-a9459deef4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:12.044363 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:12.069661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 665/1336] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:13:12.351208 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3425ff-bd3b-4869-bb07-88ef60e8eb92 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:12.352813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ac3425ff-bd3b-4869-bb07-88ef60e8eb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:12.462716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3425ff-bd3b-4869-bb07-88ef60e8eb92 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:12.492055 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:12.543750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aa397-73fe-4e0f-99d0-2a38703bc40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:12.544377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa397-73fe-4e0f-99d0-2a38703bc40c service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:12.544661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa397-73fe-4e0f-99d0-2a38703bc40c service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:12.545000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa397-73fe-4e0f-99d0-2a38703bc40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:12.546585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-404aa397-73fe-4e0f-99d0-2a38703bc40c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:12.668032 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404aa397-73fe-4e0f-99d0-2a38703bc40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:12.669470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404aa397-73fe-4e0f-99d0-2a38703bc40c service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:12.689643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 672/1337] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:15.078798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6befb-8148-47e8-abc4-465018aad09e None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:15.079834 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6befb-8148-47e8-abc4-465018aad09e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:15.079834 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6befb-8148-47e8-abc4-465018aad09e None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:15.082421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 666/1338] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:15.088287 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f4d64-b40f-4cd1-a737-80c68a175368 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:15.088736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f4d64-b40f-4cd1-a737-80c68a175368 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:15.088829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f4d64-b40f-4cd1-a737-80c68a175368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:15.157600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-632f4d64-b40f-4cd1-a737-80c68a175368 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:15.158819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-632f4d64-b40f-4cd1-a737-80c68a175368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:15.167849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:15.264568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 673/1339] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:15.545778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6befb-8148-47e8-abc4-465018aad09e None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:15.547954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-90b6befb-8148-47e8-abc4-465018aad09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:15.674776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6befb-8148-47e8-abc4-465018aad09e None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:15.768288 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667e8e3-17db-4fca-9b34-b2645dbec02f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:15.768906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667e8e3-17db-4fca-9b34-b2645dbec02f service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:15.769185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667e8e3-17db-4fca-9b34-b2645dbec02f service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:15.769453 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667e8e3-17db-4fca-9b34-b2645dbec02f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:15.771070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3667e8e3-17db-4fca-9b34-b2645dbec02f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:15.809129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:15.896661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667e8e3-17db-4fca-9b34-b2645dbec02f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:15.898231 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667e8e3-17db-4fca-9b34-b2645dbec02f service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:15.918187 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 667/1340] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:19.988245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d684-c6f1-435e-ba40-621cf4d1521f None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:19.988668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d684-c6f1-435e-ba40-621cf4d1521f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:19.988773 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557d684-c6f1-435e-ba40-621cf4d1521f None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:19.990407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 674/1341] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:19.995827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf839f5-1312-4a85-980b-4cc6f40bfb5c None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:19.996244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf839f5-1312-4a85-980b-4cc6f40bfb5c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:19.996380 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf839f5-1312-4a85-980b-4cc6f40bfb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:20.064187 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5cf839f5-1312-4a85-980b-4cc6f40bfb5c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:20.065413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5cf839f5-1312-4a85-980b-4cc6f40bfb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:20.153101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:20.165768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 668/1342] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:20.445642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557d684-c6f1-435e-ba40-621cf4d1521f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:20.447228 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2557d684-c6f1-435e-ba40-621cf4d1521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:20.556056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557d684-c6f1-435e-ba40-621cf4d1521f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:20.596572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:20.634157 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d898bdd-75be-4732-bbb5-88d89d5bc00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:20.634769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d898bdd-75be-4732-bbb5-88d89d5bc00f service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:20.635047 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d898bdd-75be-4732-bbb5-88d89d5bc00f service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:20.635297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d898bdd-75be-4732-bbb5-88d89d5bc00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:20.636953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0d898bdd-75be-4732-bbb5-88d89d5bc00f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:20.752561 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d898bdd-75be-4732-bbb5-88d89d5bc00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:20.754047 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d898bdd-75be-4732-bbb5-88d89d5bc00f service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:20.773315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 675/1343] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:23.303689 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae4169-d406-4951-bf4d-07f5246c8a65 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:23.304153 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae4169-d406-4951-bf4d-07f5246c8a65 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:23.304270 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae4169-d406-4951-bf4d-07f5246c8a65 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:23.305697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 669/1344] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:23.311287 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e39d9-3a42-4c11-a360-b78fc0403e17 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:23.311788 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e39d9-3a42-4c11-a360-b78fc0403e17 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:23.312020 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e39d9-3a42-4c11-a360-b78fc0403e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:23.384293 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-057e39d9-3a42-4c11-a360-b78fc0403e17 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:23.385523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-057e39d9-3a42-4c11-a360-b78fc0403e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:23.405439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:23.488098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 676/1345] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:23.767289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae4169-d406-4951-bf4d-07f5246c8a65 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:23.768928 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d5ae4169-d406-4951-bf4d-07f5246c8a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:23.887834 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae4169-d406-4951-bf4d-07f5246c8a65 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:23.967951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db329685-226a-4541-b05e-118ad84976db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:23.968572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db329685-226a-4541-b05e-118ad84976db service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:23.968857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db329685-226a-4541-b05e-118ad84976db service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:23.969133 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db329685-226a-4541-b05e-118ad84976db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:23.970826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-db329685-226a-4541-b05e-118ad84976db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:24.018807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:24.088262 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db329685-226a-4541-b05e-118ad84976db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:24.089766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db329685-226a-4541-b05e-118ad84976db service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:24.108911 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 670/1346] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:28.075951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7a3e-cf72-4a75-9f12-fd3744d3d539 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:28.076504 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7a3e-cf72-4a75-9f12-fd3744d3d539 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:28.076504 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7a3e-cf72-4a75-9f12-fd3744d3d539 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:28.077873 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 677/1347] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:28.083630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc7994-40b9-4385-b4de-429692c83916 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:28.084198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc7994-40b9-4385-b4de-429692c83916 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:28.084352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc7994-40b9-4385-b4de-429692c83916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:28.164680 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-00dc7994-40b9-4385-b4de-429692c83916 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:28.166079 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-00dc7994-40b9-4385-b4de-429692c83916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:28.269133 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:28.272464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 671/1348] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:28.549886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac7a3e-cf72-4a75-9f12-fd3744d3d539 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:28.551735 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5dac7a3e-cf72-4a75-9f12-fd3744d3d539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:28.664453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac7a3e-cf72-4a75-9f12-fd3744d3d539 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:28.718074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:28.751059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164216f9-bd94-437c-aebf-185b11588919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:28.751676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164216f9-bd94-437c-aebf-185b11588919 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:28.752166 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164216f9-bd94-437c-aebf-185b11588919 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:28.752250 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164216f9-bd94-437c-aebf-185b11588919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:28.753899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-164216f9-bd94-437c-aebf-185b11588919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:28.865237 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164216f9-bd94-437c-aebf-185b11588919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:28.866780 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164216f9-bd94-437c-aebf-185b11588919 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:28.885059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 678/1349] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:33.819597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc9710-8ab4-4c70-8a23-cb0a22d829fd None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:33.819597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc9710-8ab4-4c70-8a23-cb0a22d829fd None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:33.819597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc9710-8ab4-4c70-8a23-cb0a22d829fd None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:33.821132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 672/1350] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 31 00:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:33.827113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516640d-dbcc-4425-84b9-679dfcd9caea None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:33.827587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516640d-dbcc-4425-84b9-679dfcd9caea None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:33.827708 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516640d-dbcc-4425-84b9-679dfcd9caea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:33.941259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3516640d-dbcc-4425-84b9-679dfcd9caea None None] MFA Rules not processed for user `d01dd2631a81402d8a5bba7007c7fd61`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:33.941607 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3516640d-dbcc-4425-84b9-679dfcd9caea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:33.960962 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:34.093561 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 679/1351] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 31 00:13:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:38.368753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d24cfe-8605-4731-9853-aa80c2344aa1 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:38.369311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d24cfe-8605-4731-9853-aa80c2344aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:38.369311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d24cfe-8605-4731-9853-aa80c2344aa1 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:38.370918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 673/1352] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 31 00:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:38.375814 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db21f-261c-404c-a683-38fff5b37674 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:38.376272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db21f-261c-404c-a683-38fff5b37674 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:38.376605 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db21f-261c-404c-a683-38fff5b37674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:38.459605 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ad2db21f-261c-404c-a683-38fff5b37674 None None] MFA Rules not processed for user `d01dd2631a81402d8a5bba7007c7fd61`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:38.460942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ad2db21f-261c-404c-a683-38fff5b37674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:38.537271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:38.582464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 680/1353] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 31 00:13:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:39.787246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa395b-5321-4c8e-9261-eea3c5aa0160 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:39.787844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa395b-5321-4c8e-9261-eea3c5aa0160 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:39.788475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa395b-5321-4c8e-9261-eea3c5aa0160 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:39.790025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 674/1354] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 31 00:13:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:39.795576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d137e-4b51-4373-9f07-d4b8f511b67a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:39.796052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d137e-4b51-4373-9f07-d4b8f511b67a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:39.796178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d137e-4b51-4373-9f07-d4b8f511b67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:39.876395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-406d137e-4b51-4373-9f07-d4b8f511b67a None None] MFA Rules not processed for user `d01dd2631a81402d8a5bba7007c7fd61`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:39.877606 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-406d137e-4b51-4373-9f07-d4b8f511b67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:39.984599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 681/1355] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 31 00:13:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:43.440697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8e696-ea2a-4ad3-8bc5-b6000cc856ef None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:43.441248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8e696-ea2a-4ad3-8bc5-b6000cc856ef None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:43.441248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8e696-ea2a-4ad3-8bc5-b6000cc856ef None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:43.442560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 675/1356] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:43.448296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e682cce-373d-4de6-98a7-7d7d6f98ba62 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:43.448765 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e682cce-373d-4de6-98a7-7d7d6f98ba62 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:43.448856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e682cce-373d-4de6-98a7-7d7d6f98ba62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:43.491375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:43.542457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3e682cce-373d-4de6-98a7-7d7d6f98ba62 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:43.543669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3e682cce-373d-4de6-98a7-7d7d6f98ba62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:43.663665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 682/1357] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:43.961419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e08fa-6fdc-4261-80eb-3ace839a1bae None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:43.962023 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e08fa-6fdc-4261-80eb-3ace839a1bae None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:43.962519 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e08fa-6fdc-4261-80eb-3ace839a1bae None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:43.964616 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 676/1358] 10.222.0.50 () {54 vars in 962 bytes} [Wed Aug 31 00:13:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:43.973466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089106-0a41-4d91-959d-abf666fa3742 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:43.974062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089106-0a41-4d91-959d-abf666fa3742 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:43.974611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089106-0a41-4d91-959d-abf666fa3742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:44.066223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-22089106-0a41-4d91-959d-abf666fa3742 None None] MFA Rules not processed for user `cb9ef38ec3b448828826de5f76a552d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:44.067871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-22089106-0a41-4d91-959d-abf666fa3742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:44.121609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:44.218942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 683/1359] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Aug 31 00:13:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:44.226867 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e08fa-6fdc-4261-80eb-3ace839a1bae None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:44.228646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-793e08fa-6fdc-4261-80eb-3ace839a1bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:44.387035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e08fa-6fdc-4261-80eb-3ace839a1bae None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:44.462516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:44.504357 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c258bc-1afc-4a87-86d4-6df16d45ea2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:44.505081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c258bc-1afc-4a87-86d4-6df16d45ea2d service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:44.505355 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c258bc-1afc-4a87-86d4-6df16d45ea2d service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:44.505619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c258bc-1afc-4a87-86d4-6df16d45ea2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:44.507874 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b7c258bc-1afc-4a87-86d4-6df16d45ea2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:44.599840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c258bc-1afc-4a87-86d4-6df16d45ea2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:44.601745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c258bc-1afc-4a87-86d4-6df16d45ea2d service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:44.621607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 677/1360] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:13:46.748199 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef0ba8-0e6f-4954-bc8f-6bf4497559f3 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:46.748785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef0ba8-0e6f-4954-bc8f-6bf4497559f3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:46.748785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef0ba8-0e6f-4954-bc8f-6bf4497559f3 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:46.750319 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 684/1361] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:46.755983 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c50a81-b37c-43a6-a09d-658591a7707f None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:46.756543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c50a81-b37c-43a6-a09d-658591a7707f None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:46.756543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c50a81-b37c-43a6-a09d-658591a7707f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:46.829312 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-04c50a81-b37c-43a6-a09d-658591a7707f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:46.829312 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-04c50a81-b37c-43a6-a09d-658591a7707f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:46.866201 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:46.949105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 678/1362] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:47.240170 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef0ba8-0e6f-4954-bc8f-6bf4497559f3 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:47.244995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-06ef0ba8-0e6f-4954-bc8f-6bf4497559f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:47.408170 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef0ba8-0e6f-4954-bc8f-6bf4497559f3 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:47.418341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:47.529195 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802db60a-ff80-4fab-b0ed-e30ffd9822f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:47.529811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802db60a-ff80-4fab-b0ed-e30ffd9822f3 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:47.530091 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802db60a-ff80-4fab-b0ed-e30ffd9822f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:47.530345 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802db60a-ff80-4fab-b0ed-e30ffd9822f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:47.532039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-802db60a-ff80-4fab-b0ed-e30ffd9822f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:47.632171 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802db60a-ff80-4fab-b0ed-e30ffd9822f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:47.634026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802db60a-ff80-4fab-b0ed-e30ffd9822f3 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:47.654564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 685/1363] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:49.906611 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd079bd-6033-4d76-a4eb-0a33d4a93507 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:49.907139 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd079bd-6033-4d76-a4eb-0a33d4a93507 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:49.907139 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd079bd-6033-4d76-a4eb-0a33d4a93507 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:49.908560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 679/1364] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:49.914224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80be5d1-dd07-4c85-94ec-ecfe7c3627d5 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:49.914658 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80be5d1-dd07-4c85-94ec-ecfe7c3627d5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:49.915024 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80be5d1-dd07-4c85-94ec-ecfe7c3627d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:49.932243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:49.989826 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a80be5d1-dd07-4c85-94ec-ecfe7c3627d5 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:49.991471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a80be5d1-dd07-4c85-94ec-ecfe7c3627d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:50.115651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 686/1365] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:50.397962 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba815829-caa1-45db-b620-43078db5419b None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:50.398268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba815829-caa1-45db-b620-43078db5419b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:50.398734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba815829-caa1-45db-b620-43078db5419b None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:50.400270 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 680/1366] 10.222.0.50 () {54 vars in 962 bytes} [Wed Aug 31 00:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:13:50.406099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c8e77-1352-4898-8a7a-244e0d1d767d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:50.406459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c8e77-1352-4898-8a7a-244e0d1d767d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:50.406853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c8e77-1352-4898-8a7a-244e0d1d767d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:50.490335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-231c8e77-1352-4898-8a7a-244e0d1d767d None None] MFA Rules not processed for user `cb9ef38ec3b448828826de5f76a552d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:50.491457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-231c8e77-1352-4898-8a7a-244e0d1d767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:50.529636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:50.624682 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 687/1367] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Aug 31 00:13:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:50.633103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba815829-caa1-45db-b620-43078db5419b None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:50.634624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ba815829-caa1-45db-b620-43078db5419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:50.793876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba815829-caa1-45db-b620-43078db5419b None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:50.816714 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:50.920407 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b78e3-d904-4f16-83d6-020f3a943716 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:50.921118 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b78e3-d904-4f16-83d6-020f3a943716 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:50.921272 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b78e3-d904-4f16-83d6-020f3a943716 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:50.921554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b78e3-d904-4f16-83d6-020f3a943716 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:50.923181 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7d7b78e3-d904-4f16-83d6-020f3a943716 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:51.013799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b78e3-d904-4f16-83d6-020f3a943716 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:51.015414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b78e3-d904-4f16-83d6-020f3a943716 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:51.034380 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 681/1368] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:51.671876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284a4b6-7dd7-4ab3-925f-9ef84d895311 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:51.672493 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284a4b6-7dd7-4ab3-925f-9ef84d895311 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:51.672493 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284a4b6-7dd7-4ab3-925f-9ef84d895311 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:51.673989 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 688/1369] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:51.679286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843e5a0-11d5-4306-9575-4d39853e4b72 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:51.679715 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843e5a0-11d5-4306-9575-4d39853e4b72 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:51.680110 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843e5a0-11d5-4306-9575-4d39853e4b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:51.717884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:51.758697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-3843e5a0-11d5-4306-9575-4d39853e4b72 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:51.760138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3843e5a0-11d5-4306-9575-4d39853e4b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:51.865780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 682/1370] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:52.465142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2afb7a-907e-4fb8-97f3-f157bb428f0a None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:52.465557 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2afb7a-907e-4fb8-97f3-f157bb428f0a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:52.465934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2afb7a-907e-4fb8-97f3-f157bb428f0a None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:52.467529 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 689/1371] 10.222.0.50 () {54 vars in 964 bytes} [Wed Aug 31 00:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:52.472672 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22be2a1-10c9-492f-873a-4f896d9ce1b6 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:52.473140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22be2a1-10c9-492f-873a-4f896d9ce1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:52.473411 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22be2a1-10c9-492f-873a-4f896d9ce1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:52.552686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e22be2a1-10c9-492f-873a-4f896d9ce1b6 None None] MFA Rules not processed for user `fbc36c937503477e8542cbef7c5f5db8`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:52.554064 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e22be2a1-10c9-492f-873a-4f896d9ce1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:52.603091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:52.635578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 683/1372] 10.222.0.50 () {58 vars in 1061 bytes} [Wed Aug 31 00:13:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:52.643265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2afb7a-907e-4fb8-97f3-f157bb428f0a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:52.644809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7f2afb7a-907e-4fb8-97f3-f157bb428f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:52.762959 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2afb7a-907e-4fb8-97f3-f157bb428f0a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:52.810074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:52.856735 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16beff4b-d53c-45ae-9637-bd980f38a6e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:52.857551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beff4b-d53c-45ae-9637-bd980f38a6e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:52.857965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beff4b-d53c-45ae-9637-bd980f38a6e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:52.858367 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beff4b-d53c-45ae-9637-bd980f38a6e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:52.860832 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-16beff4b-d53c-45ae-9637-bd980f38a6e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:53.017006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16beff4b-d53c-45ae-9637-bd980f38a6e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:53.018387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16beff4b-d53c-45ae-9637-bd980f38a6e9 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:53.023907 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9c20c-f451-4728-b019-339f1d74c62c None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:53.025261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9c20c-f451-4728-b019-339f1d74c62c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:53.025261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9c20c-f451-4728-b019-339f1d74c62c None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:53.028318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 684/1373] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:53.031059 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b1a01-b1ba-4572-8019-39805fe804cd None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:53.031351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b1a01-b1ba-4572-8019-39805fe804cd None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:53.031624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b1a01-b1ba-4572-8019-39805fe804cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:53.046877 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 690/1374] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:53.107054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-992b1a01-b1ba-4572-8019-39805fe804cd None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:53.108605 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-992b1a01-b1ba-4572-8019-39805fe804cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:53.220824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 685/1375] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:13:53.506973 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16beff4b-d53c-45ae-9637-bd980f38a6e9 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:53.508284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-16beff4b-d53c-45ae-9637-bd980f38a6e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:53.579255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:53.612861 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16beff4b-d53c-45ae-9637-bd980f38a6e9 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:53.731311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6ff0f-f337-441e-b5b0-252b48a5b0dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:53.731953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6ff0f-f337-441e-b5b0-252b48a5b0dd service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:53.732230 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6ff0f-f337-441e-b5b0-252b48a5b0dd service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:53.732496 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6ff0f-f337-441e-b5b0-252b48a5b0dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:53.734278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b0a6ff0f-f337-441e-b5b0-252b48a5b0dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:53.818139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:53.830320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6ff0f-f337-441e-b5b0-252b48a5b0dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:53.831972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6ff0f-f337-441e-b5b0-252b48a5b0dd service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:53.850824 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 691/1376] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:55.777407 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6bf4d-c1cf-4349-81d3-e28746e6123a None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:55.777949 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6bf4d-c1cf-4349-81d3-e28746e6123a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:55.777949 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6bf4d-c1cf-4349-81d3-e28746e6123a None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:55.779211 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 686/1377] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:55.784609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca8c88-b2ed-4d97-a8af-96b59ee2fe01 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:55.785026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca8c88-b2ed-4d97-a8af-96b59ee2fe01 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:55.785164 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca8c88-b2ed-4d97-a8af-96b59ee2fe01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:55.853109 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-75ca8c88-b2ed-4d97-a8af-96b59ee2fe01 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:55.854356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-75ca8c88-b2ed-4d97-a8af-96b59ee2fe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:55.959103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 692/1378] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:56.257040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6bf4d-c1cf-4349-81d3-e28746e6123a None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:56.258883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-78d6bf4d-c1cf-4349-81d3-e28746e6123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:56.315586 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:56.417113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6bf4d-c1cf-4349-81d3-e28746e6123a None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:56.580987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a681f-f2e9-4bf9-b549-7462072ed39b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:56.581534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a681f-f2e9-4bf9-b549-7462072ed39b service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:56.581811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a681f-f2e9-4bf9-b549-7462072ed39b service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:56.582081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a681f-f2e9-4bf9-b549-7462072ed39b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:56.584975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a10a681f-f2e9-4bf9-b549-7462072ed39b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:56.601725 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:56.702626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a681f-f2e9-4bf9-b549-7462072ed39b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:56.704179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a681f-f2e9-4bf9-b549-7462072ed39b service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:56.722733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 687/1379] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:58.662497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bb74b-b370-458c-9604-2ebc61518d06 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:58.663058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bb74b-b370-458c-9604-2ebc61518d06 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:58.663296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bb74b-b370-458c-9604-2ebc61518d06 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:58.664932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 693/1380] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:58.670633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692d07a-24a8-402c-9e25-909a2c943a1e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:58.671135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692d07a-24a8-402c-9e25-909a2c943a1e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:58.671135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692d07a-24a8-402c-9e25-909a2c943a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:58.741424 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e692d07a-24a8-402c-9e25-909a2c943a1e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:58.742788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e692d07a-24a8-402c-9e25-909a2c943a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:58.829720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:58.844119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 688/1381] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:13:59.131235 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bb74b-b370-458c-9604-2ebc61518d06 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:59.133044 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-339bb74b-b370-458c-9604-2ebc61518d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:59.203518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:59.291494 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bb74b-b370-458c-9604-2ebc61518d06 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:59.425743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ee596-7e2a-4ae1-a1f1-a127b79aa977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:59.426249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee596-7e2a-4ae1-a1f1-a127b79aa977 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:59.426537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee596-7e2a-4ae1-a1f1-a127b79aa977 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:59.426800 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee596-7e2a-4ae1-a1f1-a127b79aa977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:59.428393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-041ee596-7e2a-4ae1-a1f1-a127b79aa977 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:59.452770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:59.527251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ee596-7e2a-4ae1-a1f1-a127b79aa977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:59.529019 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ee596-7e2a-4ae1-a1f1-a127b79aa977 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:59.549072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 694/1382] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:01.544762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82558d6c-2d7e-4043-88dc-ec2e3e179b2e None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:01.545302 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82558d6c-2d7e-4043-88dc-ec2e3e179b2e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:01.545638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82558d6c-2d7e-4043-88dc-ec2e3e179b2e None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:01.547508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 689/1383] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:01.553904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e96b46-32fc-4827-90d1-f8ad4cd16104 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:01.554383 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e96b46-32fc-4827-90d1-f8ad4cd16104 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:01.554550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e96b46-32fc-4827-90d1-f8ad4cd16104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:01.623012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-49e96b46-32fc-4827-90d1-f8ad4cd16104 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:01.624268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-49e96b46-32fc-4827-90d1-f8ad4cd16104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:01.728095 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:01.734900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 695/1384] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:02.055770 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82558d6c-2d7e-4043-88dc-ec2e3e179b2e None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:02.057406 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-82558d6c-2d7e-4043-88dc-ec2e3e179b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:02.221348 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82558d6c-2d7e-4043-88dc-ec2e3e179b2e None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:02.291357 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:02.369923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f529d5-54d7-411a-b979-c067488034cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:02.370690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f529d5-54d7-411a-b979-c067488034cb service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:02.371099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f529d5-54d7-411a-b979-c067488034cb service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:02.371467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f529d5-54d7-411a-b979-c067488034cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:02.374397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e5f529d5-54d7-411a-b979-c067488034cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:02.481448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f529d5-54d7-411a-b979-c067488034cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:02.483449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f529d5-54d7-411a-b979-c067488034cb service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:02.504945 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 690/1385] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:04.587768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984cfe5-0022-4911-8857-f559888e4f3f None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:04.588724 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984cfe5-0022-4911-8857-f559888e4f3f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:04.588724 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984cfe5-0022-4911-8857-f559888e4f3f None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:04.590911 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 696/1386] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:14:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:04.599054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa041f-2f28-44e1-929f-21aa3c1492c2 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:04.599607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa041f-2f28-44e1-929f-21aa3c1492c2 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:04.599977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa041f-2f28-44e1-929f-21aa3c1492c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:04.702576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e9fa041f-2f28-44e1-929f-21aa3c1492c2 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:04.704656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e9fa041f-2f28-44e1-929f-21aa3c1492c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:04.746653 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:04.830238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 691/1387] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:05.122937 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984cfe5-0022-4911-8857-f559888e4f3f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:05.125083 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f984cfe5-0022-4911-8857-f559888e4f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:05.283418 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984cfe5-0022-4911-8857-f559888e4f3f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:05.362297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:05.412282 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ec0b6-add6-4286-9026-06600802ce9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:05.412905 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ec0b6-add6-4286-9026-06600802ce9a service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:05.413232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ec0b6-add6-4286-9026-06600802ce9a service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:05.413516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ec0b6-add6-4286-9026-06600802ce9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:05.415096 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-087ec0b6-add6-4286-9026-06600802ce9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:05.509326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ec0b6-add6-4286-9026-06600802ce9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:05.511058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ec0b6-add6-4286-9026-06600802ce9a service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:05.529983 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 697/1388] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:07.472155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f4575-275e-4318-9435-d78da88b264d None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:07.472747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f4575-275e-4318-9435-d78da88b264d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:07.472747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f4575-275e-4318-9435-d78da88b264d None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:07.474027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 692/1389] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:07.479602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd395-58e9-4e4a-aaa8-3afcfdffe9b4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:07.480107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd395-58e9-4e4a-aaa8-3afcfdffe9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:07.480220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd395-58e9-4e4a-aaa8-3afcfdffe9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:07.550425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d15cd395-58e9-4e4a-aaa8-3afcfdffe9b4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:07.551723 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d15cd395-58e9-4e4a-aaa8-3afcfdffe9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:07.588234 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:07.652194 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 698/1390] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:14:07.943865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f4575-275e-4318-9435-d78da88b264d None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:07.945716 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-949f4575-275e-4318-9435-d78da88b264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:08.016095 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac22003-c4c0-41d1-ad0f-3955ef5f62cd None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:08.016650 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac22003-c4c0-41d1-ad0f-3955ef5f62cd None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:08.016982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac22003-c4c0-41d1-ad0f-3955ef5f62cd None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:08.019116 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 699/1391] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:14:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:08.024388 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ff3c7-2af1-44f6-ba8b-a8a502a7304f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:08.024738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ff3c7-2af1-44f6-ba8b-a8a502a7304f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:08.025146 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ff3c7-2af1-44f6-ba8b-a8a502a7304f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:08.098278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-af0ff3c7-2af1-44f6-ba8b-a8a502a7304f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:08.099486 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-af0ff3c7-2af1-44f6-ba8b-a8a502a7304f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:08.106909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f4575-275e-4318-9435-d78da88b264d None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:08.116199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:08.202267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 700/1392] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:08.230559 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd9b13-ae81-4290-b035-d5ece3c62b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:08.231161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd9b13-ae81-4290-b035-d5ece3c62b96 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:08.231436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd9b13-ae81-4290-b035-d5ece3c62b96 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:08.231723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd9b13-ae81-4290-b035-d5ece3c62b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:08.233410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-75dd9b13-ae81-4290-b035-d5ece3c62b96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:08.329268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd9b13-ae81-4290-b035-d5ece3c62b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:08.331088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd9b13-ae81-4290-b035-d5ece3c62b96 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:08.349623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 693/1393] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:08.515580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29bc87-b7aa-4f01-948c-56a0464271df None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:08.516192 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29bc87-b7aa-4f01-948c-56a0464271df None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:08.516192 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29bc87-b7aa-4f01-948c-56a0464271df None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:08.517747 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 701/1394] 10.222.0.50 () {54 vars in 967 bytes} [Wed Aug 31 00:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:08.523510 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcb24c-09c3-4fbd-8be8-2ac75c7589b7 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:08.524240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcb24c-09c3-4fbd-8be8-2ac75c7589b7 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:08.524619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcb24c-09c3-4fbd-8be8-2ac75c7589b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:08.543238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:08.618173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-87fcb24c-09c3-4fbd-8be8-2ac75c7589b7 None None] MFA Rules not processed for user `f886be277ef84ec28a290380980c6f06`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:08.619442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-87fcb24c-09c3-4fbd-8be8-2ac75c7589b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:08.700239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 694/1395] 10.222.0.50 () {58 vars in 1064 bytes} [Wed Aug 31 00:14:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:08.707965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29bc87-b7aa-4f01-948c-56a0464271df None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:08.709560 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3d29bc87-b7aa-4f01-948c-56a0464271df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:08.730074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:08.827192 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29bc87-b7aa-4f01-948c-56a0464271df None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:08.904020 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d277ec-f83a-4485-b3b3-fa92d2029ac5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f886be277ef84ec28a290380980c6f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:08.904651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d277ec-f83a-4485-b3b3-fa92d2029ac5 service glance] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:08.904931 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d277ec-f83a-4485-b3b3-fa92d2029ac5 service glance] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:08.905189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d277ec-f83a-4485-b3b3-fa92d2029ac5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:08.906764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b4d277ec-f83a-4485-b3b3-fa92d2029ac5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:08.979473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:09.021348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d277ec-f83a-4485-b3b3-fa92d2029ac5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:09.022908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d277ec-f83a-4485-b3b3-fa92d2029ac5 service glance] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:09.041415 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 702/1396] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:14:09.789829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aee91-b567-4a07-b91b-ca49b79c4a06 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:09.790358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aee91-b567-4a07-b91b-ca49b79c4a06 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:09.790461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aee91-b567-4a07-b91b-ca49b79c4a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:09.860652 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5d0aee91-b567-4a07-b91b-ca49b79c4a06 None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:09.861854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5d0aee91-b567-4a07-b91b-ca49b79c4a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:09.921347 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:09.954602 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 695/1397] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:14:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:09.998072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813eb63-b5c2-412e-9b1f-554cc0d3e59a None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:09.998619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813eb63-b5c2-412e-9b1f-554cc0d3e59a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:09.998619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813eb63-b5c2-412e-9b1f-554cc0d3e59a None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:10.003082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 703/1398] 10.222.0.50 () {54 vars in 943 bytes} [Wed Aug 31 00:14:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:10.008953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f89307-170b-48e3-9333-2f9a07376b95 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:10.009276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f89307-170b-48e3-9333-2f9a07376b95 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:10.009584 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f89307-170b-48e3-9333-2f9a07376b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:10.088389 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-a0f89307-170b-48e3-9333-2f9a07376b95 None None] MFA Rules not processed for user `ac02a26fe2a44b7db623003d1a96ed36`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:10.089616 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a0f89307-170b-48e3-9333-2f9a07376b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:10.201229 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 696/1399] 10.222.0.50 () {58 vars in 1040 bytes} [Wed Aug 31 00:14:10 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:10.211365 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813eb63-b5c2-412e-9b1f-554cc0d3e59a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:10.213107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a813eb63-b5c2-412e-9b1f-554cc0d3e59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:10.298050 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371b4b-652d-4c80-afef-2c39782b20bc None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:10.298327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371b4b-652d-4c80-afef-2c39782b20bc None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:10.298589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371b4b-652d-4c80-afef-2c39782b20bc None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:10.300025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 697/1400] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:10.304813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba00e5-5e72-4e2d-a75c-994e490d92a1 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:10.305202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba00e5-5e72-4e2d-a75c-994e490d92a1 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:10.305580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba00e5-5e72-4e2d-a75c-994e490d92a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:10.348279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:10.359012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813eb63-b5c2-412e-9b1f-554cc0d3e59a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:10.382841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-b3ba00e5-5e72-4e2d-a75c-994e490d92a1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:10.384154 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b3ba00e5-5e72-4e2d-a75c-994e490d92a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:10.399122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:10.464052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17ed2-1677-4413-a4cd-b7e60600917c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:10.464576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17ed2-1677-4413-a4cd-b7e60600917c service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:10.464852 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17ed2-1677-4413-a4cd-b7e60600917c service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:10.465122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17ed2-1677-4413-a4cd-b7e60600917c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:10.466768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-24a17ed2-1677-4413-a4cd-b7e60600917c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:10.482207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 698/1401] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:10.549571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a17ed2-1677-4413-a4cd-b7e60600917c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:10.551174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a17ed2-1677-4413-a4cd-b7e60600917c service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:10.560471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 704/1402] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:14:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:14:10.772407 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba00e5-5e72-4e2d-a75c-994e490d92a1 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:10.773857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b3ba00e5-5e72-4e2d-a75c-994e490d92a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:10.910013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:10.919875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba00e5-5e72-4e2d-a75c-994e490d92a1 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:11.054844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023f573-3132-4b0e-b3a7-8b26f11bb15a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:11.055432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023f573-3132-4b0e-b3a7-8b26f11bb15a service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:11.055787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023f573-3132-4b0e-b3a7-8b26f11bb15a service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:11.056069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023f573-3132-4b0e-b3a7-8b26f11bb15a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:11.060646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d023f573-3132-4b0e-b3a7-8b26f11bb15a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:11.157671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023f573-3132-4b0e-b3a7-8b26f11bb15a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:11.159313 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023f573-3132-4b0e-b3a7-8b26f11bb15a service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:11.181787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 699/1403] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:13.177916 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa56ae8-249a-472a-be56-eca7ed14050f None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:13.178481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa56ae8-249a-472a-be56-eca7ed14050f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:13.178481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa56ae8-249a-472a-be56-eca7ed14050f None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:13.179902 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 705/1404] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:13.185202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2afb7-6000-43cf-ad0e-7fda88286508 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:13.185634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2afb7-6000-43cf-ad0e-7fda88286508 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:13.185791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2afb7-6000-43cf-ad0e-7fda88286508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:13.190859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:13.259633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-c3d2afb7-6000-43cf-ad0e-7fda88286508 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:13.260894 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c3d2afb7-6000-43cf-ad0e-7fda88286508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:13.363746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 700/1405] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:13.651338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa56ae8-249a-472a-be56-eca7ed14050f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:13.653231 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4fa56ae8-249a-472a-be56-eca7ed14050f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:13.744149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:13.833732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa56ae8-249a-472a-be56-eca7ed14050f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:13.963460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef9973-af37-4db0-a11e-76dd3eb33b78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:13.964215 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef9973-af37-4db0-a11e-76dd3eb33b78 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:13.964576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef9973-af37-4db0-a11e-76dd3eb33b78 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:13.964917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef9973-af37-4db0-a11e-76dd3eb33b78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:13.966645 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d6ef9973-af37-4db0-a11e-76dd3eb33b78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:14.001942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:14.071659 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef9973-af37-4db0-a11e-76dd3eb33b78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:14.073460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef9973-af37-4db0-a11e-76dd3eb33b78 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:14.093467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 706/1406] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:16.056017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413708c8-f9a4-441d-b493-cda4477bd253 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:16.058298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413708c8-f9a4-441d-b493-cda4477bd253 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:16.058298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413708c8-f9a4-441d-b493-cda4477bd253 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:16.063533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c64e92-3284-4b58-b6bc-7b76cb2f644e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:16.064105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c64e92-3284-4b58-b6bc-7b76cb2f644e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:16.064105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c64e92-3284-4b58-b6bc-7b76cb2f644e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:16.070551 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 701/1407] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:14:16 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:16.200024 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-12c64e92-3284-4b58-b6bc-7b76cb2f644e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:16.200525 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-12c64e92-3284-4b58-b6bc-7b76cb2f644e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:16.313331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 707/1408] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:14:16.611768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413708c8-f9a4-441d-b493-cda4477bd253 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:16.613314 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-413708c8-f9a4-441d-b493-cda4477bd253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:16.699487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:16.785588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413708c8-f9a4-441d-b493-cda4477bd253 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:16.970448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73ee63-24fb-4f17-9d23-f3ddab2b506c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:16.971068 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73ee63-24fb-4f17-9d23-f3ddab2b506c service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:16.971421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73ee63-24fb-4f17-9d23-f3ddab2b506c service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:16.971691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73ee63-24fb-4f17-9d23-f3ddab2b506c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:16.973322 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-0a73ee63-24fb-4f17-9d23-f3ddab2b506c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:17.022936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:17.076237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73ee63-24fb-4f17-9d23-f3ddab2b506c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:17.077863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73ee63-24fb-4f17-9d23-f3ddab2b506c service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:17.096720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 702/1409] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:26.310889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:27.094174 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=26 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:32.342690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff70d4-2015-4603-9efa-5b13c9db09a4 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:32.343311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff70d4-2015-4603-9efa-5b13c9db09a4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:32.343311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff70d4-2015-4603-9efa-5b13c9db09a4 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:32.344632 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 708/1410] 10.222.0.50 () {54 vars in 918 bytes} [Wed Aug 31 00:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:32.350137 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b75586-8654-4368-8d86-03d8f1c74a82 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:32.350564 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b75586-8654-4368-8d86-03d8f1c74a82 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:32.350564 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b75586-8654-4368-8d86-03d8f1c74a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:32.426419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-99b75586-8654-4368-8d86-03d8f1c74a82 None None] MFA Rules not processed for user `d01dd2631a81402d8a5bba7007c7fd61`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:32.427527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-99b75586-8654-4368-8d86-03d8f1c74a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:32.540949 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 703/1411] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Aug 31 00:14:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:32.561572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337afc2-4474-4bb9-b364-151f6735f548 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:32.561848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337afc2-4474-4bb9-b364-151f6735f548 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:32.562119 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337afc2-4474-4bb9-b364-151f6735f548 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:32.563452 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 709/1412] 10.222.0.50 () {54 vars in 918 bytes} [Wed Aug 31 00:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:32.568875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa816c-3c18-4117-9993-714c31356e2b None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:32.569161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa816c-3c18-4117-9993-714c31356e2b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:32.569437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa816c-3c18-4117-9993-714c31356e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:32.658527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:32.661731 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-d3fa816c-3c18-4117-9993-714c31356e2b None None] MFA Rules not processed for user `cb9ef38ec3b448828826de5f76a552d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:32.663862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d3fa816c-3c18-4117-9993-714c31356e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:32.794365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 704/1413] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Aug 31 00:14:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:35.228591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ebd7-b4df-4cce-aaa6-2e16ff51a9b7 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:35.229652 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ebd7-b4df-4cce-aaa6-2e16ff51a9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:35.229652 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ebd7-b4df-4cce-aaa6-2e16ff51a9b7 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:35.231587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:35.237164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba54c7-e2b5-4ee2-a681-cd9145d52dda None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:35.237603 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba54c7-e2b5-4ee2-a681-cd9145d52dda None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:35.237698 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba54c7-e2b5-4ee2-a681-cd9145d52dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:35.305175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-c7ba54c7-e2b5-4ee2-a681-cd9145d52dda None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:35.306384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c7ba54c7-e2b5-4ee2-a681-cd9145d52dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:35.364657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:35.406466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:35.698187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02ebd7-b4df-4cce-aaa6-2e16ff51a9b7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:35.699839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cf02ebd7-b4df-4cce-aaa6-2e16ff51a9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:35.884417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02ebd7-b4df-4cce-aaa6-2e16ff51a9b7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:35.968452 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:36.026909 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1feeaf-5876-4786-93aa-601767ca1b2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:36.027519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1feeaf-5876-4786-93aa-601767ca1b2a service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:36.027829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1feeaf-5876-4786-93aa-601767ca1b2a service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:36.028098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1feeaf-5876-4786-93aa-601767ca1b2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:36.029718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3a1feeaf-5876-4786-93aa-601767ca1b2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:36.138335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1feeaf-5876-4786-93aa-601767ca1b2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:36.139962 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1feeaf-5876-4786-93aa-601767ca1b2a service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:36.162402 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 711/1416] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:37.076954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce46df-e136-4de3-ab8c-a7a1b84c34ab None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:37.077893 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce46df-e136-4de3-ab8c-a7a1b84c34ab None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:37.077893 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce46df-e136-4de3-ab8c-a7a1b84c34ab None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:37.080037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:37.086370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c888f-754d-42fb-9ec9-db1a36d2cfd0 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:37.087134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c888f-754d-42fb-9ec9-db1a36d2cfd0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:37.087311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c888f-754d-42fb-9ec9-db1a36d2cfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:37.181015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-282c888f-754d-42fb-9ec9-db1a36d2cfd0 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:37.182248 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-282c888f-754d-42fb-9ec9-db1a36d2cfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:37.211505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:37.287327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:37.443932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce46df-e136-4de3-ab8c-a7a1b84c34ab None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:37.446367 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2cce46df-e136-4de3-ab8c-a7a1b84c34ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:37.605665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce46df-e136-4de3-ab8c-a7a1b84c34ab None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:37.646713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:37.722238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a9c6e-0730-4d4f-9eb1-3245da8786c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:37.722767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a9c6e-0730-4d4f-9eb1-3245da8786c3 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:37.723043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a9c6e-0730-4d4f-9eb1-3245da8786c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:37.723313 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a9c6e-0730-4d4f-9eb1-3245da8786c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:37.724971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6f4a9c6e-0730-4d4f-9eb1-3245da8786c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:37.942328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a9c6e-0730-4d4f-9eb1-3245da8786c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:37.943984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a9c6e-0730-4d4f-9eb1-3245da8786c3 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:37.962464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 707/1419] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:38.856191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b92ab4-82ad-4648-9250-bf6a05b9a8ab None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:38.856836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b92ab4-82ad-4648-9250-bf6a05b9a8ab None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:38.856836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b92ab4-82ad-4648-9250-bf6a05b9a8ab None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:38.858835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:38.867239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43f2a0-08e5-4c44-8394-dd7d880b8277 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:38.868057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43f2a0-08e5-4c44-8394-dd7d880b8277 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:38.868353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43f2a0-08e5-4c44-8394-dd7d880b8277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:38.924960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:38.950155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5f43f2a0-08e5-4c44-8394-dd7d880b8277 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:38.951387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5f43f2a0-08e5-4c44-8394-dd7d880b8277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:39.050799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:39.205481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b92ab4-82ad-4648-9250-bf6a05b9a8ab None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:39.207075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-50b92ab4-82ad-4648-9250-bf6a05b9a8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:39.360270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b92ab4-82ad-4648-9250-bf6a05b9a8ab None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:39.372930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:39.482206 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92b796-98a5-42d4-ad85-b7d001841580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:39.482748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92b796-98a5-42d4-ad85-b7d001841580 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:39.483029 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92b796-98a5-42d4-ad85-b7d001841580 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:39.483298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92b796-98a5-42d4-ad85-b7d001841580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:39.484967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fc92b796-98a5-42d4-ad85-b7d001841580 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:39.578702 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92b796-98a5-42d4-ad85-b7d001841580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:39.580354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92b796-98a5-42d4-ad85-b7d001841580 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:39.598925 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 714/1422] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:40.468116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6038b7-9452-4a5c-9b8d-c8417a9c45e9 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:40.468657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6038b7-9452-4a5c-9b8d-c8417a9c45e9 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:40.468657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6038b7-9452-4a5c-9b8d-c8417a9c45e9 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:40.469950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:40.475249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8394678-d89b-4eb9-9695-57497e219032 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:40.475678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8394678-d89b-4eb9-9695-57497e219032 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:40.475906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8394678-d89b-4eb9-9695-57497e219032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:40.496510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:40.563008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d8394678-d89b-4eb9-9695-57497e219032 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:40.564267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d8394678-d89b-4eb9-9695-57497e219032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:40.688974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:40.841860 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6038b7-9452-4a5c-9b8d-c8417a9c45e9 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:40.844232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-8f6038b7-9452-4a5c-9b8d-c8417a9c45e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:40.969862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:41.009570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6038b7-9452-4a5c-9b8d-c8417a9c45e9 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:41.132649 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa43af-c082-424e-baa8-a371a22d70ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:41.133257 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa43af-c082-424e-baa8-a371a22d70ce service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:41.133517 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa43af-c082-424e-baa8-a371a22d70ce service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:41.133796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa43af-c082-424e-baa8-a371a22d70ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:41.135390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-baaa43af-c082-424e-baa8-a371a22d70ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:41.214042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:41.228126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa43af-c082-424e-baa8-a371a22d70ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:41.229742 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa43af-c082-424e-baa8-a371a22d70ce service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:41.248246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 710/1425] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:42.107068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564d078-63ce-4cbd-9508-cd62e80717a6 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:42.107923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564d078-63ce-4cbd-9508-cd62e80717a6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:42.108026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564d078-63ce-4cbd-9508-cd62e80717a6 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:42.110182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:42.118258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4db10-1f8f-4528-a4ed-fbb0ebc25b31 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:42.118977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4db10-1f8f-4528-a4ed-fbb0ebc25b31 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:42.119187 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4db10-1f8f-4528-a4ed-fbb0ebc25b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:42.195795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-dbf4db10-1f8f-4528-a4ed-fbb0ebc25b31 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:42.197040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-dbf4db10-1f8f-4528-a4ed-fbb0ebc25b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:42.298067 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:42.450695 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564d078-63ce-4cbd-9508-cd62e80717a6 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:42.453218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a564d078-63ce-4cbd-9508-cd62e80717a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:42.550164 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:42.617157 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564d078-63ce-4cbd-9508-cd62e80717a6 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:42.745979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d83140-ce1c-4f96-ab35-19942b24a475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:42.746605 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d83140-ce1c-4f96-ab35-19942b24a475 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:42.746904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d83140-ce1c-4f96-ab35-19942b24a475 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:42.747174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d83140-ce1c-4f96-ab35-19942b24a475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:42.748794 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-98d83140-ce1c-4f96-ab35-19942b24a475 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:42.797237 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:42.848453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d83140-ce1c-4f96-ab35-19942b24a475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:42.850097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d83140-ce1c-4f96-ab35-19942b24a475 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:42.869611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 717/1428] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:43.702080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161def9-3f66-4a71-ae3e-ff081dbdfbe1 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:43.702942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161def9-3f66-4a71-ae3e-ff081dbdfbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:43.702942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161def9-3f66-4a71-ae3e-ff081dbdfbe1 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:43.705032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:43.711141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf128b-ff50-4b87-97f5-a65ede91420a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:43.711855 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf128b-ff50-4b87-97f5-a65ede91420a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:43.711958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf128b-ff50-4b87-97f5-a65ede91420a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:43.797614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3edf128b-ff50-4b87-97f5-a65ede91420a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:43.798713 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3edf128b-ff50-4b87-97f5-a65ede91420a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:43.900450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:44.053248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161def9-3f66-4a71-ae3e-ff081dbdfbe1 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:44.054684 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a161def9-3f66-4a71-ae3e-ff081dbdfbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:44.106283 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:44.220703 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161def9-3f66-4a71-ae3e-ff081dbdfbe1 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:44.340868 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6f929-dd3e-4bca-a89b-85a5015decb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:44.341396 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6f929-dd3e-4bca-a89b-85a5015decb1 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:44.341674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6f929-dd3e-4bca-a89b-85a5015decb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:44.341950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6f929-dd3e-4bca-a89b-85a5015decb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:44.343556 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b9b6f929-dd3e-4bca-a89b-85a5015decb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:44.350618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:44.441489 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6f929-dd3e-4bca-a89b-85a5015decb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:44.444416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6f929-dd3e-4bca-a89b-85a5015decb1 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:44.466179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 713/1431] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:45.286519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb34d3-3904-4750-a23d-bd0a654ddfcd None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:45.287076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb34d3-3904-4750-a23d-bd0a654ddfcd None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:45.287076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb34d3-3904-4750-a23d-bd0a654ddfcd None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:45.288462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:45.294945 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c8305-2534-4754-a70d-3a8285bdb874 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:45.295716 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c8305-2534-4754-a70d-3a8285bdb874 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:45.295918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c8305-2534-4754-a70d-3a8285bdb874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:45.390311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-bb2c8305-2534-4754-a70d-3a8285bdb874 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:45.391613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-bb2c8305-2534-4754-a70d-3a8285bdb874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:45.460661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:45.490344 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:14:45.647247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb34d3-3904-4750-a23d-bd0a654ddfcd None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:45.650046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4feb34d3-3904-4750-a23d-bd0a654ddfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:45.674727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:45.825005 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb34d3-3904-4750-a23d-bd0a654ddfcd None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:45.930497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:45.957747 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21766b1-01d9-4d32-833b-2028fbffad2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:45.958378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21766b1-01d9-4d32-833b-2028fbffad2f service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:45.958658 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21766b1-01d9-4d32-833b-2028fbffad2f service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:45.958932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21766b1-01d9-4d32-833b-2028fbffad2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:45.960598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e21766b1-01d9-4d32-833b-2028fbffad2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:46.056197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21766b1-01d9-4d32-833b-2028fbffad2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:46.057758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21766b1-01d9-4d32-833b-2028fbffad2f service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:46.078125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 720/1434] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:46.877766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351d50c-7074-4340-8bb7-569e90c91c57 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:46.878333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351d50c-7074-4340-8bb7-569e90c91c57 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:46.878333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351d50c-7074-4340-8bb7-569e90c91c57 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:46.879727 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:46.886189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecb46-1580-408e-8fce-1bf800144e97 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:46.887113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecb46-1580-408e-8fce-1bf800144e97 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:46.887113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecb46-1580-408e-8fce-1bf800144e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:46.968643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e13ecb46-1580-408e-8fce-1bf800144e97 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:46.969846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e13ecb46-1580-408e-8fce-1bf800144e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:47.011390 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:47.068744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:47.227378 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351d50c-7074-4340-8bb7-569e90c91c57 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:47.229856 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c351d50c-7074-4340-8bb7-569e90c91c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:47.406253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351d50c-7074-4340-8bb7-569e90c91c57 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:47.465562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:47.526463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b35c9-bac6-4ac9-b119-9208ae57b387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:47.527064 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b35c9-bac6-4ac9-b119-9208ae57b387 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:47.527339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b35c9-bac6-4ac9-b119-9208ae57b387 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:47.527597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b35c9-bac6-4ac9-b119-9208ae57b387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:47.529268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f13b35c9-bac6-4ac9-b119-9208ae57b387 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:47.621451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b35c9-bac6-4ac9-b119-9208ae57b387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:47.623109 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b35c9-bac6-4ac9-b119-9208ae57b387 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:47.644999 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 716/1437] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:48.463181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf99d5-bf7e-4f8d-9119-d3d850b4ea7d None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:48.463803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf99d5-bf7e-4f8d-9119-d3d850b4ea7d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:48.463803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf99d5-bf7e-4f8d-9119-d3d850b4ea7d None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:48.465156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:48.470327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1ae3-7737-40ef-bb7e-54bd5c45895e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:48.470794 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1ae3-7737-40ef-bb7e-54bd5c45895e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:48.470905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1ae3-7737-40ef-bb7e-54bd5c45895e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:48.545601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-8aec1ae3-7737-40ef-bb7e-54bd5c45895e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:48.546808 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-8aec1ae3-7737-40ef-bb7e-54bd5c45895e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:48.548927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:48.659854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:48.813038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf99d5-bf7e-4f8d-9119-d3d850b4ea7d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:48.814488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-99bf99d5-bf7e-4f8d-9119-d3d850b4ea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:48.985139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf99d5-bf7e-4f8d-9119-d3d850b4ea7d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:49.015946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:49.111527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3974aff-6dff-485c-a769-f917b66c680d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:49.112108 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3974aff-6dff-485c-a769-f917b66c680d service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:49.112376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3974aff-6dff-485c-a769-f917b66c680d service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:49.112641 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3974aff-6dff-485c-a769-f917b66c680d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:49.114265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f3974aff-6dff-485c-a769-f917b66c680d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:49.208529 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3974aff-6dff-485c-a769-f917b66c680d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:49.210167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3974aff-6dff-485c-a769-f917b66c680d service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:49.230058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 723/1440] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:51.066185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc1836-22bb-4b74-9054-29be338ea204 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:51.066805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc1836-22bb-4b74-9054-29be338ea204 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:51.066805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc1836-22bb-4b74-9054-29be338ea204 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:51.068468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:51.074999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb7a02-9332-4d6f-8812-324d035bc0ea None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:51.075744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb7a02-9332-4d6f-8812-324d035bc0ea None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:51.075926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb7a02-9332-4d6f-8812-324d035bc0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:51.124682 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:51.152642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b2eb7a02-9332-4d6f-8812-324d035bc0ea None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:51.153863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b2eb7a02-9332-4d6f-8812-324d035bc0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:51.255139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:51.553867 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc1836-22bb-4b74-9054-29be338ea204 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:51.556502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-bbbc1836-22bb-4b74-9054-29be338ea204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:51.679842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc1836-22bb-4b74-9054-29be338ea204 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:51.713468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:51.769911 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3560e8a-b55a-44ee-9eaa-40e230c76cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:51.770551 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560e8a-b55a-44ee-9eaa-40e230c76cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:51.770819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560e8a-b55a-44ee-9eaa-40e230c76cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:51.771076 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560e8a-b55a-44ee-9eaa-40e230c76cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:51.772724 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b3560e8a-b55a-44ee-9eaa-40e230c76cb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:51.888378 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3560e8a-b55a-44ee-9eaa-40e230c76cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:51.889824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3560e8a-b55a-44ee-9eaa-40e230c76cb9 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:51.908792 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 719/1443] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:53.996621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee0a2-8814-40c2-a5aa-651a90ff043f None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:53.997216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee0a2-8814-40c2-a5aa-651a90ff043f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:53.997216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee0a2-8814-40c2-a5aa-651a90ff043f None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:53.998647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:54.004376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c908-994f-4c90-b665-f5bbfe41f98c None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:54.004807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c908-994f-4c90-b665-f5bbfe41f98c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:54.004929 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c908-994f-4c90-b665-f5bbfe41f98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:54.076725 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5623c908-994f-4c90-b665-f5bbfe41f98c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:54.078192 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5623c908-994f-4c90-b665-f5bbfe41f98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:54.092185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:54.184149 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:54.469269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee0a2-8814-40c2-a5aa-651a90ff043f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:54.470877 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fb2ee0a2-8814-40c2-a5aa-651a90ff043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:54.596614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee0a2-8814-40c2-a5aa-651a90ff043f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:54.610687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:54.676377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa444ee-2de6-428d-a1fc-dc6dba979451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:54.676986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa444ee-2de6-428d-a1fc-dc6dba979451 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:54.677267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa444ee-2de6-428d-a1fc-dc6dba979451 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:54.677546 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa444ee-2de6-428d-a1fc-dc6dba979451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:54.679149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5aa444ee-2de6-428d-a1fc-dc6dba979451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:54.931408 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa444ee-2de6-428d-a1fc-dc6dba979451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:54.932887 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa444ee-2de6-428d-a1fc-dc6dba979451 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:54.951212 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 726/1446] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:57.192721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156a89d-62d8-47cc-ac80-fdc1ac253672 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:57.193795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156a89d-62d8-47cc-ac80-fdc1ac253672 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:57.193795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156a89d-62d8-47cc-ac80-fdc1ac253672 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:57.195883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:57.201371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3d2a-3456-4b83-a19c-f08ae88db6e0 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:57.201812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3d2a-3456-4b83-a19c-f08ae88db6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:57.201910 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3d2a-3456-4b83-a19c-f08ae88db6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:57.264000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:57.282624 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-132f3d2a-3456-4b83-a19c-f08ae88db6e0 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:57.283871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-132f3d2a-3456-4b83-a19c-f08ae88db6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:57.384541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:57.668589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156a89d-62d8-47cc-ac80-fdc1ac253672 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:57.670864 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b156a89d-62d8-47cc-ac80-fdc1ac253672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:57.786468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156a89d-62d8-47cc-ac80-fdc1ac253672 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:57.828327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:57.863737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54981ed5-ec02-41a0-b088-51442f23ae5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:57.864354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54981ed5-ec02-41a0-b088-51442f23ae5f service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:57.864627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54981ed5-ec02-41a0-b088-51442f23ae5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:57.864870 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54981ed5-ec02-41a0-b088-51442f23ae5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:57.866481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-54981ed5-ec02-41a0-b088-51442f23ae5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:57.982605 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54981ed5-ec02-41a0-b088-51442f23ae5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:57.984045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54981ed5-ec02-41a0-b088-51442f23ae5f service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:58.002769 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 722/1449] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:00.094186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcf091-53fc-4ac8-a6ca-feea67b7b347 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:00.095100 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcf091-53fc-4ac8-a6ca-feea67b7b347 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:00.095100 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcf091-53fc-4ac8-a6ca-feea67b7b347 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:00.097317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:15:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:00.103765 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70efbcc-9a23-4cfe-9766-5b27ce666ecb None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:00.104196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70efbcc-9a23-4cfe-9766-5b27ce666ecb None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:00.104320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70efbcc-9a23-4cfe-9766-5b27ce666ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:00.184463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e70efbcc-9a23-4cfe-9766-5b27ce666ecb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:00.185788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e70efbcc-9a23-4cfe-9766-5b27ce666ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:00.206220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:00.285933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:00.573255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcf091-53fc-4ac8-a6ca-feea67b7b347 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:00.575601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8cfcf091-53fc-4ac8-a6ca-feea67b7b347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:00.683429 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcf091-53fc-4ac8-a6ca-feea67b7b347 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:00.706366 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:00.762055 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e15f5-e777-47c6-b36a-23e9e1c94edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:00.762666 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e15f5-e777-47c6-b36a-23e9e1c94edf service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:00.762947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e15f5-e777-47c6-b36a-23e9e1c94edf service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:00.763216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e15f5-e777-47c6-b36a-23e9e1c94edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:00.764960 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-758e15f5-e777-47c6-b36a-23e9e1c94edf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:00.901853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e15f5-e777-47c6-b36a-23e9e1c94edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:00.903308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e15f5-e777-47c6-b36a-23e9e1c94edf service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:00.926611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 729/1452] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:02.896006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a076a-f767-47cd-88d6-5636487607ba None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:02.896944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a076a-f767-47cd-88d6-5636487607ba None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:02.896944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a076a-f767-47cd-88d6-5636487607ba None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:02.899212 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:15:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:02.917949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c794c-21f4-4826-a4dd-443fa17ae29d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:02.918630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c794c-21f4-4826-a4dd-443fa17ae29d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:02.918630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c794c-21f4-4826-a4dd-443fa17ae29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:03.005067 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:03.008536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-888c794c-21f4-4826-a4dd-443fa17ae29d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:03.010479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-888c794c-21f4-4826-a4dd-443fa17ae29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:03.117715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:03.403982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a076a-f767-47cd-88d6-5636487607ba None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:03.406200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-455a076a-f767-47cd-88d6-5636487607ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:03.516681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a076a-f767-47cd-88d6-5636487607ba None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:03.569498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:03.597567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464f81e-6f9d-4807-a996-a7fada9a0b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:03.598177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464f81e-6f9d-4807-a996-a7fada9a0b52 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:03.598456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464f81e-6f9d-4807-a996-a7fada9a0b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:03.598726 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464f81e-6f9d-4807-a996-a7fada9a0b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:03.600363 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-0464f81e-6f9d-4807-a996-a7fada9a0b52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:03.717270 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464f81e-6f9d-4807-a996-a7fada9a0b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:03.719581 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464f81e-6f9d-4807-a996-a7fada9a0b52 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:03.743321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 725/1455] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:05.711256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365b981-5e8f-4ab4-9fbf-8a228124b400 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:05.711889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365b981-5e8f-4ab4-9fbf-8a228124b400 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:05.711889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365b981-5e8f-4ab4-9fbf-8a228124b400 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:05.713822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:05.719484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021294a-b1f9-4141-9bef-9786ff558af0 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:05.720033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021294a-b1f9-4141-9bef-9786ff558af0 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:05.720147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021294a-b1f9-4141-9bef-9786ff558af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:05.793988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-c021294a-b1f9-4141-9bef-9786ff558af0 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:05.795327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c021294a-b1f9-4141-9bef-9786ff558af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:05.825576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:05.895924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:06.198633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365b981-5e8f-4ab4-9fbf-8a228124b400 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:06.200255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3365b981-5e8f-4ab4-9fbf-8a228124b400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:06.324853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365b981-5e8f-4ab4-9fbf-8a228124b400 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:06.356161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:06.404280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905ec3f-ff2d-4be0-852c-3a88438e5c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:06.404899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905ec3f-ff2d-4be0-852c-3a88438e5c83 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:06.405190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905ec3f-ff2d-4be0-852c-3a88438e5c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:06.405448 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905ec3f-ff2d-4be0-852c-3a88438e5c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:06.407073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3905ec3f-ff2d-4be0-852c-3a88438e5c83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:06.527464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905ec3f-ff2d-4be0-852c-3a88438e5c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:06.528883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905ec3f-ff2d-4be0-852c-3a88438e5c83 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:06.548664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 732/1458] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:08.529561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04fbee-0a2c-47f4-8e20-e766de6744be None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:08.530413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04fbee-0a2c-47f4-8e20-e766de6744be None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:08.530413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04fbee-0a2c-47f4-8e20-e766de6744be None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:08.532553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:15:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:08.541538 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3018ba9-0318-4d87-b3a1-fdbab1ea12be None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:08.541970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3018ba9-0318-4d87-b3a1-fdbab1ea12be None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:08.542201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3018ba9-0318-4d87-b3a1-fdbab1ea12be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:08.611745 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f3018ba9-0318-4d87-b3a1-fdbab1ea12be None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:08.612966 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f3018ba9-0318-4d87-b3a1-fdbab1ea12be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:08.621657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:08.724196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:09.008500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04fbee-0a2c-47f4-8e20-e766de6744be None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:09.010974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-0c04fbee-0a2c-47f4-8e20-e766de6744be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:09.128175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04fbee-0a2c-47f4-8e20-e766de6744be None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:09.187550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:09.206845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105ecda-a532-4be7-bcbb-54ace9a90c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:09.207461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105ecda-a532-4be7-bcbb-54ace9a90c6c service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:09.207797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105ecda-a532-4be7-bcbb-54ace9a90c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:09.208082 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105ecda-a532-4be7-bcbb-54ace9a90c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:09.209649 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5105ecda-a532-4be7-bcbb-54ace9a90c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:09.325914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105ecda-a532-4be7-bcbb-54ace9a90c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:09.327325 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105ecda-a532-4be7-bcbb-54ace9a90c6c service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:09.347362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 728/1461] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:11.305053 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85c637-faf8-40be-911b-209202323577 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.305976 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85c637-faf8-40be-911b-209202323577 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.306301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85c637-faf8-40be-911b-209202323577 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.310013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:15:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:11.315658 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bab96a-0583-4a2a-9a31-475f00fbf96e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.316139 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bab96a-0583-4a2a-9a31-475f00fbf96e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.316245 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bab96a-0583-4a2a-9a31-475f00fbf96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.389139 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e3bab96a-0583-4a2a-9a31-475f00fbf96e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:11.390660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e3bab96a-0583-4a2a-9a31-475f00fbf96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:11.429688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:11.491037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:11.771313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85c637-faf8-40be-911b-209202323577 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:11.773881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9a85c637-faf8-40be-911b-209202323577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:11.887888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85c637-faf8-40be-911b-209202323577 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:11.928945 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:11.969223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706d9d4-e928-40ef-967f-146a2d6798b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:11.969828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706d9d4-e928-40ef-967f-146a2d6798b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.970103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706d9d4-e928-40ef-967f-146a2d6798b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.970439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706d9d4-e928-40ef-967f-146a2d6798b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.972044 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0706d9d4-e928-40ef-967f-146a2d6798b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:12.084134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706d9d4-e928-40ef-967f-146a2d6798b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:12.085479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706d9d4-e928-40ef-967f-146a2d6798b6 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:12.107233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 735/1464] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:14.022836 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcd5e0-5833-4da2-a9c3-33951fa40bd1 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:14.023783 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcd5e0-5833-4da2-a9c3-33951fa40bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:14.023783 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcd5e0-5833-4da2-a9c3-33951fa40bd1 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:14.025924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:15:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:14.032146 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b69f6-1989-47f4-858a-ca21b7649b83 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:14.032656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b69f6-1989-47f4-858a-ca21b7649b83 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:14.032763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b69f6-1989-47f4-858a-ca21b7649b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:14.103653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2f5b69f6-1989-47f4-858a-ca21b7649b83 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:14.104927 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2f5b69f6-1989-47f4-858a-ca21b7649b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:14.123670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:14.209570 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:14.488891 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcd5e0-5833-4da2-a9c3-33951fa40bd1 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:14.490491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-9abcd5e0-5833-4da2-a9c3-33951fa40bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:14.601025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcd5e0-5833-4da2-a9c3-33951fa40bd1 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:14.674516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:14.681649 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d82e5-e4e9-48dd-baf4-bc1f3434417c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:14.682250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d82e5-e4e9-48dd-baf4-bc1f3434417c service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:14.682520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d82e5-e4e9-48dd-baf4-bc1f3434417c service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:14.682786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d82e5-e4e9-48dd-baf4-bc1f3434417c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:14.684422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6f9d82e5-e4e9-48dd-baf4-bc1f3434417c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:14.797648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d82e5-e4e9-48dd-baf4-bc1f3434417c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:14.799110 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d82e5-e4e9-48dd-baf4-bc1f3434417c service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:14.818722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 731/1467] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:16.754403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9cf28-4b5d-4cbf-bce6-f9257163460a None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.755282 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9cf28-4b5d-4cbf-bce6-f9257163460a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.755282 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9cf28-4b5d-4cbf-bce6-f9257163460a None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.757522 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:15:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:16.764114 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069608-0457-4b53-80f1-a8398289e078 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.764593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069608-0457-4b53-80f1-a8398289e078 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.764690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069608-0457-4b53-80f1-a8398289e078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.834256 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-66069608-0457-4b53-80f1-a8398289e078 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:16.835475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-66069608-0457-4b53-80f1-a8398289e078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:16.886640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:16.937843 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:17.223099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9cf28-4b5d-4cbf-bce6-f9257163460a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:17.224687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c2f9cf28-4b5d-4cbf-bce6-f9257163460a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:17.343640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9cf28-4b5d-4cbf-bce6-f9257163460a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:17.392168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:17.420112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216538b5-502f-47fd-903c-5f83f16cd1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:17.420703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216538b5-502f-47fd-903c-5f83f16cd1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:17.420981 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216538b5-502f-47fd-903c-5f83f16cd1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:17.421250 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216538b5-502f-47fd-903c-5f83f16cd1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:17.422906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-216538b5-502f-47fd-903c-5f83f16cd1f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:17.534170 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216538b5-502f-47fd-903c-5f83f16cd1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:17.535623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216538b5-502f-47fd-903c-5f83f16cd1f2 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:17.555436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 738/1470] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:26.936103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=22 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:27.552898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=66 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:36.963210 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f62de7-9999-4b40-9087-059b592d3814 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:36.963838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f62de7-9999-4b40-9087-059b592d3814 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:36.963838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f62de7-9999-4b40-9087-059b592d3814 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:36.965936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 733/1471] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:15:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:36.974937 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7ff09-bcec-4c6d-80ef-b5569ff54a15 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:36.975354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7ff09-bcec-4c6d-80ef-b5569ff54a15 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:36.975498 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7ff09-bcec-4c6d-80ef-b5569ff54a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:37.050907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-54c7ff09-bcec-4c6d-80ef-b5569ff54a15 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:37.052132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-54c7ff09-bcec-4c6d-80ef-b5569ff54a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:37.156225 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 739/1472] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:37.457770 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97efaea-02da-4bfc-bc6a-bede307ae577 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:37.458235 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97efaea-02da-4bfc-bc6a-bede307ae577 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:37.458686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97efaea-02da-4bfc-bc6a-bede307ae577 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:37.460889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 734/1473] 10.222.0.50 () {54 vars in 967 bytes} [Wed Aug 31 00:15:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:37.468040 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee684b7e-7b8e-437f-8ab1-a84e3684f26c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:37.468324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee684b7e-7b8e-437f-8ab1-a84e3684f26c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:37.468625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee684b7e-7b8e-437f-8ab1-a84e3684f26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:37.553278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ee684b7e-7b8e-437f-8ab1-a84e3684f26c None None] MFA Rules not processed for user `f886be277ef84ec28a290380980c6f06`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:37.554530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ee684b7e-7b8e-437f-8ab1-a84e3684f26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:37.582640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:37.648015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 740/1474] 10.222.0.50 () {58 vars in 1064 bytes} [Wed Aug 31 00:15:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:15:37.656579 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97efaea-02da-4bfc-bc6a-bede307ae577 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:37.659070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d97efaea-02da-4bfc-bc6a-bede307ae577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:37.786393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97efaea-02da-4bfc-bc6a-bede307ae577 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:37.887959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6446fab-19f2-434e-b5d4-d2c6c813ba4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f886be277ef84ec28a290380980c6f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:37.888576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6446fab-19f2-434e-b5d4-d2c6c813ba4f service glance] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:37.888841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6446fab-19f2-434e-b5d4-d2c6c813ba4f service glance] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:37.889158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6446fab-19f2-434e-b5d4-d2c6c813ba4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:37.891061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c6446fab-19f2-434e-b5d4-d2c6c813ba4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:37.962991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:38.036674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6446fab-19f2-434e-b5d4-d2c6c813ba4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:38.038594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6446fab-19f2-434e-b5d4-d2c6c813ba4f service glance] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:38.058926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 735/1475] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:15:40.114900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead646a-62d2-45bc-ba06-0f1078bfda72 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:40.115462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead646a-62d2-45bc-ba06-0f1078bfda72 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:40.115462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead646a-62d2-45bc-ba06-0f1078bfda72 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:40.117554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 741/1476] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:15:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:15:40.125189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c526d-3a70-47d5-bce6-dfefc6f78ea9 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:40.125664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c526d-3a70-47d5-bce6-dfefc6f78ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:40.125771 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c526d-3a70-47d5-bce6-dfefc6f78ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:40.195060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-cd6c526d-3a70-47d5-bce6-dfefc6f78ea9 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:40.196679 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-cd6c526d-3a70-47d5-bce6-dfefc6f78ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:40.294471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 736/1477] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:15:40.573134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead646a-62d2-45bc-ba06-0f1078bfda72 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:40.575646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2ead646a-62d2-45bc-ba06-0f1078bfda72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:40.712720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead646a-62d2-45bc-ba06-0f1078bfda72 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:40.769444 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:40.828297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3904fc-90d4-44e2-9498-9bc94238fdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:40.829150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3904fc-90d4-44e2-9498-9bc94238fdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:40.829507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3904fc-90d4-44e2-9498-9bc94238fdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:40.829772 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3904fc-90d4-44e2-9498-9bc94238fdb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:40.830534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3904fc-90d4-44e2-9498-9bc94238fdb2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:40.832339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-9b3904fc-90d4-44e2-9498-9bc94238fdb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:40.832339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 31 00:15:40.832339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: Aug 31 00:15:40.833477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3904fc-90d4-44e2-9498-9bc94238fdb2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:40.852268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 742/1478] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:40 2022] GET /identity/v3/projects => generated 2553 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:42.751988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b38f6-b720-4235-95ce-af17c553a6ea None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:42.752567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b38f6-b720-4235-95ce-af17c553a6ea None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:42.752567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b38f6-b720-4235-95ce-af17c553a6ea None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:42.753906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 737/1479] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:42.760471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ae8ae-001e-4a81-8ea3-98eef2f66beb None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:42.761238 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ae8ae-001e-4a81-8ea3-98eef2f66beb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:42.761428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ae8ae-001e-4a81-8ea3-98eef2f66beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:42.839599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e45ae8ae-001e-4a81-8ea3-98eef2f66beb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:42.840857 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e45ae8ae-001e-4a81-8ea3-98eef2f66beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:42.945557 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 743/1480] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:43.240322 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b38f6-b720-4235-95ce-af17c553a6ea None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:43.241884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c48b38f6-b720-4235-95ce-af17c553a6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:43.252265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:43.397988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b38f6-b720-4235-95ce-af17c553a6ea None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:43.486773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:43.526993 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd508615-252f-4be3-b56c-30086fa0902f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:43.527599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd508615-252f-4be3-b56c-30086fa0902f service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:43.527918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd508615-252f-4be3-b56c-30086fa0902f service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:43.528187 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd508615-252f-4be3-b56c-30086fa0902f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:43.529800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-dd508615-252f-4be3-b56c-30086fa0902f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:43.619791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd508615-252f-4be3-b56c-30086fa0902f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:43.621413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd508615-252f-4be3-b56c-30086fa0902f service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:43.639278 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 738/1481] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:45.735665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077035d-1e2a-4647-95ef-788bea635cc7 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.736186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077035d-1e2a-4647-95ef-788bea635cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.736298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077035d-1e2a-4647-95ef-788bea635cc7 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.738359 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 744/1482] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:15:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:45.744017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a198c-9ab0-484e-ba11-e61561b0a2cf None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.744482 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a198c-9ab0-484e-ba11-e61561b0a2cf None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.744589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a198c-9ab0-484e-ba11-e61561b0a2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.817342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-ac9a198c-9ab0-484e-ba11-e61561b0a2cf None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:45.818604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ac9a198c-9ab0-484e-ba11-e61561b0a2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:45.866460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:45.927123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 739/1483] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:46.208466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077035d-1e2a-4647-95ef-788bea635cc7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.210050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1077035d-1e2a-4647-95ef-788bea635cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:46.234865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:46.318571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077035d-1e2a-4647-95ef-788bea635cc7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.397845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086dbb2-628f-40a4-b18e-3f8adef49309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.398472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086dbb2-628f-40a4-b18e-3f8adef49309 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.398801 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086dbb2-628f-40a4-b18e-3f8adef49309 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.399098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086dbb2-628f-40a4-b18e-3f8adef49309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.400746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9086dbb2-628f-40a4-b18e-3f8adef49309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:46.484639 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:46.525569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086dbb2-628f-40a4-b18e-3f8adef49309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.527035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086dbb2-628f-40a4-b18e-3f8adef49309 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.546367 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 745/1484] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:48.526861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816613-b4ee-40e0-af53-46abfaec6cb2 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:48.527408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816613-b4ee-40e0-af53-46abfaec6cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:48.527516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816613-b4ee-40e0-af53-46abfaec6cb2 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:48.529682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 740/1485] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:15:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:48.536051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6653a-db1a-4e84-bf82-c418c5157f78 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:48.536465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6653a-db1a-4e84-bf82-c418c5157f78 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:48.536604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6653a-db1a-4e84-bf82-c418c5157f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:48.612060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-26c6653a-db1a-4e84-bf82-c418c5157f78 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:48.613872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-26c6653a-db1a-4e84-bf82-c418c5157f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:48.738852 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 746/1486] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:49.027827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2816613-b4ee-40e0-af53-46abfaec6cb2 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:49.030343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e2816613-b4ee-40e0-af53-46abfaec6cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:49.154629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2816613-b4ee-40e0-af53-46abfaec6cb2 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:49.232167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:49.234697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1cbd2-cc03-4478-9c87-1da70a24d00e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:49.235368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1cbd2-cc03-4478-9c87-1da70a24d00e service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:49.235650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1cbd2-cc03-4478-9c87-1da70a24d00e service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:49.235961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1cbd2-cc03-4478-9c87-1da70a24d00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:49.238126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-31b1cbd2-cc03-4478-9c87-1da70a24d00e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:49.365230 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1cbd2-cc03-4478-9c87-1da70a24d00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:49.366705 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1cbd2-cc03-4478-9c87-1da70a24d00e service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:49.386028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 741/1487] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:51.405622 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9cc1b-ca20-4a5a-9864-1724cf2ccdb1 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:51.406519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9cc1b-ca20-4a5a-9864-1724cf2ccdb1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:51.406519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9cc1b-ca20-4a5a-9864-1724cf2ccdb1 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.408719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 747/1488] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:15:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:51.417417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928297b-76bf-408b-af65-0a0e466b1ab6 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:51.417833 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928297b-76bf-408b-af65-0a0e466b1ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:51.417942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928297b-76bf-408b-af65-0a0e466b1ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.495156 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-2928297b-76bf-408b-af65-0a0e466b1ab6 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:51.496426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2928297b-76bf-408b-af65-0a0e466b1ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:51.549638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:51.597569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 742/1489] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:51.886263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9cc1b-ca20-4a5a-9864-1724cf2ccdb1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:51.888053 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1cd9cc1b-ca20-4a5a-9864-1724cf2ccdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:51.928517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:52.002512 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9cc1b-ca20-4a5a-9864-1724cf2ccdb1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:52.086993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcdd09-edf0-449d-88e0-f5eef2dd3064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:52.087619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcdd09-edf0-449d-88e0-f5eef2dd3064 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:52.087934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcdd09-edf0-449d-88e0-f5eef2dd3064 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:52.088204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcdd09-edf0-449d-88e0-f5eef2dd3064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:52.089812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-eedcdd09-edf0-449d-88e0-f5eef2dd3064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:52.177937 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:52.209234 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcdd09-edf0-449d-88e0-f5eef2dd3064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:52.210676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcdd09-edf0-449d-88e0-f5eef2dd3064 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:52.229744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 748/1490] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:54.381403 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4d79f-64f3-48cb-ada9-1b86e14c48e2 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:54.382011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4d79f-64f3-48cb-ada9-1b86e14c48e2 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:54.382011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4d79f-64f3-48cb-ada9-1b86e14c48e2 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:54.383341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 743/1491] 10.222.0.50 () {54 vars in 927 bytes} [Wed Aug 31 00:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:54.389979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4de73-e1ca-4a1c-92f3-f492d497eca7 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:54.390644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4de73-e1ca-4a1c-92f3-f492d497eca7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:54.390895 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4de73-e1ca-4a1c-92f3-f492d497eca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:54.462805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-fec4de73-e1ca-4a1c-92f3-f492d497eca7 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:54.463970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fec4de73-e1ca-4a1c-92f3-f492d497eca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:54.563297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 749/1492] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:54.851508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4d79f-64f3-48cb-ada9-1b86e14c48e2 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:54.853122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ada4d79f-64f3-48cb-ada9-1b86e14c48e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:54.965057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4d79f-64f3-48cb-ada9-1b86e14c48e2 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:55.050386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96cd66-6909-469a-bc70-bb548a52f6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:55.051256 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96cd66-6909-469a-bc70-bb548a52f6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.051680 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96cd66-6909-469a-bc70-bb548a52f6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.051987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96cd66-6909-469a-bc70-bb548a52f6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.053657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-dd96cd66-6909-469a-bc70-bb548a52f6e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:55.063335 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:55.167502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96cd66-6909-469a-bc70-bb548a52f6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:55.169012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96cd66-6909-469a-bc70-bb548a52f6e1 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:55.187886 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 744/1493] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:04.561369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=82 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:05.185413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=50 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:08.432193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d74e8-3cab-4fc6-87c0-0165ee68926f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:08.433105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d74e8-3cab-4fc6-87c0-0165ee68926f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:08.433105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d74e8-3cab-4fc6-87c0-0165ee68926f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:08.520643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9e7d74e8-3cab-4fc6-87c0-0165ee68926f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:08.521888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9e7d74e8-3cab-4fc6-87c0-0165ee68926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:08.624797 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 750/1494] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:08.637695 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c446a-e6b9-43d1-8f35-2ccd422fdb9d None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:08.638239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c446a-e6b9-43d1-8f35-2ccd422fdb9d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:08.638344 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c446a-e6b9-43d1-8f35-2ccd422fdb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:08.725040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-a93c446a-e6b9-43d1-8f35-2ccd422fdb9d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:08.726158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a93c446a-e6b9-43d1-8f35-2ccd422fdb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:08.835468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 745/1495] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:08.840366 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d74e8-3cab-4fc6-87c0-0165ee68926f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:08.841648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9e7d74e8-3cab-4fc6-87c0-0165ee68926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:08.853407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d74e8-3cab-4fc6-87c0-0165ee68926f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:08.927069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:08.964170 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f128c-010f-41c3-96fb-c7eeee3cae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:08.964819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f128c-010f-41c3-96fb-c7eeee3cae03 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:08.965120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f128c-010f-41c3-96fb-c7eeee3cae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:08.965389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f128c-010f-41c3-96fb-c7eeee3cae03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:08.966032 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f128c-010f-41c3-96fb-c7eeee3cae03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:08.966330 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f128c-010f-41c3-96fb-c7eeee3cae03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:08.967626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-6b3f128c-010f-41c3-96fb-c7eeee3cae03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:17:08.967626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 31 00:17:08.967626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: Aug 31 00:17:08.968659 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f128c-010f-41c3-96fb-c7eeee3cae03 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:08.981166 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 751/1496] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:08.990079 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c446a-e6b9-43d1-8f35-2ccd422fdb9d None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:09.000025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c446a-e6b9-43d1-8f35-2ccd422fdb9d None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:09.070900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:09.108506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bc9fa-68aa-4bb1-a679-4d4d600a5e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:09.109129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bc9fa-68aa-4bb1-a679-4d4d600a5e75 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.109407 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bc9fa-68aa-4bb1-a679-4d4d600a5e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.109664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bc9fa-68aa-4bb1-a679-4d4d600a5e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.110317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bc9fa-68aa-4bb1-a679-4d4d600a5e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:09.112143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: WARNING py.warnings [None req-f42bc9fa-68aa-4bb1-a679-4d4d600a5e75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:17:09.112143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: warnings.warn(msg) Aug 31 00:17:09.112143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: Aug 31 00:17:09.113320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bc9fa-68aa-4bb1-a679-4d4d600a5e75 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:09.176447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 746/1497] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:17:08 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:09.180778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f128c-010f-41c3-96fb-c7eeee3cae03 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:09.182349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6b3f128c-010f-41c3-96fb-c7eeee3cae03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:09.218527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f128c-010f-41c3-96fb-c7eeee3cae03 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:09.317772 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573842-987a-452a-afe4-492c25f8f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:09.318376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573842-987a-452a-afe4-492c25f8f54e admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.318652 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573842-987a-452a-afe4-492c25f8f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.318914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573842-987a-452a-afe4-492c25f8f54e admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.319571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6573842-987a-452a-afe4-492c25f8f54e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:09.320613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-c6573842-987a-452a-afe4-492c25f8f54e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:17:09.320613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 31 00:17:09.320613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: Aug 31 00:17:09.321816 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6573842-987a-452a-afe4-492c25f8f54e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:09.367981 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 752/1498] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:17:09 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:09.372397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bc9fa-68aa-4bb1-a679-4d4d600a5e75 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:09.373937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f42bc9fa-68aa-4bb1-a679-4d4d600a5e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:09.443531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bc9fa-68aa-4bb1-a679-4d4d600a5e75 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:09.548114 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:09.560123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a558f-f4d5-498e-8f84-0504906bbb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:09.560810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a558f-f4d5-498e-8f84-0504906bbb0a admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.561086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a558f-f4d5-498e-8f84-0504906bbb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.561349 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a558f-f4d5-498e-8f84-0504906bbb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.561990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a558f-f4d5-498e-8f84-0504906bbb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:09.563016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: WARNING py.warnings [None req-bc5a558f-f4d5-498e-8f84-0504906bbb0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:17:09.563016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: warnings.warn(msg) Aug 31 00:17:09.563016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: Aug 31 00:17:09.563922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a558f-f4d5-498e-8f84-0504906bbb0a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:09.576742 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 747/1499] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:09.581388 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573842-987a-452a-afe4-492c25f8f54e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:09.582894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c6573842-987a-452a-afe4-492c25f8f54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:09.594857 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573842-987a-452a-afe4-492c25f8f54e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:09.620267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:09.700186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3de45c-3569-41d1-8e20-9278eeac2475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:09.700850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3de45c-3569-41d1-8e20-9278eeac2475 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.701132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3de45c-3569-41d1-8e20-9278eeac2475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.701390 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3de45c-3569-41d1-8e20-9278eeac2475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.702120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3de45c-3569-41d1-8e20-9278eeac2475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:09.703190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-0d3de45c-3569-41d1-8e20-9278eeac2475 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:17:09.703190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 31 00:17:09.703190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: Aug 31 00:17:09.704452 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3de45c-3569-41d1-8e20-9278eeac2475 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:09.717789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 753/1500] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:17:09.722388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a558f-f4d5-498e-8f84-0504906bbb0a admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:09.723997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-bc5a558f-f4d5-498e-8f84-0504906bbb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:09.758801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a558f-f4d5-498e-8f84-0504906bbb0a admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:09.854962 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504751d5-79f0-4f16-a5c9-b1d5f29cc466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:09.855564 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504751d5-79f0-4f16-a5c9-b1d5f29cc466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.855874 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504751d5-79f0-4f16-a5c9-b1d5f29cc466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.856144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504751d5-79f0-4f16-a5c9-b1d5f29cc466 admin admin] PATH_INFO: `/v3/projects/2dda162f3733422798f33eb7af9579bc/users/46790a5e1de54b42b39fef50be0593d0/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.885208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504751d5-79f0-4f16-a5c9-b1d5f29cc466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dda162f3733422798f33eb7af9579bc, user_id=46790a5e1de54b42b39fef50be0593d0, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:09.886755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: WARNING py.warnings [None req-504751d5-79f0-4f16-a5c9-b1d5f29cc466 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:17:09.886755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: warnings.warn(msg) Aug 31 00:17:09.886755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: Aug 31 00:17:09.889511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504751d5-79f0-4f16-a5c9-b1d5f29cc466 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:09.916231 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 748/1501] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:17:09 2022] PUT /identity/v3/projects/2dda162f3733422798f33eb7af9579bc/users/46790a5e1de54b42b39fef50be0593d0/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:09.929380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf42809-f34f-4d04-8d8c-d8de86a63c39 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.929727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf42809-f34f-4d04-8d8c-d8de86a63c39 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.930131 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf42809-f34f-4d04-8d8c-d8de86a63c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.994919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-cbf42809-f34f-4d04-8d8c-d8de86a63c39 None None] MFA Rules not processed for user `46790a5e1de54b42b39fef50be0593d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:09.996177 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cbf42809-f34f-4d04-8d8c-d8de86a63c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:10.088173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 754/1502] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:17:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:17:10.105759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b763b1-8bca-4065-b185-e0c07193bb64 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:10.105951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b763b1-8bca-4065-b185-e0c07193bb64 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:10.106260 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b763b1-8bca-4065-b185-e0c07193bb64 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:10.107842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 749/1503] 10.222.0.50 () {54 vars in 964 bytes} [Wed Aug 31 00:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:10.112864 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094827b7-e7fa-4b53-a681-ae48a059288d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:10.113159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094827b7-e7fa-4b53-a681-ae48a059288d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:10.113435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094827b7-e7fa-4b53-a681-ae48a059288d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:10.147492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:10.203945 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-094827b7-e7fa-4b53-a681-ae48a059288d None None] MFA Rules not processed for user `fbc36c937503477e8542cbef7c5f5db8`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:10.205286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-094827b7-e7fa-4b53-a681-ae48a059288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:10.285467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 755/1504] 10.222.0.50 () {58 vars in 1061 bytes} [Wed Aug 31 00:17:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:10.295729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b763b1-8bca-4065-b185-e0c07193bb64 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:10.297285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f1b763b1-8bca-4065-b185-e0c07193bb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:10.353700 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:10.410307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b763b1-8bca-4065-b185-e0c07193bb64 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:10.486904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97640d55-6a8d-4838-b4d1-1240a2f77f7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:10.487548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97640d55-6a8d-4838-b4d1-1240a2f77f7b service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:10.487848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97640d55-6a8d-4838-b4d1-1240a2f77f7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:10.488113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97640d55-6a8d-4838-b4d1-1240a2f77f7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:10.489675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-97640d55-6a8d-4838-b4d1-1240a2f77f7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:10.597596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97640d55-6a8d-4838-b4d1-1240a2f77f7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:10.599072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97640d55-6a8d-4838-b4d1-1240a2f77f7b service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:10.602493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:10.617717 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 750/1505] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:10.665037 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef27c-c035-4514-b985-1a058715d093 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:10.665471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef27c-c035-4514-b985-1a058715d093 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:10.665585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef27c-c035-4514-b985-1a058715d093 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:10.666855 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 756/1506] 10.222.0.50 () {52 vars in 830 bytes} [Wed Aug 31 00:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:10.671329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97640d55-6a8d-4838-b4d1-1240a2f77f7b service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:10.672734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-97640d55-6a8d-4838-b4d1-1240a2f77f7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:10.783435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97640d55-6a8d-4838-b4d1-1240a2f77f7b service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:10.887249 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:10.888154 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:10.888512 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:10.888852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] PATH_INFO: `/v3/users/46790a5e1de54b42b39fef50be0593d0` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:10.902490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=46790a5e1de54b42b39fef50be0593d0)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:10.903544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: WARNING py.warnings [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:17:10.903544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: warnings.warn(msg) Aug 31 00:17:10.903544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: Aug 31 00:17:10.904862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:10.915312 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:10.982224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46790a5e1de54b42b39fef50be0593d0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:11.013995 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46790a5e1de54b42b39fef50be0593d0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:11.027996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46790a5e1de54b42b39fef50be0593d0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:11.040182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46790a5e1de54b42b39fef50be0593d0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:11.040692 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46790a5e1de54b42b39fef50be0593d0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:11.046599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 751/1507] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:17:10 2022] DELETE /identity/v3/users/46790a5e1de54b42b39fef50be0593d0 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:11.051190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e05587-576d-4cb5-a975-3ccb9b64e9d2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:11.051477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e05587-576d-4cb5-a975-3ccb9b64e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:11.051779 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e05587-576d-4cb5-a975-3ccb9b64e9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:11.118472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-59e05587-576d-4cb5-a975-3ccb9b64e9d2 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:11.119673 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-59e05587-576d-4cb5-a975-3ccb9b64e9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:11.205292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:11.219766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 757/1508] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:17:11.229978 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:11.231240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:11.333975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0fea2-d9d0-47d3-9c4c-c219b5926d1a admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:11.394854 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:11.425973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dfd06-b4fd-4301-90d5-267bf1709e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:11.426529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dfd06-b4fd-4301-90d5-267bf1709e7f service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:11.426801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dfd06-b4fd-4301-90d5-267bf1709e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:11.427066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dfd06-b4fd-4301-90d5-267bf1709e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:11.428709 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a51dfd06-b4fd-4301-90d5-267bf1709e7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:11.546590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dfd06-b4fd-4301-90d5-267bf1709e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:11.548089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dfd06-b4fd-4301-90d5-267bf1709e7f service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:11.567385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 752/1509] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:17:11.917580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e05587-576d-4cb5-a975-3ccb9b64e9d2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:11.918938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-59e05587-576d-4cb5-a975-3ccb9b64e9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:11.930787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e05587-576d-4cb5-a975-3ccb9b64e9d2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:12.027325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c556b84-8ee3-47d6-a471-c23470d15b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:12.027995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c556b84-8ee3-47d6-a471-c23470d15b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:12.028275 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c556b84-8ee3-47d6-a471-c23470d15b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:12.028567 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c556b84-8ee3-47d6-a471-c23470d15b1c admin admin] PATH_INFO: `/v3/projects/2dda162f3733422798f33eb7af9579bc` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:12.038818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c556b84-8ee3-47d6-a471-c23470d15b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dda162f3733422798f33eb7af9579bc)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:12.039891 dv-cinder-852210-5-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-6c556b84-8ee3-47d6-a471-c23470d15b1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:17:12.039891 dv-cinder-852210-5-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 31 00:17:12.039891 dv-cinder-852210-5-smb devstack@keystone.service[81491]: Aug 31 00:17:12.041092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c556b84-8ee3-47d6-a471-c23470d15b1c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:12.102028 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6c556b84-8ee3-47d6-a471-c23470d15b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dda162f3733422798f33eb7af9579bc', 'request_id': 'req-6c556b84-8ee3-47d6-a471-c23470d15b1c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:12.114006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6c556b84-8ee3-47d6-a471-c23470d15b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dda162f3733422798f33eb7af9579bc', 'request_id': 'req-6c556b84-8ee3-47d6-a471-c23470d15b1c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:12.122721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6c556b84-8ee3-47d6-a471-c23470d15b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dda162f3733422798f33eb7af9579bc', 'request_id': 'req-6c556b84-8ee3-47d6-a471-c23470d15b1c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:12.159862 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6c556b84-8ee3-47d6-a471-c23470d15b1c admin admin] The token cache is being invalidate because project 2dda162f3733422798f33eb7af9579bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:17:12.160125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6c556b84-8ee3-47d6-a471-c23470d15b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:12.160679 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6c556b84-8ee3-47d6-a471-c23470d15b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:17:12.162272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 758/1510] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:17:11 2022] DELETE /identity/v3/projects/2dda162f3733422798f33eb7af9579bc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:21.565055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=62 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:22.157700 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:47.054816 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47234a-6c24-4bca-8767-9164d9188fcc None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.055430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47234a-6c24-4bca-8767-9164d9188fcc None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.055430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47234a-6c24-4bca-8767-9164d9188fcc None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.056826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:18:47.062943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c33c61-1f24-4610-89aa-044ae1a075a8 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.063801 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c33c61-1f24-4610-89aa-044ae1a075a8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.063801 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c33c61-1f24-4610-89aa-044ae1a075a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.151477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-49c33c61-1f24-4610-89aa-044ae1a075a8 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:47.152754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-49c33c61-1f24-4610-89aa-044ae1a075a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:47.271250 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:47.430035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47234a-6c24-4bca-8767-9164d9188fcc None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:47.434020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3b47234a-6c24-4bca-8767-9164d9188fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:47.567294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47234a-6c24-4bca-8767-9164d9188fcc None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:47.574615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b3d09-5bf2-4845-bc41-125d12b2368d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:47.575225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3d09-5bf2-4845-bc41-125d12b2368d service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:47.575502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3d09-5bf2-4845-bc41-125d12b2368d service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:47.575776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b3d09-5bf2-4845-bc41-125d12b2368d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:47.585758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b3d09-5bf2-4845-bc41-125d12b2368d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:47.587390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b3d09-5bf2-4845-bc41-125d12b2368d service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:47.597624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 754/1513] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:48.399652 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d99de-0719-496d-b25c-9d5ced78fe34 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:48.400227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d99de-0719-496d-b25c-9d5ced78fe34 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:48.400328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d99de-0719-496d-b25c-9d5ced78fe34 None None] PATH_INFO: `/v3` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:48.401875 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 760/1514] 10.222.0.66 () {54 vars in 925 bytes} [Wed Aug 31 00:18:48 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:18:48.409280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50f5d9-5998-4798-b918-857f9a6072f5 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:48.409775 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50f5d9-5998-4798-b918-857f9a6072f5 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:48.409775 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50f5d9-5998-4798-b918-857f9a6072f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:48.436422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cb858-249c-4ffb-a3df-b7a8d5ceddeb None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:48.436619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cb858-249c-4ffb-a3df-b7a8d5ceddeb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:48.436891 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cb858-249c-4ffb-a3df-b7a8d5ceddeb None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:48.438258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 761/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:18:48.443404 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da027c54-f059-4366-b1fc-4390ff7bd9bb None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:48.443750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da027c54-f059-4366-b1fc-4390ff7bd9bb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:48.444009 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da027c54-f059-4366-b1fc-4390ff7bd9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:48.466972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-da027c54-f059-4366-b1fc-4390ff7bd9bb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:48.468248 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-da027c54-f059-4366-b1fc-4390ff7bd9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:48.476061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-ad50f5d9-5998-4798-b918-857f9a6072f5 None None] MFA Rules not processed for user `d01dd2631a81402d8a5bba7007c7fd61`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:48.476884 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 762/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:48.480074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ad50f5d9-5998-4798-b918-857f9a6072f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:48.550600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:48.556385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 755/1517] 10.222.0.66 () {58 vars in 1015 bytes} [Wed Aug 31 00:18:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:48.632959 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da027c54-f059-4366-b1fc-4390ff7bd9bb None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:48.648539 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da027c54-f059-4366-b1fc-4390ff7bd9bb None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:48.654438 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592daf4-bdbf-462a-bc22-aa1a102d7b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:48.655086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592daf4-bdbf-462a-bc22-aa1a102d7b69 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:48.655363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592daf4-bdbf-462a-bc22-aa1a102d7b69 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:48.655634 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592daf4-bdbf-462a-bc22-aa1a102d7b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:48.664757 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592daf4-bdbf-462a-bc22-aa1a102d7b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:48.666379 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592daf4-bdbf-462a-bc22-aa1a102d7b69 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:48.676420 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 763/1518] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:57.497459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab609-dd0d-4c4d-aa80-1c1ecce94d87 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:57.498344 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab609-dd0d-4c4d-aa80-1c1ecce94d87 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:57.498344 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab609-dd0d-4c4d-aa80-1c1ecce94d87 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:57.501517 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 756/1519] 10.222.0.50 () {54 vars in 961 bytes} [Wed Aug 31 00:18:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:18:57.506933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa84b9-edda-4428-a573-7d2948932739 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:57.507423 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa84b9-edda-4428-a573-7d2948932739 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:57.507527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa84b9-edda-4428-a573-7d2948932739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:57.528611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d0aa84b9-edda-4428-a573-7d2948932739 None None] MFA Rules not processed for user `d01dd2631a81402d8a5bba7007c7fd61`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:57.529839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d0aa84b9-edda-4428-a573-7d2948932739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:57.539120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 764/1520] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Aug 31 00:18:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:57.547032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfab609-dd0d-4c4d-aa80-1c1ecce94d87 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:57.569161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfab609-dd0d-4c4d-aa80-1c1ecce94d87 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:57.576682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da95ba-9a2e-4edf-97ec-3203d713d208 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01dd2631a81402d8a5bba7007c7fd61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:57.577280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da95ba-9a2e-4edf-97ec-3203d713d208 service placement] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:57.577549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da95ba-9a2e-4edf-97ec-3203d713d208 service placement] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:57.578014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da95ba-9a2e-4edf-97ec-3203d713d208 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:57.586087 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da95ba-9a2e-4edf-97ec-3203d713d208 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:57.587681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da95ba-9a2e-4edf-97ec-3203d713d208 service placement] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:57.597304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 757/1521] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:59.914781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dc33b-ba71-4e65-a85c-762b73283a2a None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:59.915399 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dc33b-ba71-4e65-a85c-762b73283a2a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:59.915399 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dc33b-ba71-4e65-a85c-762b73283a2a None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:59.916730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:18:59.921972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f3b79-57a1-478e-9035-75caa082e54f None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:59.922424 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f3b79-57a1-478e-9035-75caa082e54f None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:59.922532 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f3b79-57a1-478e-9035-75caa082e54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:59.944302 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-767f3b79-57a1-478e-9035-75caa082e54f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:59.945484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-767f3b79-57a1-478e-9035-75caa082e54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:59.954740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:00.113750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dc33b-ba71-4e65-a85c-762b73283a2a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:00.131260 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dc33b-ba71-4e65-a85c-762b73283a2a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:00.137996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b66d4d-c9d1-4120-879f-a0a76a0a37a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:00.138627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66d4d-c9d1-4120-879f-a0a76a0a37a4 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:00.138916 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66d4d-c9d1-4120-879f-a0a76a0a37a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:00.139227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66d4d-c9d1-4120-879f-a0a76a0a37a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:00.148188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b66d4d-c9d1-4120-879f-a0a76a0a37a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:00.149767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b66d4d-c9d1-4120-879f-a0a76a0a37a4 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:00.159507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 766/1524] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:00.978824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea1963-93ce-4605-bc7a-e13d0db5509f None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:00.979455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea1963-93ce-4605-bc7a-e13d0db5509f None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:00.979455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea1963-93ce-4605-bc7a-e13d0db5509f None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:00.981312 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:00.988284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebce8f1-ef56-4188-9c11-9e0682ac6961 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:00.988727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebce8f1-ef56-4188-9c11-9e0682ac6961 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:00.988837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebce8f1-ef56-4188-9c11-9e0682ac6961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:01.010210 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-8ebce8f1-ef56-4188-9c11-9e0682ac6961 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:01.011418 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8ebce8f1-ef56-4188-9c11-9e0682ac6961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:01.020641 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:01.171225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea1963-93ce-4605-bc7a-e13d0db5509f None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:01.188135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea1963-93ce-4605-bc7a-e13d0db5509f None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:01.195350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460fcda-3833-40b9-a49b-3a62ee0b30c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:01.196325 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460fcda-3833-40b9-a49b-3a62ee0b30c3 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:01.197078 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460fcda-3833-40b9-a49b-3a62ee0b30c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:01.197411 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460fcda-3833-40b9-a49b-3a62ee0b30c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:01.206855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460fcda-3833-40b9-a49b-3a62ee0b30c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:01.208516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460fcda-3833-40b9-a49b-3a62ee0b30c3 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:01.218339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 760/1527] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:05.643718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586c72-e21c-4213-bdf9-0a0ae9f50ad7 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:05.644629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586c72-e21c-4213-bdf9-0a0ae9f50ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:05.644871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586c72-e21c-4213-bdf9-0a0ae9f50ad7 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:05.647329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:19:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:05.656210 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6c73d-e60d-4e91-b08b-c26b4a27db04 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:05.656636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6c73d-e60d-4e91-b08b-c26b4a27db04 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:05.656846 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6c73d-e60d-4e91-b08b-c26b4a27db04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:05.681685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-a8f6c73d-e60d-4e91-b08b-c26b4a27db04 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:05.682858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a8f6c73d-e60d-4e91-b08b-c26b4a27db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:05.691817 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:05.982569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc586c72-e21c-4213-bdf9-0a0ae9f50ad7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:05.984477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bc586c72-e21c-4213-bdf9-0a0ae9f50ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:06.022281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:06.079264 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc586c72-e21c-4213-bdf9-0a0ae9f50ad7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:06.083487 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f5cee-b14c-4a70-9502-0cf5fe4d5be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:06.084119 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f5cee-b14c-4a70-9502-0cf5fe4d5be9 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:06.084382 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f5cee-b14c-4a70-9502-0cf5fe4d5be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:06.084648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f5cee-b14c-4a70-9502-0cf5fe4d5be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:06.095167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f5cee-b14c-4a70-9502-0cf5fe4d5be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:06.096635 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f5cee-b14c-4a70-9502-0cf5fe4d5be9 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:06.106761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 769/1530] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:07.983992 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681ef0-016e-458d-be42-c5f42bcdbfbc None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:07.984831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681ef0-016e-458d-be42-c5f42bcdbfbc None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:07.984831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681ef0-016e-458d-be42-c5f42bcdbfbc None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:07.987132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:19:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:07.992640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546755e7-a6bc-44d8-a6cb-9f61bf68e0eb None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:07.993090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546755e7-a6bc-44d8-a6cb-9f61bf68e0eb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:07.993224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546755e7-a6bc-44d8-a6cb-9f61bf68e0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:08.017131 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-546755e7-a6bc-44d8-a6cb-9f61bf68e0eb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:08.019018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-546755e7-a6bc-44d8-a6cb-9f61bf68e0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:08.033513 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:08.327762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db681ef0-016e-458d-be42-c5f42bcdbfbc None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:08.330871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-db681ef0-016e-458d-be42-c5f42bcdbfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:08.347595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db681ef0-016e-458d-be42-c5f42bcdbfbc None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:08.351536 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33247d71-ee99-4233-8b8a-817d54c4b5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:08.352171 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33247d71-ee99-4233-8b8a-817d54c4b5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:08.352449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33247d71-ee99-4233-8b8a-817d54c4b5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:08.352721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33247d71-ee99-4233-8b8a-817d54c4b5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:08.362223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33247d71-ee99-4233-8b8a-817d54c4b5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:08.363863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33247d71-ee99-4233-8b8a-817d54c4b5c8 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:08.374580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 763/1533] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:12.865733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c46d9-d63b-4181-bef9-4828a26d9300 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:12.866603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c46d9-d63b-4181-bef9-4828a26d9300 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:12.866603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c46d9-d63b-4181-bef9-4828a26d9300 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:12.868468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:19:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:12.873892 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5d653-43c5-40ee-950f-f90f90817f6a None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:12.874355 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5d653-43c5-40ee-950f-f90f90817f6a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:12.874460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5d653-43c5-40ee-950f-f90f90817f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:12.896643 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-ddc5d653-43c5-40ee-950f-f90f90817f6a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:12.898482 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ddc5d653-43c5-40ee-950f-f90f90817f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:12.906788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:13.454853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c46d9-d63b-4181-bef9-4828a26d9300 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:13.456991 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-de8c46d9-d63b-4181-bef9-4828a26d9300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:13.547356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c46d9-d63b-4181-bef9-4828a26d9300 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:13.551162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c0039-b840-4424-91c9-9643072f00b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:13.551803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0039-b840-4424-91c9-9643072f00b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:13.552099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0039-b840-4424-91c9-9643072f00b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:13.552350 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0039-b840-4424-91c9-9643072f00b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:13.561736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c0039-b840-4424-91c9-9643072f00b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:13.563182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c0039-b840-4424-91c9-9643072f00b9 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:13.573165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 772/1536] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:15.511175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5afdd-759c-45e3-b3e3-ff62eb5bd67e None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:15.511787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5afdd-759c-45e3-b3e3-ff62eb5bd67e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:15.511787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5afdd-759c-45e3-b3e3-ff62eb5bd67e None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:15.513621 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:15.519025 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6610-708d-45b1-97df-feb25ac86a3a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:15.519475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6610-708d-45b1-97df-feb25ac86a3a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:15.519579 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6610-708d-45b1-97df-feb25ac86a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:15.540043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c56e6610-708d-45b1-97df-feb25ac86a3a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:15.541231 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c56e6610-708d-45b1-97df-feb25ac86a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:15.549646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:19:16.093653 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5afdd-759c-45e3-b3e3-ff62eb5bd67e None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:16.095672 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f1e5afdd-759c-45e3-b3e3-ff62eb5bd67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:16.110122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5afdd-759c-45e3-b3e3-ff62eb5bd67e None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:16.113837 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430105c-56fd-4e29-8ae0-68d41f9f458c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:16.114428 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430105c-56fd-4e29-8ae0-68d41f9f458c service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:16.114699 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430105c-56fd-4e29-8ae0-68d41f9f458c service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:16.114983 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430105c-56fd-4e29-8ae0-68d41f9f458c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:16.125060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430105c-56fd-4e29-8ae0-68d41f9f458c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:16.126496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430105c-56fd-4e29-8ae0-68d41f9f458c service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:16.135946 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 766/1539] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:19:25.535023 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=66 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:26.131710 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=34 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:44.752590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515778c1-dc13-4fdf-917d-5692c3084b3e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.753370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515778c1-dc13-4fdf-917d-5692c3084b3e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.753370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515778c1-dc13-4fdf-917d-5692c3084b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.754160 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04d58-e374-41bb-a833-13f5eb148a32 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.755040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04d58-e374-41bb-a833-13f5eb148a32 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.755531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04d58-e374-41bb-a833-13f5eb148a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.782394 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-c5c04d58-e374-41bb-a833-13f5eb148a32 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:44.783133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-515778c1-dc13-4fdf-917d-5692c3084b3e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:44.787725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-515778c1-dc13-4fdf-917d-5692c3084b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.788692 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c5c04d58-e374-41bb-a833-13f5eb148a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.796903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 774/1540] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:44.810165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 767/1541] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:44.819580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b32f8-966d-4708-a98a-4cd5563fb3b1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.820018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b32f8-966d-4708-a98a-4cd5563fb3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.820940 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b1bf-d5bd-462b-9bba-ac793100caac None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.821342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b32f8-966d-4708-a98a-4cd5563fb3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.821676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b1bf-d5bd-462b-9bba-ac793100caac None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.822182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b1bf-d5bd-462b-9bba-ac793100caac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.848484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7431b1bf-d5bd-462b-9bba-ac793100caac None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:44.850226 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7431b1bf-d5bd-462b-9bba-ac793100caac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.858007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-910b32f8-966d-4708-a98a-4cd5563fb3b1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:44.858007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-910b32f8-966d-4708-a98a-4cd5563fb3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.872511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 768/1542] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:44.874315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8b1f4-7db5-40e0-bb42-5e8fcef10071 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.874834 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8b1f4-7db5-40e0-bb42-5e8fcef10071 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.875347 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8b1f4-7db5-40e0-bb42-5e8fcef10071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.876636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 775/1543] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:44.877879 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d6197-e14f-46ea-b762-20a2833715dd None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.878163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d6197-e14f-46ea-b762-20a2833715dd None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.878440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d6197-e14f-46ea-b762-20a2833715dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.903477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-817d6197-e14f-46ea-b762-20a2833715dd None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:44.905143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-a9c8b1f4-7db5-40e0-bb42-5e8fcef10071 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:44.905595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-817d6197-e14f-46ea-b762-20a2833715dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.906310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a9c8b1f4-7db5-40e0-bb42-5e8fcef10071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.915558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 776/1544] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:44.916131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 769/1545] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:44.917465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bba3f-52b0-4ec2-9902-c6d0e6a5eb8d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.917979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bba3f-52b0-4ec2-9902-c6d0e6a5eb8d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.918478 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bba3f-52b0-4ec2-9902-c6d0e6a5eb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.923204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6a50d-9959-49e4-a8cb-78d88b42e26f None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.923204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6a50d-9959-49e4-a8cb-78d88b42e26f None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.923204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6a50d-9959-49e4-a8cb-78d88b42e26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.945121 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ef2bba3f-52b0-4ec2-9902-c6d0e6a5eb8d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:44.946477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ef2bba3f-52b0-4ec2-9902-c6d0e6a5eb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.946999 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-f2c6a50d-9959-49e4-a8cb-78d88b42e26f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:44.948180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f2c6a50d-9959-49e4-a8cb-78d88b42e26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.954719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 777/1546] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:44.961759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038b57-23f6-4c45-86f4-87a0ea0dc11b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.961759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038b57-23f6-4c45-86f4-87a0ea0dc11b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.961759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa038b57-23f6-4c45-86f4-87a0ea0dc11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.962130 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 770/1547] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:44.962130 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6a50d-9959-49e4-a8cb-78d88b42e26f None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.978392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6a50d-9959-49e4-a8cb-78d88b42e26f None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:44.980903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-aa038b57-23f6-4c45-86f4-87a0ea0dc11b None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:44.982115 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-aa038b57-23f6-4c45-86f4-87a0ea0dc11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.982977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f74778-ac56-48b2-8bf6-839c190e4d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:44.983603 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f74778-ac56-48b2-8bf6-839c190e4d82 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.983923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f74778-ac56-48b2-8bf6-839c190e4d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.984195 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f74778-ac56-48b2-8bf6-839c190e4d82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.984869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f74778-ac56-48b2-8bf6-839c190e4d82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:44.985166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f74778-ac56-48b2-8bf6-839c190e4d82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:44.986201 dv-cinder-852210-5-smb devstack@keystone.service[81492]: WARNING py.warnings [None req-29f74778-ac56-48b2-8bf6-839c190e4d82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:20:44.986201 dv-cinder-852210-5-smb devstack@keystone.service[81492]: warnings.warn(msg) Aug 31 00:20:44.986201 dv-cinder-852210-5-smb devstack@keystone.service[81492]: Aug 31 00:20:44.987104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f74778-ac56-48b2-8bf6-839c190e4d82 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:44.990243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 778/1548] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:44.991017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa038b57-23f6-4c45-86f4-87a0ea0dc11b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.999390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 771/1549] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:45.000223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa038b57-23f6-4c45-86f4-87a0ea0dc11b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.000722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c432118-1715-4d1b-a1e4-81d7bd1aa09b None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.001014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c432118-1715-4d1b-a1e4-81d7bd1aa09b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.001286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c432118-1715-4d1b-a1e4-81d7bd1aa09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.007990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bf935-a4b0-467b-bafa-d16d04519385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.008595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bf935-a4b0-467b-bafa-d16d04519385 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.008880 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bf935-a4b0-467b-bafa-d16d04519385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.009157 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bf935-a4b0-467b-bafa-d16d04519385 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.009804 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bf935-a4b0-467b-bafa-d16d04519385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:45.010104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bf935-a4b0-467b-bafa-d16d04519385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.011742 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bf935-a4b0-467b-bafa-d16d04519385 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.020746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-2c432118-1715-4d1b-a1e4-81d7bd1aa09b None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:45.021618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2c432118-1715-4d1b-a1e4-81d7bd1aa09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:45.023723 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 779/1550] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:45.025115 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02779053-1165-4c32-8579-bac9d2c110b3 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.025393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02779053-1165-4c32-8579-bac9d2c110b3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.025671 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02779053-1165-4c32-8579-bac9d2c110b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.031173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 772/1551] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:45.031719 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871bd41-ae25-4640-b808-af035f74a01d None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.031988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871bd41-ae25-4640-b808-af035f74a01d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.032264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871bd41-ae25-4640-b808-af035f74a01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.048587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-02779053-1165-4c32-8579-bac9d2c110b3 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:45.049809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-02779053-1165-4c32-8579-bac9d2c110b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:45.054166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-0871bd41-ae25-4640-b808-af035f74a01d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:45.055319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-0871bd41-ae25-4640-b808-af035f74a01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:45.059358 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 780/1552] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:45.060592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7170128-d8e5-4355-a717-8d30692d9cff None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.060886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7170128-d8e5-4355-a717-8d30692d9cff None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.061156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7170128-d8e5-4355-a717-8d30692d9cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.063540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 773/1553] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:45.064873 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444229-96c4-4ef2-a6ae-1fd72d3023bf None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.065159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444229-96c4-4ef2-a6ae-1fd72d3023bf None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.065458 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444229-96c4-4ef2-a6ae-1fd72d3023bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.081112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e7170128-d8e5-4355-a717-8d30692d9cff None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:45.082304 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e7170128-d8e5-4355-a717-8d30692d9cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:45.086146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e6444229-96c4-4ef2-a6ae-1fd72d3023bf None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:45.087007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e6444229-96c4-4ef2-a6ae-1fd72d3023bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:45.091604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 781/1554] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:45.092401 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7170128-d8e5-4355-a717-8d30692d9cff None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.096768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 774/1555] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:45.097852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6444229-96c4-4ef2-a6ae-1fd72d3023bf None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.102121 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7170128-d8e5-4355-a717-8d30692d9cff None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.107020 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd128a-5426-494c-ae0c-8da2a7856ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.107644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd128a-5426-494c-ae0c-8da2a7856ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.107925 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6444229-96c4-4ef2-a6ae-1fd72d3023bf None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.108061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd128a-5426-494c-ae0c-8da2a7856ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.108188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd128a-5426-494c-ae0c-8da2a7856ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.108844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd128a-5426-494c-ae0c-8da2a7856ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:45.109141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd128a-5426-494c-ae0c-8da2a7856ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.110770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd128a-5426-494c-ae0c-8da2a7856ba3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.112530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57362af5-72a4-4bf9-b84c-8ea918d6d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.113137 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57362af5-72a4-4bf9-b84c-8ea918d6d861 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.113421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57362af5-72a4-4bf9-b84c-8ea918d6d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.113691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57362af5-72a4-4bf9-b84c-8ea918d6d861 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.114973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57362af5-72a4-4bf9-b84c-8ea918d6d861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.117047 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57362af5-72a4-4bf9-b84c-8ea918d6d861 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.123265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 782/1556] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:45.124592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd128a-5426-494c-ae0c-8da2a7856ba3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.134279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd128a-5426-494c-ae0c-8da2a7856ba3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.138881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9672e5b-7cb8-4ee0-b0b6-b2d4d5dd6175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.139474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9672e5b-7cb8-4ee0-b0b6-b2d4d5dd6175 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.139813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9672e5b-7cb8-4ee0-b0b6-b2d4d5dd6175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.140109 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9672e5b-7cb8-4ee0-b0b6-b2d4d5dd6175 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.140747 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9672e5b-7cb8-4ee0-b0b6-b2d4d5dd6175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.142018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-f9672e5b-7cb8-4ee0-b0b6-b2d4d5dd6175 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:20:45.142018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 31 00:20:45.142018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: Aug 31 00:20:45.143216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9672e5b-7cb8-4ee0-b0b6-b2d4d5dd6175 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.159782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 775/1557] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.161418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57e09-8195-477e-a723-86dd8c86424c None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.161700 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57e09-8195-477e-a723-86dd8c86424c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.161975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57e09-8195-477e-a723-86dd8c86424c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.180747 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 783/1558] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.181613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9672e5b-7cb8-4ee0-b0b6-b2d4d5dd6175 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.183210 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-8ac57e09-8195-477e-a723-86dd8c86424c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:45.184606 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-8ac57e09-8195-477e-a723-86dd8c86424c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:45.243569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9672e5b-7cb8-4ee0-b0b6-b2d4d5dd6175 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.244298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 776/1559] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:45.245142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac57e09-8195-477e-a723-86dd8c86424c None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.249107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060db39-7157-4f86-afd4-91c70ed5c17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.249799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060db39-7157-4f86-afd4-91c70ed5c17e admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.250083 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060db39-7157-4f86-afd4-91c70ed5c17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.250351 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060db39-7157-4f86-afd4-91c70ed5c17e admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.250998 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060db39-7157-4f86-afd4-91c70ed5c17e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:45.251305 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060db39-7157-4f86-afd4-91c70ed5c17e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.253144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060db39-7157-4f86-afd4-91c70ed5c17e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.254436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac57e09-8195-477e-a723-86dd8c86424c None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.259257 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb23f4-1bf9-4bb9-b3b3-56f0d75bce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.260477 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb23f4-1bf9-4bb9-b3b3-56f0d75bce3a admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.260759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb23f4-1bf9-4bb9-b3b3-56f0d75bce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.261031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb23f4-1bf9-4bb9-b3b3-56f0d75bce3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.261675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb23f4-1bf9-4bb9-b3b3-56f0d75bce3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:45.261972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb23f4-1bf9-4bb9-b3b3-56f0d75bce3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.263549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb23f4-1bf9-4bb9-b3b3-56f0d75bce3a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.265687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 784/1560] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:45.266554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060db39-7157-4f86-afd4-91c70ed5c17e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.275822 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 777/1561] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:45.277052 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95488a0-8b7a-410d-a7e7-888916b8f8ed None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.277334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95488a0-8b7a-410d-a7e7-888916b8f8ed None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.277607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95488a0-8b7a-410d-a7e7-888916b8f8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.282941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060db39-7157-4f86-afd4-91c70ed5c17e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.289362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1a30f-0fcb-4ae2-ae3c-9af7a31d32f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.289983 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1a30f-0fcb-4ae2-ae3c-9af7a31d32f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.290375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1a30f-0fcb-4ae2-ae3c-9af7a31d32f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.290862 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1a30f-0fcb-4ae2-ae3c-9af7a31d32f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.292002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1a30f-0fcb-4ae2-ae3c-9af7a31d32f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:45.292306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1a30f-0fcb-4ae2-ae3c-9af7a31d32f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.293927 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1a30f-0fcb-4ae2-ae3c-9af7a31d32f1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.296689 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-b95488a0-8b7a-410d-a7e7-888916b8f8ed None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:45.297972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b95488a0-8b7a-410d-a7e7-888916b8f8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:45.308843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 785/1562] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:45.309069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 778/1563] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:45.309069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95488a0-8b7a-410d-a7e7-888916b8f8ed None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.309271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1a30f-0fcb-4ae2-ae3c-9af7a31d32f1 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.319892 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95488a0-8b7a-410d-a7e7-888916b8f8ed None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.321669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1a30f-0fcb-4ae2-ae3c-9af7a31d32f1 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.324538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcbbcf-1778-487e-93a9-6a4530485ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.325138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcbbcf-1778-487e-93a9-6a4530485ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.325419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcbbcf-1778-487e-93a9-6a4530485ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.325654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcbbcf-1778-487e-93a9-6a4530485ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.326283 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcbbcf-1778-487e-93a9-6a4530485ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.326764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6f7e6-cfb5-4c89-901a-59fe59cc66b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.327296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: WARNING py.warnings [None req-09dcbbcf-1778-487e-93a9-6a4530485ac7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:20:45.327296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: warnings.warn(msg) Aug 31 00:20:45.327296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: Aug 31 00:20:45.327565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6f7e6-cfb5-4c89-901a-59fe59cc66b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.327649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6f7e6-cfb5-4c89-901a-59fe59cc66b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.327965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6f7e6-cfb5-4c89-901a-59fe59cc66b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.328525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcbbcf-1778-487e-93a9-6a4530485ac7 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.328631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6f7e6-cfb5-4c89-901a-59fe59cc66b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.330483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6f7e6-cfb5-4c89-901a-59fe59cc66b5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.351515 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 779/1564] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.352353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcbbcf-1778-487e-93a9-6a4530485ac7 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.359247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 786/1565] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.360277 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6f7e6-cfb5-4c89-901a-59fe59cc66b5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.364865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcbbcf-1778-487e-93a9-6a4530485ac7 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.386906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:45.395780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:45.429066 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6f7e6-cfb5-4c89-901a-59fe59cc66b5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.432384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b506-bd73-4119-8d74-5315b11a7fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.433082 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b506-bd73-4119-8d74-5315b11a7fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.433285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b506-bd73-4119-8d74-5315b11a7fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.433572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b506-bd73-4119-8d74-5315b11a7fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.434218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45b506-bd73-4119-8d74-5315b11a7fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.434345 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd483495-a5a4-4958-8ebc-3636c7c97080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.434860 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483495-a5a4-4958-8ebc-3636c7c97080 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.435143 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483495-a5a4-4958-8ebc-3636c7c97080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.435418 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483495-a5a4-4958-8ebc-3636c7c97080 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.436131 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd483495-a5a4-4958-8ebc-3636c7c97080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:45.436248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45b506-bd73-4119-8d74-5315b11a7fe6 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.436437 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd483495-a5a4-4958-8ebc-3636c7c97080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.438039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd483495-a5a4-4958-8ebc-3636c7c97080 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.451856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 787/1566] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:45.452893 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd483495-a5a4-4958-8ebc-3636c7c97080 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.461848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 780/1567] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.462747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b506-bd73-4119-8d74-5315b11a7fe6 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.470845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd483495-a5a4-4958-8ebc-3636c7c97080 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.472648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b506-bd73-4119-8d74-5315b11a7fe6 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.476151 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066d8fd-96a0-4045-8b22-a61dfb2100eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.476777 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066d8fd-96a0-4045-8b22-a61dfb2100eb admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.477057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066d8fd-96a0-4045-8b22-a61dfb2100eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.477329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066d8fd-96a0-4045-8b22-a61dfb2100eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.477448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88834dba-4440-401b-8425-b88036931f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.477963 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066d8fd-96a0-4045-8b22-a61dfb2100eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.478080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88834dba-4440-401b-8425-b88036931f35 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.478309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88834dba-4440-401b-8425-b88036931f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.478580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88834dba-4440-401b-8425-b88036931f35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.479263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88834dba-4440-401b-8425-b88036931f35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.479958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066d8fd-96a0-4045-8b22-a61dfb2100eb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.481182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88834dba-4440-401b-8425-b88036931f35 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.511015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 788/1568] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.511015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066d8fd-96a0-4045-8b22-a61dfb2100eb admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.511323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 781/1569] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.511910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88834dba-4440-401b-8425-b88036931f35 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.569343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066d8fd-96a0-4045-8b22-a61dfb2100eb admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.574219 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be6c5d-3167-4c77-8752-36b81a3d5f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.574845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be6c5d-3167-4c77-8752-36b81a3d5f41 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.575144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be6c5d-3167-4c77-8752-36b81a3d5f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.575424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be6c5d-3167-4c77-8752-36b81a3d5f41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.576346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be6c5d-3167-4c77-8752-36b81a3d5f41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:45.576627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88834dba-4440-401b-8425-b88036931f35 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.576733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be6c5d-3167-4c77-8752-36b81a3d5f41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.578311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be6c5d-3167-4c77-8752-36b81a3d5f41 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.581212 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98e8d2-58ac-4e19-ba46-13cc5d66c1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.581827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e8d2-58ac-4e19-ba46-13cc5d66c1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.582102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e8d2-58ac-4e19-ba46-13cc5d66c1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.582373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e8d2-58ac-4e19-ba46-13cc5d66c1d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.583040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98e8d2-58ac-4e19-ba46-13cc5d66c1d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.584994 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98e8d2-58ac-4e19-ba46-13cc5d66c1d2 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.590387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 789/1570] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:45.591216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be6c5d-3167-4c77-8752-36b81a3d5f41 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.603013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be6c5d-3167-4c77-8752-36b81a3d5f41 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.609252 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11947376-2a85-425c-b011-2657237aec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.609915 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11947376-2a85-425c-b011-2657237aec29 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.610191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11947376-2a85-425c-b011-2657237aec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.610455 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11947376-2a85-425c-b011-2657237aec29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.611139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11947376-2a85-425c-b011-2657237aec29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.612861 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11947376-2a85-425c-b011-2657237aec29 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.617212 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 782/1571] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.617212 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98e8d2-58ac-4e19-ba46-13cc5d66c1d2 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.630253 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 790/1572] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:45.630253 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11947376-2a85-425c-b011-2657237aec29 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.638544 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11947376-2a85-425c-b011-2657237aec29 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.682477 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98e8d2-58ac-4e19-ba46-13cc5d66c1d2 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.687479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9547ae-c15a-4ac6-8b17-a6c68ec2b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.688288 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9547ae-c15a-4ac6-8b17-a6c68ec2b476 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.688770 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9547ae-c15a-4ac6-8b17-a6c68ec2b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.689476 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9547ae-c15a-4ac6-8b17-a6c68ec2b476 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.690264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9547ae-c15a-4ac6-8b17-a6c68ec2b476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.692257 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9547ae-c15a-4ac6-8b17-a6c68ec2b476 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.699146 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c918300-560c-4ed7-89f4-c21f8b9ec335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.699882 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c918300-560c-4ed7-89f4-c21f8b9ec335 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.700185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c918300-560c-4ed7-89f4-c21f8b9ec335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.700464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c918300-560c-4ed7-89f4-c21f8b9ec335 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.701239 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c918300-560c-4ed7-89f4-c21f8b9ec335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.708272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c918300-560c-4ed7-89f4-c21f8b9ec335 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.720153 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 783/1573] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.720153 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9547ae-c15a-4ac6-8b17-a6c68ec2b476 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.729717 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9547ae-c15a-4ac6-8b17-a6c68ec2b476 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.734567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438b30b-09e5-4ac1-815e-dcbbb3188a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.735226 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438b30b-09e5-4ac1-815e-dcbbb3188a01 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.735501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438b30b-09e5-4ac1-815e-dcbbb3188a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.735804 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438b30b-09e5-4ac1-815e-dcbbb3188a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.736447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438b30b-09e5-4ac1-815e-dcbbb3188a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.738078 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438b30b-09e5-4ac1-815e-dcbbb3188a01 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.743562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 791/1574] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.743562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c918300-560c-4ed7-89f4-c21f8b9ec335 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.746061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:45.753402 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 784/1575] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:45.754224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438b30b-09e5-4ac1-815e-dcbbb3188a01 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.761294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:45.765747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438b30b-09e5-4ac1-815e-dcbbb3188a01 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.809208 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c918300-560c-4ed7-89f4-c21f8b9ec335 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.814037 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f94cb-1e82-43ce-aca3-e3bd63eb5b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.814651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f94cb-1e82-43ce-aca3-e3bd63eb5b52 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.814927 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f94cb-1e82-43ce-aca3-e3bd63eb5b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.815208 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f94cb-1e82-43ce-aca3-e3bd63eb5b52 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.815889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f94cb-1e82-43ce-aca3-e3bd63eb5b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.819023 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f94cb-1e82-43ce-aca3-e3bd63eb5b52 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.824545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c817763-8968-498d-96f9-c5bfd63a1ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.825197 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c817763-8968-498d-96f9-c5bfd63a1ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.825469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c817763-8968-498d-96f9-c5bfd63a1ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.825734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c817763-8968-498d-96f9-c5bfd63a1ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.826377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c817763-8968-498d-96f9-c5bfd63a1ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.828383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c817763-8968-498d-96f9-c5bfd63a1ca0 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.849107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 792/1576] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.850546 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f94cb-1e82-43ce-aca3-e3bd63eb5b52 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.853494 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 785/1577] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.854580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c817763-8968-498d-96f9-c5bfd63a1ca0 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.860671 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f94cb-1e82-43ce-aca3-e3bd63eb5b52 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.865632 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9983cf-7b24-4625-8f9c-3c70e02f13aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.866015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c817763-8968-498d-96f9-c5bfd63a1ca0 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.866251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9983cf-7b24-4625-8f9c-3c70e02f13aa admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.866585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9983cf-7b24-4625-8f9c-3c70e02f13aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.866951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9983cf-7b24-4625-8f9c-3c70e02f13aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.867612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9983cf-7b24-4625-8f9c-3c70e02f13aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.869569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9983cf-7b24-4625-8f9c-3c70e02f13aa admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.872596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23293f18-a5fe-4e66-a05d-eaab2959ccee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.873210 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23293f18-a5fe-4e66-a05d-eaab2959ccee admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.873491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23293f18-a5fe-4e66-a05d-eaab2959ccee admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.873761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23293f18-a5fe-4e66-a05d-eaab2959ccee admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.874392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23293f18-a5fe-4e66-a05d-eaab2959ccee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.876367 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23293f18-a5fe-4e66-a05d-eaab2959ccee admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.909227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 786/1578] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.910534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 793/1579] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/projects => generated 405 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.910664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23293f18-a5fe-4e66-a05d-eaab2959ccee admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.911961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9983cf-7b24-4625-8f9c-3c70e02f13aa admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.925329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23293f18-a5fe-4e66-a05d-eaab2959ccee admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.983781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9983cf-7b24-4625-8f9c-3c70e02f13aa admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.985614 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e17cd-ad49-4f22-98fa-822064d1310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.986209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e17cd-ad49-4f22-98fa-822064d1310f admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.986486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e17cd-ad49-4f22-98fa-822064d1310f admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.986756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e17cd-ad49-4f22-98fa-822064d1310f admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.987398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e17cd-ad49-4f22-98fa-822064d1310f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.988582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9d792-f2c0-4368-aa55-5117b1a6d11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.989051 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e17cd-ad49-4f22-98fa-822064d1310f admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.989190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9d792-f2c0-4368-aa55-5117b1a6d11a admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.989470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9d792-f2c0-4368-aa55-5117b1a6d11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.989734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9d792-f2c0-4368-aa55-5117b1a6d11a admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.990372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9d792-f2c0-4368-aa55-5117b1a6d11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.992245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9d792-f2c0-4368-aa55-5117b1a6d11a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.006202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 787/1580] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.006202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e17cd-ad49-4f22-98fa-822064d1310f admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.006518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 794/1581] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.006518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9d792-f2c0-4368-aa55-5117b1a6d11a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.014009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e17cd-ad49-4f22-98fa-822064d1310f admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.017266 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9d792-f2c0-4368-aa55-5117b1a6d11a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.018843 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb393a2f-a14e-475f-ae81-61e654965c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.019445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb393a2f-a14e-475f-ae81-61e654965c3b admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.019735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb393a2f-a14e-475f-ae81-61e654965c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.020005 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb393a2f-a14e-475f-ae81-61e654965c3b admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.020633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb393a2f-a14e-475f-ae81-61e654965c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.022541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74b401-036c-42d0-a846-f69bc594db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.022663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb393a2f-a14e-475f-ae81-61e654965c3b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.023216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74b401-036c-42d0-a846-f69bc594db0b admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.023517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74b401-036c-42d0-a846-f69bc594db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.023832 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74b401-036c-42d0-a846-f69bc594db0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.024495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74b401-036c-42d0-a846-f69bc594db0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.026126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74b401-036c-42d0-a846-f69bc594db0b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.037985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 795/1582] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.038957 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74b401-036c-42d0-a846-f69bc594db0b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.050120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74b401-036c-42d0-a846-f69bc594db0b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.053947 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 788/1583] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:46 2022] POST /identity/v3/users => generated 293 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:46.054831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb393a2f-a14e-475f-ae81-61e654965c3b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.056065 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1540ac-3aed-420a-b47a-93643dfdceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.056689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1540ac-3aed-420a-b47a-93643dfdceec admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.057255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1540ac-3aed-420a-b47a-93643dfdceec admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.057371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1540ac-3aed-420a-b47a-93643dfdceec admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.058028 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1540ac-3aed-420a-b47a-93643dfdceec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.060757 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1540ac-3aed-420a-b47a-93643dfdceec admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.066705 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb393a2f-a14e-475f-ae81-61e654965c3b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.075062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 796/1584] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.075062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1540ac-3aed-420a-b47a-93643dfdceec admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.076959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ed729-3fe8-42c1-bb06-0828196a160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.077576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ed729-3fe8-42c1-bb06-0828196a160b admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.077852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ed729-3fe8-42c1-bb06-0828196a160b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.078092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ed729-3fe8-42c1-bb06-0828196a160b admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.078729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ed729-3fe8-42c1-bb06-0828196a160b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.080401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ed729-3fe8-42c1-bb06-0828196a160b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.083865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1540ac-3aed-420a-b47a-93643dfdceec admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.088569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4782c57-883c-4920-9d9c-22fddb05611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.089505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4782c57-883c-4920-9d9c-22fddb05611d admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.089965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4782c57-883c-4920-9d9c-22fddb05611d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.090431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4782c57-883c-4920-9d9c-22fddb05611d admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.091491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 789/1585] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.091854 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4782c57-883c-4920-9d9c-22fddb05611d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.092352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ed729-3fe8-42c1-bb06-0828196a160b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.093790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4782c57-883c-4920-9d9c-22fddb05611d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.106839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 797/1586] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.106839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4782c57-883c-4920-9d9c-22fddb05611d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.111277 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ed729-3fe8-42c1-bb06-0828196a160b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.115983 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae24c6-a104-49ce-9d0a-a5ad7bd813c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.116655 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae24c6-a104-49ce-9d0a-a5ad7bd813c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.116932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae24c6-a104-49ce-9d0a-a5ad7bd813c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.117203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae24c6-a104-49ce-9d0a-a5ad7bd813c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.117843 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae24c6-a104-49ce-9d0a-a5ad7bd813c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.118107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4782c57-883c-4920-9d9c-22fddb05611d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.119847 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae24c6-a104-49ce-9d0a-a5ad7bd813c2 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.123674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78eb01-e54b-4957-883f-86c45ce83c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.124400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78eb01-e54b-4957-883f-86c45ce83c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.124705 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78eb01-e54b-4957-883f-86c45ce83c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.124969 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78eb01-e54b-4957-883f-86c45ce83c02 admin admin] PATH_INFO: `/v3/projects/7dd18e5fbcf34c0a84619d1813de23a2/users/e7976ce7465549e0a1a70bf7aeb48f55/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.143876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78eb01-e54b-4957-883f-86c45ce83c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd18e5fbcf34c0a84619d1813de23a2, user_id=e7976ce7465549e0a1a70bf7aeb48f55, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.144993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-de78eb01-e54b-4957-883f-86c45ce83c02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:20:46.144993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 31 00:20:46.144993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: Aug 31 00:20:46.146849 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 790/1587] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:46 2022] POST /identity/v3/users => generated 303 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:46.146999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78eb01-e54b-4957-883f-86c45ce83c02 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.148596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae24c6-a104-49ce-9d0a-a5ad7bd813c2 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.161282 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae24c6-a104-49ce-9d0a-a5ad7bd813c2 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.166629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 798/1588] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:46 2022] PUT /identity/v3/projects/7dd18e5fbcf34c0a84619d1813de23a2/users/e7976ce7465549e0a1a70bf7aeb48f55/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:46.172792 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78eb01-e54b-4957-883f-86c45ce83c02 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.186713 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:46.190636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:46.228944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70456bf5-6ca5-4cc5-bafb-87e44389fae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.229633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70456bf5-6ca5-4cc5-bafb-87e44389fae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.229906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70456bf5-6ca5-4cc5-bafb-87e44389fae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.230186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70456bf5-6ca5-4cc5-bafb-87e44389fae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.230976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70456bf5-6ca5-4cc5-bafb-87e44389fae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.232738 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70456bf5-6ca5-4cc5-bafb-87e44389fae3 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.240126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78eb01-e54b-4957-883f-86c45ce83c02 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.243307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 791/1589] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.244177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70456bf5-6ca5-4cc5-bafb-87e44389fae3 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.244897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0c6f7-156f-43fc-b5b0-0726dd535110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.245656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0c6f7-156f-43fc-b5b0-0726dd535110 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.245939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0c6f7-156f-43fc-b5b0-0726dd535110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.246215 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0c6f7-156f-43fc-b5b0-0726dd535110 admin admin] PATH_INFO: `/v3/projects/e7ba4e79b364426d834f7cd34d84cd17/users/f73759f32c794f20bbab3a9887c9d37c/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.255280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70456bf5-6ca5-4cc5-bafb-87e44389fae3 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.260055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19700667-66d8-4658-b473-a3eb25bff9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.260686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19700667-66d8-4658-b473-a3eb25bff9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.260968 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19700667-66d8-4658-b473-a3eb25bff9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.261242 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19700667-66d8-4658-b473-a3eb25bff9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.261890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19700667-66d8-4658-b473-a3eb25bff9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.262113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0c6f7-156f-43fc-b5b0-0726dd535110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ba4e79b364426d834f7cd34d84cd17, user_id=f73759f32c794f20bbab3a9887c9d37c, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.263521 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19700667-66d8-4658-b473-a3eb25bff9c9 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.264835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0c6f7-156f-43fc-b5b0-0726dd535110 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.274929 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 792/1590] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.279753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19700667-66d8-4658-b473-a3eb25bff9c9 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.280131 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 799/1591] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:46 2022] PUT /identity/v3/projects/e7ba4e79b364426d834f7cd34d84cd17/users/f73759f32c794f20bbab3a9887c9d37c/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:46.280940 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0c6f7-156f-43fc-b5b0-0726dd535110 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.291623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19700667-66d8-4658-b473-a3eb25bff9c9 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.347958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0c6f7-156f-43fc-b5b0-0726dd535110 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.350636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7ea9b-f6ff-4915-9ff2-aade3bc423b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.351323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7ea9b-f6ff-4915-9ff2-aade3bc423b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.351570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7ea9b-f6ff-4915-9ff2-aade3bc423b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.351965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7ea9b-f6ff-4915-9ff2-aade3bc423b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.352596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccaa943-abfa-4587-afea-c4b2afb8c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.352848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7ea9b-f6ff-4915-9ff2-aade3bc423b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.353201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccaa943-abfa-4587-afea-c4b2afb8c305 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.353480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccaa943-abfa-4587-afea-c4b2afb8c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.353752 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccaa943-abfa-4587-afea-c4b2afb8c305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.354196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7ea9b-f6ff-4915-9ff2-aade3bc423b8 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.354358 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccaa943-abfa-4587-afea-c4b2afb8c305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.356026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccaa943-abfa-4587-afea-c4b2afb8c305 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.369291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 800/1593] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.369500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 793/1593] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.369614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccaa943-abfa-4587-afea-c4b2afb8c305 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.369716 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7ea9b-f6ff-4915-9ff2-aade3bc423b8 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.379690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccaa943-abfa-4587-afea-c4b2afb8c305 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.381540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7ea9b-f6ff-4915-9ff2-aade3bc423b8 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.386256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b3a73-74ab-4101-ad38-8c2b8a1bba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.386872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b3a73-74ab-4101-ad38-8c2b8a1bba06 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.387149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b3a73-74ab-4101-ad38-8c2b8a1bba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.387352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587585d-10d3-4ecd-8724-28837ae5e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.387483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b3a73-74ab-4101-ad38-8c2b8a1bba06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.388023 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587585d-10d3-4ecd-8724-28837ae5e8cd admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.388133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b3a73-74ab-4101-ad38-8c2b8a1bba06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.388303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587585d-10d3-4ecd-8724-28837ae5e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.388572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587585d-10d3-4ecd-8724-28837ae5e8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.389218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587585d-10d3-4ecd-8724-28837ae5e8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.389805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b3a73-74ab-4101-ad38-8c2b8a1bba06 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.390852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587585d-10d3-4ecd-8724-28837ae5e8cd admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.402731 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 794/1594] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.403464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 801/1595] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.404373 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b3a73-74ab-4101-ad38-8c2b8a1bba06 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.405115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214a88a-ac67-4037-9bd6-5ee17ba82b64 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.405621 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214a88a-ac67-4037-9bd6-5ee17ba82b64 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.406058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214a88a-ac67-4037-9bd6-5ee17ba82b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.415517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b3a73-74ab-4101-ad38-8c2b8a1bba06 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.423289 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7009f-fc0f-4d0a-9e96-ee8badcb975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.424209 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7009f-fc0f-4d0a-9e96-ee8badcb975f admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.424501 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7009f-fc0f-4d0a-9e96-ee8badcb975f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.424790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7009f-fc0f-4d0a-9e96-ee8badcb975f admin admin] PATH_INFO: `/v3/projects/11f0a399ab21448799c78878e175336e/users/27016a2b993e4cd69c89f8f49b3c5a84/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.441168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7009f-fc0f-4d0a-9e96-ee8badcb975f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f0a399ab21448799c78878e175336e, user_id=27016a2b993e4cd69c89f8f49b3c5a84, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.442245 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e214a88a-ac67-4037-9bd6-5ee17ba82b64 None None] MFA Rules not processed for user `e7976ce7465549e0a1a70bf7aeb48f55`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:46.443486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e214a88a-ac67-4037-9bd6-5ee17ba82b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:46.443843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7009f-fc0f-4d0a-9e96-ee8badcb975f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.458827 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 802/1596] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:46 2022] PUT /identity/v3/projects/11f0a399ab21448799c78878e175336e/users/27016a2b993e4cd69c89f8f49b3c5a84/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:46.459659 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7009f-fc0f-4d0a-9e96-ee8badcb975f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.511898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 795/1597] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:46.513078 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782658-7066-4dd5-9952-5cc22b968d66 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.513400 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782658-7066-4dd5-9952-5cc22b968d66 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.513694 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782658-7066-4dd5-9952-5cc22b968d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.525552 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:46.531646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7009f-fc0f-4d0a-9e96-ee8badcb975f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.534697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-3a782658-7066-4dd5-9952-5cc22b968d66 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:46.536356 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3a782658-7066-4dd5-9952-5cc22b968d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:46.537694 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9355742-0b5b-4266-9c3c-326ca54d50b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.538613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355742-0b5b-4266-9c3c-326ca54d50b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.539104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355742-0b5b-4266-9c3c-326ca54d50b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.539674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355742-0b5b-4266-9c3c-326ca54d50b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.540822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9355742-0b5b-4266-9c3c-326ca54d50b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.542679 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9355742-0b5b-4266-9c3c-326ca54d50b1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.548236 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 796/1598] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:46.549233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a782658-7066-4dd5-9952-5cc22b968d66 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.556614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 803/1599] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.557532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9355742-0b5b-4266-9c3c-326ca54d50b1 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.564159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a782658-7066-4dd5-9952-5cc22b968d66 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.569161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76384e6-da95-46eb-9c40-8fdb2152fe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.569924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76384e6-da95-46eb-9c40-8fdb2152fe42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.570121 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9355742-0b5b-4266-9c3c-326ca54d50b1 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.570242 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76384e6-da95-46eb-9c40-8fdb2152fe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.570479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76384e6-da95-46eb-9c40-8fdb2152fe42 admin admin] PATH_INFO: `/v3/projects/15e73c3a609b4314a4ae2437ad21333d/users/7b05f63c8a054e6dbfe70a70c50805cf/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.581842 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4d950-f12e-4644-8bc2-4d6f2c8b5cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.586661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4d950-f12e-4644-8bc2-4d6f2c8b5cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.587119 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4d950-f12e-4644-8bc2-4d6f2c8b5cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.587264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76384e6-da95-46eb-9c40-8fdb2152fe42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e73c3a609b4314a4ae2437ad21333d, user_id=7b05f63c8a054e6dbfe70a70c50805cf, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.587643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4d950-f12e-4644-8bc2-4d6f2c8b5cfb admin admin] PATH_INFO: `/v3/projects/1b34732c9fe14bcb98ec19ac2620ade0/users/f2154c0f8d4b44e688aefc064dca64d7/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.590120 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76384e6-da95-46eb-9c40-8fdb2152fe42 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.593303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:46.603657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4d950-f12e-4644-8bc2-4d6f2c8b5cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b34732c9fe14bcb98ec19ac2620ade0, user_id=f2154c0f8d4b44e688aefc064dca64d7, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.605705 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 797/1600] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:46 2022] PUT /identity/v3/projects/15e73c3a609b4314a4ae2437ad21333d/users/7b05f63c8a054e6dbfe70a70c50805cf/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:46.606440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4d950-f12e-4644-8bc2-4d6f2c8b5cfb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.606799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76384e6-da95-46eb-9c40-8fdb2152fe42 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.623682 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 804/1601] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:46 2022] PUT /identity/v3/projects/1b34732c9fe14bcb98ec19ac2620ade0/users/f2154c0f8d4b44e688aefc064dca64d7/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:46.632724 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4d950-f12e-4644-8bc2-4d6f2c8b5cfb admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.671210 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76384e6-da95-46eb-9c40-8fdb2152fe42 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.709178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4d950-f12e-4644-8bc2-4d6f2c8b5cfb admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.719281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd115c-5139-4d66-91e9-619fcedab216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.719936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd115c-5139-4d66-91e9-619fcedab216 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.720212 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd115c-5139-4d66-91e9-619fcedab216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.720486 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd115c-5139-4d66-91e9-619fcedab216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.721124 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd115c-5139-4d66-91e9-619fcedab216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.722730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd115c-5139-4d66-91e9-619fcedab216 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.733450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 805/1602] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.735169 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d325c0d-fe7d-4abe-a048-be881e66b133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.735895 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d325c0d-fe7d-4abe-a048-be881e66b133 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.736178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d325c0d-fe7d-4abe-a048-be881e66b133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.736450 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d325c0d-fe7d-4abe-a048-be881e66b133 admin admin] PATH_INFO: `/v3/projects/2899e565da2f4eac90b470fadf5792e6/users/0ae3ab8ab42b40739a90121bcbeaba2c/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.737292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375917b7-af2d-47c4-8341-f41de7da60ca None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.741539 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375917b7-af2d-47c4-8341-f41de7da60ca None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.741539 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375917b7-af2d-47c4-8341-f41de7da60ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.752007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d325c0d-fe7d-4abe-a048-be881e66b133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2899e565da2f4eac90b470fadf5792e6, user_id=0ae3ab8ab42b40739a90121bcbeaba2c, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.754846 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d325c0d-fe7d-4abe-a048-be881e66b133 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.760437 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-375917b7-af2d-47c4-8341-f41de7da60ca None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:46.762273 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-375917b7-af2d-47c4-8341-f41de7da60ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:46.774721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 798/1603] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:46 2022] PUT /identity/v3/projects/2899e565da2f4eac90b470fadf5792e6/users/0ae3ab8ab42b40739a90121bcbeaba2c/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:46.776228 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40054af8-e021-47d4-aa25-3e75f6d19688 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.776511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40054af8-e021-47d4-aa25-3e75f6d19688 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.776781 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40054af8-e021-47d4-aa25-3e75f6d19688 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.778011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 799/1604] 10.222.0.50 () {54 vars in 962 bytes} [Wed Aug 31 00:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:20:46.778916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40054af8-e021-47d4-aa25-3e75f6d19688 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.832477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 806/1605] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:46.833348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375917b7-af2d-47c4-8341-f41de7da60ca None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.856628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40054af8-e021-47d4-aa25-3e75f6d19688 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.861666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11171f86-815f-42e2-856e-7aa7b774c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.862539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11171f86-815f-42e2-856e-7aa7b774c591 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.862812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11171f86-815f-42e2-856e-7aa7b774c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.863084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11171f86-815f-42e2-856e-7aa7b774c591 admin admin] PATH_INFO: `/v3/projects/ec9c4e090047403a802aee0fc48a8c47/users/1aeead6fcbc54b39826b5da033dd9d5f/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.877567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11171f86-815f-42e2-856e-7aa7b774c591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9c4e090047403a802aee0fc48a8c47, user_id=1aeead6fcbc54b39826b5da033dd9d5f, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.880248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11171f86-815f-42e2-856e-7aa7b774c591 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.888193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375917b7-af2d-47c4-8341-f41de7da60ca None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.893828 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 800/1606] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:46 2022] PUT /identity/v3/projects/ec9c4e090047403a802aee0fc48a8c47/users/1aeead6fcbc54b39826b5da033dd9d5f/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:46.895207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623039d-34e7-4596-921f-fce1d5c27873 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.895492 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623039d-34e7-4596-921f-fce1d5c27873 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.895797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623039d-34e7-4596-921f-fce1d5c27873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.905527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:46.914836 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-6623039d-34e7-4596-921f-fce1d5c27873 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:46.916185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6623039d-34e7-4596-921f-fce1d5c27873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:46.920244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:46.942059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d9240-cb10-4e65-b31d-7c23e646af5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.942761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d9240-cb10-4e65-b31d-7c23e646af5a service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.943378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d9240-cb10-4e65-b31d-7c23e646af5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.943598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d9240-cb10-4e65-b31d-7c23e646af5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.987632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 801/1607] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:46.988945 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b41ae7-db1e-4123-9fc8-b3f84da4f065 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.989205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b41ae7-db1e-4123-9fc8-b3f84da4f065 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.989473 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b41ae7-db1e-4123-9fc8-b3f84da4f065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.011028 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d9240-cb10-4e65-b31d-7c23e646af5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.012531 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d9240-cb10-4e65-b31d-7c23e646af5a service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.020239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-70b41ae7-db1e-4123-9fc8-b3f84da4f065 None None] MFA Rules not processed for user `f2154c0f8d4b44e688aefc064dca64d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:47.021481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-70b41ae7-db1e-4123-9fc8-b3f84da4f065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:47.022190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 807/1608] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:47.023052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d9240-cb10-4e65-b31d-7c23e646af5a service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.032219 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d9240-cb10-4e65-b31d-7c23e646af5a service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.039405 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed160f-754e-448c-a30c-06587744ef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.040262 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed160f-754e-448c-a30c-06587744ef73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.040542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed160f-754e-448c-a30c-06587744ef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.040911 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed160f-754e-448c-a30c-06587744ef73 admin admin] PATH_INFO: `/v3/projects/7e2153c52a074cbaa057d66c5314b054/users/240514b7499042c688c7ed026d4c4c99/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.058138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed160f-754e-448c-a30c-06587744ef73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2153c52a074cbaa057d66c5314b054, user_id=240514b7499042c688c7ed026d4c4c99, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.060874 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed160f-754e-448c-a30c-06587744ef73 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.075669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 808/1609] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:47 2022] PUT /identity/v3/projects/7e2153c52a074cbaa057d66c5314b054/users/240514b7499042c688c7ed026d4c4c99/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:47.077268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721da9b-4938-4b5b-b6d5-78d3c3f5ae64 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.077554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721da9b-4938-4b5b-b6d5-78d3c3f5ae64 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.077828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721da9b-4938-4b5b-b6d5-78d3c3f5ae64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.097236 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b721da9b-4938-4b5b-b6d5-78d3c3f5ae64 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:47.098477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b721da9b-4938-4b5b-b6d5-78d3c3f5ae64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:47.100492 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 802/1610] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:47.102215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d69310-5a42-4256-9cad-14990a11784c None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.102694 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d69310-5a42-4256-9cad-14990a11784c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.103129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d69310-5a42-4256-9cad-14990a11784c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.152452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-c5d69310-5a42-4256-9cad-14990a11784c None None] MFA Rules not processed for user `cb9ef38ec3b448828826de5f76a552d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:47.153166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c5d69310-5a42-4256-9cad-14990a11784c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:47.178889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 809/1611] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:47.180167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721da9b-4938-4b5b-b6d5-78d3c3f5ae64 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.234995 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 803/1612] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Aug 31 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:47.237981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854afc5-ef94-4517-a7ab-01441f241715 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.238263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854afc5-ef94-4517-a7ab-01441f241715 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.238535 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854afc5-ef94-4517-a7ab-01441f241715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.241634 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:47.249886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721da9b-4938-4b5b-b6d5-78d3c3f5ae64 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.254587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a2001-410d-4d39-b67b-e8912c22e8a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.255430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a2001-410d-4d39-b67b-e8912c22e8a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.255814 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a2001-410d-4d39-b67b-e8912c22e8a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.256209 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a2001-410d-4d39-b67b-e8912c22e8a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.262028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-1854afc5-ef94-4517-a7ab-01441f241715 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:47.263255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-1854afc5-ef94-4517-a7ab-01441f241715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:47.267278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a2001-410d-4d39-b67b-e8912c22e8a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.272370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a2001-410d-4d39-b67b-e8912c22e8a6 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.272542 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 804/1613] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:47.272989 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854afc5-ef94-4517-a7ab-01441f241715 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.282182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 810/1614] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:47.283840 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53663e-79b2-4e00-9db4-4f6403795051 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.284245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53663e-79b2-4e00-9db4-4f6403795051 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.284374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53663e-79b2-4e00-9db4-4f6403795051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.285907 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854afc5-ef94-4517-a7ab-01441f241715 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.290025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1aa4bc-304a-4986-9a8c-1cc0fe1a810d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.290657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aa4bc-304a-4986-9a8c-1cc0fe1a810d service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.290920 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aa4bc-304a-4986-9a8c-1cc0fe1a810d service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.291190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aa4bc-304a-4986-9a8c-1cc0fe1a810d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.301151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1aa4bc-304a-4986-9a8c-1cc0fe1a810d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.302970 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1aa4bc-304a-4986-9a8c-1cc0fe1a810d service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.305911 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-af53663e-79b2-4e00-9db4-4f6403795051 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:47.307294 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-af53663e-79b2-4e00-9db4-4f6403795051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:47.307664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:47.315593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 805/1615] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:47.316303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 811/1616] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:47.316672 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1aa4bc-304a-4986-9a8c-1cc0fe1a810d service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.317430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53663e-79b2-4e00-9db4-4f6403795051 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.327774 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53663e-79b2-4e00-9db4-4f6403795051 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.330030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1aa4bc-304a-4986-9a8c-1cc0fe1a810d service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.332112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90872b-8dad-4d72-b407-0a804331ac51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.332870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90872b-8dad-4d72-b407-0a804331ac51 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.333217 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90872b-8dad-4d72-b407-0a804331ac51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.333492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90872b-8dad-4d72-b407-0a804331ac51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.335509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0df73-2fe9-4aa9-a7f2-c3eba5206c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.336258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0df73-2fe9-4aa9-a7f2-c3eba5206c77 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.336608 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0df73-2fe9-4aa9-a7f2-c3eba5206c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.336972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0df73-2fe9-4aa9-a7f2-c3eba5206c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.337719 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0df73-2fe9-4aa9-a7f2-c3eba5206c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.339729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0df73-2fe9-4aa9-a7f2-c3eba5206c77 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.347034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90872b-8dad-4d72-b407-0a804331ac51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.348619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90872b-8dad-4d72-b407-0a804331ac51 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.361091 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 812/1617] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:47.362036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90872b-8dad-4d72-b407-0a804331ac51 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.377474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90872b-8dad-4d72-b407-0a804331ac51 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.377808 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 806/1618] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:47 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:47.378906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0df73-2fe9-4aa9-a7f2-c3eba5206c77 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.463951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0df73-2fe9-4aa9-a7f2-c3eba5206c77 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.467852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e60e0-74c0-4210-bffe-2c57cfe2f0dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.468462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e60e0-74c0-4210-bffe-2c57cfe2f0dd service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.468716 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e60e0-74c0-4210-bffe-2c57cfe2f0dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.468922 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52170232-9387-4115-95cd-2817ba82f4f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.469061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e60e0-74c0-4210-bffe-2c57cfe2f0dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.470123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52170232-9387-4115-95cd-2817ba82f4f6 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.470478 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52170232-9387-4115-95cd-2817ba82f4f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.470818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52170232-9387-4115-95cd-2817ba82f4f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.555505 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e60e0-74c0-4210-bffe-2c57cfe2f0dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.562726 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e60e0-74c0-4210-bffe-2c57cfe2f0dd service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.583408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 807/1619] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:47.584317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e60e0-74c0-4210-bffe-2c57cfe2f0dd service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.606934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e60e0-74c0-4210-bffe-2c57cfe2f0dd service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.608549 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52170232-9387-4115-95cd-2817ba82f4f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.610197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52170232-9387-4115-95cd-2817ba82f4f6 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.618361 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d1a28-3855-4b1e-8ccd-0ccc20baa672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.619048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1a28-3855-4b1e-8ccd-0ccc20baa672 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.619362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1a28-3855-4b1e-8ccd-0ccc20baa672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.619663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1a28-3855-4b1e-8ccd-0ccc20baa672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.629818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 813/1620] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:47.630802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52170232-9387-4115-95cd-2817ba82f4f6 service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.638536 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d1a28-3855-4b1e-8ccd-0ccc20baa672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.640294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d1a28-3855-4b1e-8ccd-0ccc20baa672 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.651125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 808/1621] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:47.655322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52170232-9387-4115-95cd-2817ba82f4f6 service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.662569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92465c-e1c9-4f47-b62a-3bf18727cdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.663406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92465c-e1c9-4f47-b62a-3bf18727cdb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.663727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92465c-e1c9-4f47-b62a-3bf18727cdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.663983 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92465c-e1c9-4f47-b62a-3bf18727cdb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.664630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92465c-e1c9-4f47-b62a-3bf18727cdb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.667943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92465c-e1c9-4f47-b62a-3bf18727cdb0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.714037 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 814/1622] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:47 2022] POST /identity/v3/users => generated 296 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:47.718019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d1a28-3855-4b1e-8ccd-0ccc20baa672 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.729710 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d1a28-3855-4b1e-8ccd-0ccc20baa672 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.735865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315fd3d-6fc0-4156-acc2-7aed91a2939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.736584 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315fd3d-6fc0-4156-acc2-7aed91a2939c admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.737003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315fd3d-6fc0-4156-acc2-7aed91a2939c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.737730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315fd3d-6fc0-4156-acc2-7aed91a2939c admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.738537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315fd3d-6fc0-4156-acc2-7aed91a2939c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.740786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315fd3d-6fc0-4156-acc2-7aed91a2939c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.753251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 809/1623] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:47.757382 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92465c-e1c9-4f47-b62a-3bf18727cdb0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.772782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92465c-e1c9-4f47-b62a-3bf18727cdb0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.780648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fbbf9-33dd-4f89-808c-213c4184c434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.781933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fbbf9-33dd-4f89-808c-213c4184c434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.782619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fbbf9-33dd-4f89-808c-213c4184c434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.783256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fbbf9-33dd-4f89-808c-213c4184c434 admin admin] PATH_INFO: `/v3/projects/216ceded9fd24214b217e3e244608b3b/users/00fc081664f7472ba7dee2cca28aa741/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.818747 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fbbf9-33dd-4f89-808c-213c4184c434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216ceded9fd24214b217e3e244608b3b, user_id=00fc081664f7472ba7dee2cca28aa741, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.826472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fbbf9-33dd-4f89-808c-213c4184c434 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.863589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315fd3d-6fc0-4156-acc2-7aed91a2939c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.866826 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 815/1624] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:47 2022] PUT /identity/v3/projects/216ceded9fd24214b217e3e244608b3b/users/00fc081664f7472ba7dee2cca28aa741/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:47.890093 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315fd3d-6fc0-4156-acc2-7aed91a2939c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:48.029214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df72052-b966-4ecd-8e2d-1e375b6bba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:48.031406 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df72052-b966-4ecd-8e2d-1e375b6bba2b admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:48.032061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df72052-b966-4ecd-8e2d-1e375b6bba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:48.033034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df72052-b966-4ecd-8e2d-1e375b6bba2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:48.034428 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df72052-b966-4ecd-8e2d-1e375b6bba2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:48.037921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df72052-b966-4ecd-8e2d-1e375b6bba2b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:48.043552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:48.058235 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 810/1625] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:48.062942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fbbf9-33dd-4f89-808c-213c4184c434 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:48.076147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fbbf9-33dd-4f89-808c-213c4184c434 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:48.082882 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6b4c7-fabc-457b-90b5-0265ce4d632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:48.083777 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6b4c7-fabc-457b-90b5-0265ce4d632e admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:48.084106 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6b4c7-fabc-457b-90b5-0265ce4d632e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:48.084374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6b4c7-fabc-457b-90b5-0265ce4d632e admin admin] PATH_INFO: `/v3/projects/216ceded9fd24214b217e3e244608b3b/users/00fc081664f7472ba7dee2cca28aa741/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:48.087533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6b4c7-fabc-457b-90b5-0265ce4d632e admin admin] RBAC: Authorizing `identity:create_grant(project_id=216ceded9fd24214b217e3e244608b3b, user_id=00fc081664f7472ba7dee2cca28aa741, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:48.091342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6b4c7-fabc-457b-90b5-0265ce4d632e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:48.115076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 816/1626] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:48 2022] PUT /identity/v3/projects/216ceded9fd24214b217e3e244608b3b/users/00fc081664f7472ba7dee2cca28aa741/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:48.117025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffc38a-3aa0-440b-a30b-9c394568b0b8 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:48.117311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffc38a-3aa0-440b-a30b-9c394568b0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:48.117584 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffc38a-3aa0-440b-a30b-9c394568b0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:48.156297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-d2ffc38a-3aa0-440b-a30b-9c394568b0b8 None None] MFA Rules not processed for user `00fc081664f7472ba7dee2cca28aa741`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:48.158519 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d2ffc38a-3aa0-440b-a30b-9c394568b0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:48.335483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 811/1627] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:48.345679 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6b4c7-fabc-457b-90b5-0265ce4d632e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:48.364465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522068c-bc6b-4724-b920-56511df51743 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:48.365192 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522068c-bc6b-4724-b920-56511df51743 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:48.365474 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522068c-bc6b-4724-b920-56511df51743 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:48.366920 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 812/1628] 10.222.0.50 () {54 vars in 962 bytes} [Wed Aug 31 00:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:20:48.374955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:48.379196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f9c02-9c29-4edc-9510-48f1667bef1f None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:48.379454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f9c02-9c29-4edc-9510-48f1667bef1f None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:48.379557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f9c02-9c29-4edc-9510-48f1667bef1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:48.424341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-325f9c02-9c29-4edc-9510-48f1667bef1f None None] MFA Rules not processed for user `cb9ef38ec3b448828826de5f76a552d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:48.426060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-325f9c02-9c29-4edc-9510-48f1667bef1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:48.488129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6b4c7-fabc-457b-90b5-0265ce4d632e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:48.494777 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba76d6-b596-4cb4-8483-d1e7ae1b46c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:48.495413 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba76d6-b596-4cb4-8483-d1e7ae1b46c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:48.495894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba76d6-b596-4cb4-8483-d1e7ae1b46c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:48.496046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba76d6-b596-4cb4-8483-d1e7ae1b46c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:48.509337 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba76d6-b596-4cb4-8483-d1e7ae1b46c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:48.510791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba76d6-b596-4cb4-8483-d1e7ae1b46c1 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:48.540912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 817/1629] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:20:48.596530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 813/1630] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Aug 31 00:20:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:48.603125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a74b-80b1-476c-b5ac-78058051d141 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:48.603472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a74b-80b1-476c-b5ac-78058051d141 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:48.604405 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a74b-80b1-476c-b5ac-78058051d141 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:48.605860 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 818/1631] 10.222.0.50 () {54 vars in 912 bytes} [Wed Aug 31 00:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:20:48.611418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94db24a-cb60-4dbe-b86e-af590fa3ccd6 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:48.611730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94db24a-cb60-4dbe-b86e-af590fa3ccd6 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:48.612010 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94db24a-cb60-4dbe-b86e-af590fa3ccd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:48.654414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e94db24a-cb60-4dbe-b86e-af590fa3ccd6 None None] MFA Rules not processed for user `cb9ef38ec3b448828826de5f76a552d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:48.655865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e94db24a-cb60-4dbe-b86e-af590fa3ccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:48.682369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 814/1632] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:20:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:48.702319 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477a74b-80b1-476c-b5ac-78058051d141 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:48.708091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94db24a-cb60-4dbe-b86e-af590fa3ccd6 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:48.724824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94db24a-cb60-4dbe-b86e-af590fa3ccd6 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:48.727439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477a74b-80b1-476c-b5ac-78058051d141 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:48.733796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31494564-550f-4602-9177-2a7da20672a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:48.734922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494564-550f-4602-9177-2a7da20672a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:48.735682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494564-550f-4602-9177-2a7da20672a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:48.735682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494564-550f-4602-9177-2a7da20672a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:48.744532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af62de-7894-4ba2-8889-a398225a761b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:48.745886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af62de-7894-4ba2-8889-a398225a761b service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:48.747156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af62de-7894-4ba2-8889-a398225a761b service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:48.747820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af62de-7894-4ba2-8889-a398225a761b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:48.776025 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af62de-7894-4ba2-8889-a398225a761b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:48.782111 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af62de-7894-4ba2-8889-a398225a761b service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:48.819022 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 819/1633] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:48.871461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31494564-550f-4602-9177-2a7da20672a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:48.884656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31494564-550f-4602-9177-2a7da20672a9 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:48.910249 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 815/1634] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:49.079021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b94d34-e2f2-4615-a356-09ece390b93d None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:49.080047 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b94d34-e2f2-4615-a356-09ece390b93d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:49.080492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b94d34-e2f2-4615-a356-09ece390b93d None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:49.084110 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 820/1635] 10.222.0.50 () {54 vars in 912 bytes} [Wed Aug 31 00:20:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:20:49.098318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86e90c-e8e2-44a2-9e8c-b9b909b12ba0 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:49.099219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86e90c-e8e2-44a2-9e8c-b9b909b12ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:49.099776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86e90c-e8e2-44a2-9e8c-b9b909b12ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:49.124688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:49.136051 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-6e86e90c-e8e2-44a2-9e8c-b9b909b12ba0 None None] MFA Rules not processed for user `cb9ef38ec3b448828826de5f76a552d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:49.137417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6e86e90c-e8e2-44a2-9e8c-b9b909b12ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:49.167841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 816/1636] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:20:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:49.174145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b94d34-e2f2-4615-a356-09ece390b93d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:49.189517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b94d34-e2f2-4615-a356-09ece390b93d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:49.193876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e89b9-1aae-40a2-b6e5-8cec2e04c169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:49.194805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e89b9-1aae-40a2-b6e5-8cec2e04c169 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:49.195158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e89b9-1aae-40a2-b6e5-8cec2e04c169 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:49.195537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e89b9-1aae-40a2-b6e5-8cec2e04c169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:49.208988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e89b9-1aae-40a2-b6e5-8cec2e04c169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:49.211932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e89b9-1aae-40a2-b6e5-8cec2e04c169 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:49.229288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 821/1637] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:49.350819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86e90c-e8e2-44a2-9e8c-b9b909b12ba0 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:49.507132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86e90c-e8e2-44a2-9e8c-b9b909b12ba0 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:49.524334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c13824-d30d-41c8-a572-2c239dba543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:49.525636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c13824-d30d-41c8-a572-2c239dba543d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:49.525636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c13824-d30d-41c8-a572-2c239dba543d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:49.525963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c13824-d30d-41c8-a572-2c239dba543d admin admin] PATH_INFO: `/v3/users/e7976ce7465549e0a1a70bf7aeb48f55` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:49.528934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c13824-d30d-41c8-a572-2c239dba543d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7976ce7465549e0a1a70bf7aeb48f55)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:49.534689 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c13824-d30d-41c8-a572-2c239dba543d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:49.626752 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-39c13824-d30d-41c8-a572-2c239dba543d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7976ce7465549e0a1a70bf7aeb48f55'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:49.646533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-39c13824-d30d-41c8-a572-2c239dba543d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7976ce7465549e0a1a70bf7aeb48f55'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:49.656571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-39c13824-d30d-41c8-a572-2c239dba543d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7976ce7465549e0a1a70bf7aeb48f55'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:49.668231 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-39c13824-d30d-41c8-a572-2c239dba543d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7976ce7465549e0a1a70bf7aeb48f55'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:49.669168 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-39c13824-d30d-41c8-a572-2c239dba543d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7976ce7465549e0a1a70bf7aeb48f55'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:49.678971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 817/1638] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:49 2022] DELETE /identity/v3/users/e7976ce7465549e0a1a70bf7aeb48f55 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:49.685148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c291b3-e243-4b34-8784-bfde43f42f52 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:49.686372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c291b3-e243-4b34-8784-bfde43f42f52 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:49.687368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c291b3-e243-4b34-8784-bfde43f42f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:49.728189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-13c291b3-e243-4b34-8784-bfde43f42f52 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:49.729819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-13c291b3-e243-4b34-8784-bfde43f42f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:49.849011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 822/1639] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:49.896380 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c13824-d30d-41c8-a572-2c239dba543d admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:49.898354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-39c13824-d30d-41c8-a572-2c239dba543d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:50.020228 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c13824-d30d-41c8-a572-2c239dba543d admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:50.027087 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a83330-34f7-4e8c-8fd3-e1666a2ebc09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:50.027877 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a83330-34f7-4e8c-8fd3-e1666a2ebc09 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:50.028226 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a83330-34f7-4e8c-8fd3-e1666a2ebc09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:50.028600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a83330-34f7-4e8c-8fd3-e1666a2ebc09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:50.043408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a83330-34f7-4e8c-8fd3-e1666a2ebc09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:50.045670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a83330-34f7-4e8c-8fd3-e1666a2ebc09 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:50.069321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 818/1640] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:51.780743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9f501-f3c7-4e7a-a6bf-20151f131fb9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:51.781750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9f501-f3c7-4e7a-a6bf-20151f131fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:51.785403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9f501-f3c7-4e7a-a6bf-20151f131fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:51.801226 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a83330-34f7-4e8c-8fd3-e1666a2ebc09 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:51.802746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a2a83330-34f7-4e8c-8fd3-e1666a2ebc09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:51.837183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a83330-34f7-4e8c-8fd3-e1666a2ebc09 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:51.858158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565b2b6-145c-42a7-be7d-644c2582b87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:51.860039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565b2b6-145c-42a7-be7d-644c2582b87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:51.860326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565b2b6-145c-42a7-be7d-644c2582b87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:51.867645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565b2b6-145c-42a7-be7d-644c2582b87b admin admin] PATH_INFO: `/v3/projects/7dd18e5fbcf34c0a84619d1813de23a2` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:51.876710 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565b2b6-145c-42a7-be7d-644c2582b87b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd18e5fbcf34c0a84619d1813de23a2)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:51.877982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: WARNING py.warnings [None req-e565b2b6-145c-42a7-be7d-644c2582b87b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:20:51.877982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: warnings.warn(msg) Aug 31 00:20:51.877982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: Aug 31 00:20:51.879503 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565b2b6-145c-42a7-be7d-644c2582b87b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:51.896625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-98f9f501-f3c7-4e7a-a6bf-20151f131fb9 None None] MFA Rules not processed for user `240514b7499042c688c7ed026d4c4c99`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:51.898220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-98f9f501-f3c7-4e7a-a6bf-20151f131fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:51.946050 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:52.033659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e565b2b6-145c-42a7-be7d-644c2582b87b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd18e5fbcf34c0a84619d1813de23a2', 'request_id': 'req-e565b2b6-145c-42a7-be7d-644c2582b87b'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:52.048439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e565b2b6-145c-42a7-be7d-644c2582b87b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd18e5fbcf34c0a84619d1813de23a2', 'request_id': 'req-e565b2b6-145c-42a7-be7d-644c2582b87b'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:52.059415 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 823/1641] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:51 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:52.063864 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9f501-f3c7-4e7a-a6bf-20151f131fb9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.065481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-98f9f501-f3c7-4e7a-a6bf-20151f131fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:52.066225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e565b2b6-145c-42a7-be7d-644c2582b87b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd18e5fbcf34c0a84619d1813de23a2', 'request_id': 'req-e565b2b6-145c-42a7-be7d-644c2582b87b'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:52.088612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9f501-f3c7-4e7a-a6bf-20151f131fb9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:52.091669 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e565b2b6-145c-42a7-be7d-644c2582b87b admin admin] The token cache is being invalidate because project 7dd18e5fbcf34c0a84619d1813de23a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:52.092142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e565b2b6-145c-42a7-be7d-644c2582b87b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:52.092953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e565b2b6-145c-42a7-be7d-644c2582b87b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:52.097499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 819/1642] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:51 2022] DELETE /identity/v3/projects/7dd18e5fbcf34c0a84619d1813de23a2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:52.100279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699cad1-0b54-4004-bbd6-e83103363758 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.100790 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699cad1-0b54-4004-bbd6-e83103363758 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.101566 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699cad1-0b54-4004-bbd6-e83103363758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.121324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:52.137147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-f699cad1-0b54-4004-bbd6-e83103363758 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:52.144687 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f699cad1-0b54-4004-bbd6-e83103363758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:52.215687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48024729-cb94-4cb0-be50-2af6acc0f596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:52.216350 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48024729-cb94-4cb0-be50-2af6acc0f596 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.216630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48024729-cb94-4cb0-be50-2af6acc0f596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.217140 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48024729-cb94-4cb0-be50-2af6acc0f596 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.218499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48024729-cb94-4cb0-be50-2af6acc0f596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:52.228527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48024729-cb94-4cb0-be50-2af6acc0f596 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:52.287459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 820/1643] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:52.297347 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20e0bb-bb93-4eaa-bb70-8cda8468c1a6 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.298679 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20e0bb-bb93-4eaa-bb70-8cda8468c1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.300676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20e0bb-bb93-4eaa-bb70-8cda8468c1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.310016 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 824/1644] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:52 2022] POST /identity/v3/projects => generated 403 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:20:52.318343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48024729-cb94-4cb0-be50-2af6acc0f596 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.320790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-48024729-cb94-4cb0-be50-2af6acc0f596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:52.337432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7d20e0bb-bb93-4eaa-bb70-8cda8468c1a6 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:52.339109 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7d20e0bb-bb93-4eaa-bb70-8cda8468c1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:52.432107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 821/1645] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:52.437091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20e0bb-bb93-4eaa-bb70-8cda8468c1a6 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.456472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20e0bb-bb93-4eaa-bb70-8cda8468c1a6 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:52.461703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48024729-cb94-4cb0-be50-2af6acc0f596 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:52.469827 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357722d8-bb8c-4ace-b6bd-d9dce7c05894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:52.470922 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357722d8-bb8c-4ace-b6bd-d9dce7c05894 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.471587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357722d8-bb8c-4ace-b6bd-d9dce7c05894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.472109 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357722d8-bb8c-4ace-b6bd-d9dce7c05894 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.473018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357722d8-bb8c-4ace-b6bd-d9dce7c05894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:52.473865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2abd82-801e-4d65-b3dc-baeedc850657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:52.476407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357722d8-bb8c-4ace-b6bd-d9dce7c05894 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:52.477033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2abd82-801e-4d65-b3dc-baeedc850657 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.477697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2abd82-801e-4d65-b3dc-baeedc850657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.478235 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2abd82-801e-4d65-b3dc-baeedc850657 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.481496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2abd82-801e-4d65-b3dc-baeedc850657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:52.481930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2abd82-801e-4d65-b3dc-baeedc850657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:52.486444 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2abd82-801e-4d65-b3dc-baeedc850657 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:52.509544 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 825/1646] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:52 2022] POST /identity/v3/users => generated 308 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:52.513577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357722d8-bb8c-4ace-b6bd-d9dce7c05894 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.533895 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 822/1647] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:52.534959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2abd82-801e-4d65-b3dc-baeedc850657 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.535342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357722d8-bb8c-4ace-b6bd-d9dce7c05894 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:52.543180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b7c20-3817-4446-89a8-544d5959336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:52.544355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b7c20-3817-4446-89a8-544d5959336f admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.545573 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b7c20-3817-4446-89a8-544d5959336f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.546064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b7c20-3817-4446-89a8-544d5959336f admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.547188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b7c20-3817-4446-89a8-544d5959336f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:52.550425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b7c20-3817-4446-89a8-544d5959336f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:52.558646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2abd82-801e-4d65-b3dc-baeedc850657 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:52.563914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73504ee-2259-43eb-927f-89f89f4547e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:52.564791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73504ee-2259-43eb-927f-89f89f4547e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.565065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73504ee-2259-43eb-927f-89f89f4547e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.565337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73504ee-2259-43eb-927f-89f89f4547e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.565991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73504ee-2259-43eb-927f-89f89f4547e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:52.567967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73504ee-2259-43eb-927f-89f89f4547e1 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:52.571429 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 826/1648] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:20:52.576648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b7c20-3817-4446-89a8-544d5959336f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.603283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b7c20-3817-4446-89a8-544d5959336f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:52.606641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 823/1649] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:52 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:52.611503 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73504ee-2259-43eb-927f-89f89f4547e1 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.617263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1fa53-c26c-46d3-b074-b62aeea7e5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:52.617794 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1fa53-c26c-46d3-b074-b62aeea7e5b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.618080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1fa53-c26c-46d3-b074-b62aeea7e5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.618352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1fa53-c26c-46d3-b074-b62aeea7e5b6 admin admin] PATH_INFO: `/v3/projects/fbf89e2efeaa4088ae768762cadd3987/users/2ce8772152314697a784a69331de863f/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.630117 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:52.646795 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b1fa53-c26c-46d3-b074-b62aeea7e5b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf89e2efeaa4088ae768762cadd3987, user_id=2ce8772152314697a784a69331de863f, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:52.649668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b1fa53-c26c-46d3-b074-b62aeea7e5b6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:52.673436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 827/1650] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:52 2022] PUT /identity/v3/projects/fbf89e2efeaa4088ae768762cadd3987/users/2ce8772152314697a784a69331de863f/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:52.679039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1fa53-c26c-46d3-b074-b62aeea7e5b6 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.706173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73504ee-2259-43eb-927f-89f89f4547e1 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:52.750858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:52.756611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1fa53-c26c-46d3-b074-b62aeea7e5b6 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:52.764545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1eb22-a888-4d91-9cff-fcedf6b94682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:52.765276 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1eb22-a888-4d91-9cff-fcedf6b94682 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.766700 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1eb22-a888-4d91-9cff-fcedf6b94682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.767251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1eb22-a888-4d91-9cff-fcedf6b94682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.767896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1eb22-a888-4d91-9cff-fcedf6b94682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:52.769878 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1eb22-a888-4d91-9cff-fcedf6b94682 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:52.791679 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa0b51-a730-42f3-a54c-e1b9830e3d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:52.792345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa0b51-a730-42f3-a54c-e1b9830e3d44 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.792623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa0b51-a730-42f3-a54c-e1b9830e3d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.792894 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa0b51-a730-42f3-a54c-e1b9830e3d44 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.793553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa0b51-a730-42f3-a54c-e1b9830e3d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:52.801133 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa0b51-a730-42f3-a54c-e1b9830e3d44 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:52.806202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 828/1651] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:20:52.812440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1eb22-a888-4d91-9cff-fcedf6b94682 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.825924 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1eb22-a888-4d91-9cff-fcedf6b94682 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:52.832906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04029c-e26e-4194-ae12-869e7f183b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:52.833831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04029c-e26e-4194-ae12-869e7f183b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.834339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04029c-e26e-4194-ae12-869e7f183b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.834769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04029c-e26e-4194-ae12-869e7f183b68 admin admin] PATH_INFO: `/v3/projects/fbf89e2efeaa4088ae768762cadd3987/users/2ce8772152314697a784a69331de863f/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.837113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04029c-e26e-4194-ae12-869e7f183b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf89e2efeaa4088ae768762cadd3987, user_id=2ce8772152314697a784a69331de863f, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:52.840015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04029c-e26e-4194-ae12-869e7f183b68 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:52.840188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 824/1652] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:52 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:52.841529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa0b51-a730-42f3-a54c-e1b9830e3d44 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.853377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa0b51-a730-42f3-a54c-e1b9830e3d44 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:52.853965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 829/1653] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:52 2022] PUT /identity/v3/projects/fbf89e2efeaa4088ae768762cadd3987/users/2ce8772152314697a784a69331de863f/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:52.924921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc347a34-947e-4736-a572-158fc39b922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:52.927081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc347a34-947e-4736-a572-158fc39b922c admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.927772 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc347a34-947e-4736-a572-158fc39b922c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.928467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc347a34-947e-4736-a572-158fc39b922c admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.929529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc347a34-947e-4736-a572-158fc39b922c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:52.931721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc347a34-947e-4736-a572-158fc39b922c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:52.951441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 825/1654] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:52.951615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04029c-e26e-4194-ae12-869e7f183b68 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.973518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04029c-e26e-4194-ae12-869e7f183b68 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:52.989915 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32c770-f134-457b-91ce-a506883f2f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:52.991126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32c770-f134-457b-91ce-a506883f2f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.993398 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32c770-f134-457b-91ce-a506883f2f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.993960 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32c770-f134-457b-91ce-a506883f2f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.995188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32c770-f134-457b-91ce-a506883f2f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:52.998705 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32c770-f134-457b-91ce-a506883f2f42 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:53.020922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc347a34-947e-4736-a572-158fc39b922c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:53.032999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 830/1655] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:53.036344 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc347a34-947e-4736-a572-158fc39b922c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:53.047266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a9d1b-ada6-4ffd-943b-52bc4a91d213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:53.048675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a9d1b-ada6-4ffd-943b-52bc4a91d213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:53.049276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a9d1b-ada6-4ffd-943b-52bc4a91d213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:53.049767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a9d1b-ada6-4ffd-943b-52bc4a91d213 admin admin] PATH_INFO: `/v3/projects/73dae054d72c4ff1886c3daad34ceb19/users/dda2364fc8894a50a18fdcc43acc081b/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:53.073201 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a9d1b-ada6-4ffd-943b-52bc4a91d213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dae054d72c4ff1886c3daad34ceb19, user_id=dda2364fc8894a50a18fdcc43acc081b, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:53.077254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a9d1b-ada6-4ffd-943b-52bc4a91d213 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:53.116753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 826/1656] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:53 2022] PUT /identity/v3/projects/73dae054d72c4ff1886c3daad34ceb19/users/dda2364fc8894a50a18fdcc43acc081b/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:53.119101 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59a815-5e25-4ed0-81e7-1def427d05d1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:53.119497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59a815-5e25-4ed0-81e7-1def427d05d1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:53.120258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59a815-5e25-4ed0-81e7-1def427d05d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:53.166463 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7b59a815-5e25-4ed0-81e7-1def427d05d1 None None] MFA Rules not processed for user `dda2364fc8894a50a18fdcc43acc081b`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:53.168833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7b59a815-5e25-4ed0-81e7-1def427d05d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:53.333633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 831/1657] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:53.339140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a9d1b-ada6-4ffd-943b-52bc4a91d213 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:53.377857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:53.476185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a9d1b-ada6-4ffd-943b-52bc4a91d213 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:53.488013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d4775-3da7-4c2b-816e-100cf7a15ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:53.489877 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d4775-3da7-4c2b-816e-100cf7a15ced admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:53.490305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d4775-3da7-4c2b-816e-100cf7a15ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:53.490674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d4775-3da7-4c2b-816e-100cf7a15ced admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:53.492538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d4775-3da7-4c2b-816e-100cf7a15ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:53.499342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d4775-3da7-4c2b-816e-100cf7a15ced admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:53.570233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 827/1658] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:53 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:53.571070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59a815-5e25-4ed0-81e7-1def427d05d1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:53.595681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59a815-5e25-4ed0-81e7-1def427d05d1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:53.736524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035f16d-1c24-49b6-8cef-bc5f54ad98c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:53.737173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035f16d-1c24-49b6-8cef-bc5f54ad98c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:53.737644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035f16d-1c24-49b6-8cef-bc5f54ad98c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:53.737931 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035f16d-1c24-49b6-8cef-bc5f54ad98c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:53.738685 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035f16d-1c24-49b6-8cef-bc5f54ad98c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:53.740743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035f16d-1c24-49b6-8cef-bc5f54ad98c9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:53.799441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 832/1659] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:53 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:53.802519 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d4775-3da7-4c2b-816e-100cf7a15ced admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:53.841792 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d4775-3da7-4c2b-816e-100cf7a15ced admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:53.858256 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33026d-da1b-4976-a7f4-43bb85c8d009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:53.866618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33026d-da1b-4976-a7f4-43bb85c8d009 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:53.872463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33026d-da1b-4976-a7f4-43bb85c8d009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:53.872910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33026d-da1b-4976-a7f4-43bb85c8d009 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:53.875490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33026d-da1b-4976-a7f4-43bb85c8d009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:53.878027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33026d-da1b-4976-a7f4-43bb85c8d009 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:53.908953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 828/1660] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:53.913290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035f16d-1c24-49b6-8cef-bc5f54ad98c9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:53.937344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035f16d-1c24-49b6-8cef-bc5f54ad98c9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:53.974893 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21ed74-b981-47ef-85d9-623269e95f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:53.975624 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21ed74-b981-47ef-85d9-623269e95f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:53.975942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21ed74-b981-47ef-85d9-623269e95f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:53.976219 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21ed74-b981-47ef-85d9-623269e95f3a admin admin] PATH_INFO: `/v3/projects/32c2c148ac8e439d9ec80f0424e5bde9/users/6ace5e545ef14ffa98b2d01214e47779/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:54.053769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21ed74-b981-47ef-85d9-623269e95f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c2c148ac8e439d9ec80f0424e5bde9, user_id=6ace5e545ef14ffa98b2d01214e47779, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:54.058424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21ed74-b981-47ef-85d9-623269e95f3a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:54.117472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 833/1661] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:53 2022] PUT /identity/v3/projects/32c2c148ac8e439d9ec80f0424e5bde9/users/6ace5e545ef14ffa98b2d01214e47779/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:54.122366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33026d-da1b-4976-a7f4-43bb85c8d009 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:54.144948 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33026d-da1b-4976-a7f4-43bb85c8d009 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:54.314494 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98991922-b2a1-4ddd-ad22-b7edc393396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:54.315745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98991922-b2a1-4ddd-ad22-b7edc393396b admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:54.315903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98991922-b2a1-4ddd-ad22-b7edc393396b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:54.316106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98991922-b2a1-4ddd-ad22-b7edc393396b admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:54.316818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98991922-b2a1-4ddd-ad22-b7edc393396b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:54.319628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98991922-b2a1-4ddd-ad22-b7edc393396b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:54.348899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21ed74-b981-47ef-85d9-623269e95f3a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:54.350483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 829/1662] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:54.378164 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21ed74-b981-47ef-85d9-623269e95f3a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:54.385861 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91581a-10b6-4e6f-9443-29f826088422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:54.393038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91581a-10b6-4e6f-9443-29f826088422 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:54.393924 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91581a-10b6-4e6f-9443-29f826088422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:54.394451 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91581a-10b6-4e6f-9443-29f826088422 admin admin] PATH_INFO: `/v3/projects/32c2c148ac8e439d9ec80f0424e5bde9/users/6ace5e545ef14ffa98b2d01214e47779/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:54.396988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91581a-10b6-4e6f-9443-29f826088422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c2c148ac8e439d9ec80f0424e5bde9, user_id=6ace5e545ef14ffa98b2d01214e47779, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:54.400365 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91581a-10b6-4e6f-9443-29f826088422 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:54.421654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 834/1663] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:54 2022] PUT /identity/v3/projects/32c2c148ac8e439d9ec80f0424e5bde9/users/6ace5e545ef14ffa98b2d01214e47779/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:54.432736 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60a2ab-e01d-4126-8350-ee852f8731c3 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:54.433018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60a2ab-e01d-4126-8350-ee852f8731c3 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:54.433294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60a2ab-e01d-4126-8350-ee852f8731c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:54.480232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-cd60a2ab-e01d-4126-8350-ee852f8731c3 None None] MFA Rules not processed for user `6ace5e545ef14ffa98b2d01214e47779`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:54.483602 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-cd60a2ab-e01d-4126-8350-ee852f8731c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:54.647508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 830/1664] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:54.656732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91581a-10b6-4e6f-9443-29f826088422 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:54.659055 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fd91581a-10b6-4e6f-9443-29f826088422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:54.683400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:54.773919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91581a-10b6-4e6f-9443-29f826088422 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:54.786053 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cda664-a0d0-45a0-a1f1-74908f8469cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:54.787707 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cda664-a0d0-45a0-a1f1-74908f8469cd service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:54.788010 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cda664-a0d0-45a0-a1f1-74908f8469cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:54.788315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cda664-a0d0-45a0-a1f1-74908f8469cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:54.810688 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cda664-a0d0-45a0-a1f1-74908f8469cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:54.815229 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cda664-a0d0-45a0-a1f1-74908f8469cd service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:54.840629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 835/1665] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:20:56.474642 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60a2ab-e01d-4126-8350-ee852f8731c3 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:56.525774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:56.667359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60a2ab-e01d-4126-8350-ee852f8731c3 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:56.688942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9302a-b929-429e-a6e6-9051854abd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:56.689744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9302a-b929-429e-a6e6-9051854abd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:56.690180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9302a-b929-429e-a6e6-9051854abd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:56.690575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9302a-b929-429e-a6e6-9051854abd0c admin admin] PATH_INFO: `/v3/users/dda2364fc8894a50a18fdcc43acc081b` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:56.693416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9302a-b929-429e-a6e6-9051854abd0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda2364fc8894a50a18fdcc43acc081b)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:56.695611 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9302a-b929-429e-a6e6-9051854abd0c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:56.848486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-36e9302a-b929-429e-a6e6-9051854abd0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda2364fc8894a50a18fdcc43acc081b'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:56.884269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-36e9302a-b929-429e-a6e6-9051854abd0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda2364fc8894a50a18fdcc43acc081b'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:56.894745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-36e9302a-b929-429e-a6e6-9051854abd0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda2364fc8894a50a18fdcc43acc081b'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:56.914693 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-36e9302a-b929-429e-a6e6-9051854abd0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda2364fc8894a50a18fdcc43acc081b'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:56.915996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-36e9302a-b929-429e-a6e6-9051854abd0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda2364fc8894a50a18fdcc43acc081b'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:56.955317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 831/1666] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:56 2022] DELETE /identity/v3/users/dda2364fc8894a50a18fdcc43acc081b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:56.957498 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7813192-6a17-4af3-a6ef-5c3d677ae082 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:56.958561 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7813192-6a17-4af3-a6ef-5c3d677ae082 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:56.959198 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7813192-6a17-4af3-a6ef-5c3d677ae082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:57.015358 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c7813192-6a17-4af3-a6ef-5c3d677ae082 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:57.019008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c7813192-6a17-4af3-a6ef-5c3d677ae082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:57.179309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 836/1667] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:57.247741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9302a-b929-429e-a6e6-9051854abd0c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:57.249362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-36e9302a-b929-429e-a6e6-9051854abd0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:57.383444 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9302a-b929-429e-a6e6-9051854abd0c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:57.389857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c63dde-666d-4fbf-9711-b71d36301a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:57.389857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c63dde-666d-4fbf-9711-b71d36301a69 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:57.389857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c63dde-666d-4fbf-9711-b71d36301a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:57.390916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c63dde-666d-4fbf-9711-b71d36301a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:57.406271 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c63dde-666d-4fbf-9711-b71d36301a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:57.410636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c63dde-666d-4fbf-9711-b71d36301a69 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:57.432313 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 832/1668] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:59.143456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a880f3-8ab5-4cdb-b1b3-c0ea60dfffd8 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:59.143951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a880f3-8ab5-4cdb-b1b3-c0ea60dfffd8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:59.144062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a880f3-8ab5-4cdb-b1b3-c0ea60dfffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:59.207936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e9a880f3-8ab5-4cdb-b1b3-c0ea60dfffd8 None None] MFA Rules not processed for user `2ce8772152314697a784a69331de863f`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:59.209354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e9a880f3-8ab5-4cdb-b1b3-c0ea60dfffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:59.398010 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 837/1669] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:20:59 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:59.826234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c63dde-666d-4fbf-9711-b71d36301a69 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:59.828699 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c9c63dde-666d-4fbf-9711-b71d36301a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:59.847600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c63dde-666d-4fbf-9711-b71d36301a69 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:59.858387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:59.859162 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:59.859549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:59.859949 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] PATH_INFO: `/v3/projects/73dae054d72c4ff1886c3daad34ceb19` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:59.861414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73dae054d72c4ff1886c3daad34ceb19)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:59.864007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:59.974784 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:00.027020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73dae054d72c4ff1886c3daad34ceb19', 'request_id': 'req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.041098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a880f3-8ab5-4cdb-b1b3-c0ea60dfffd8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:00.043022 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e9a880f3-8ab5-4cdb-b1b3-c0ea60dfffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:00.053228 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73dae054d72c4ff1886c3daad34ceb19', 'request_id': 'req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.082315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a880f3-8ab5-4cdb-b1b3-c0ea60dfffd8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:00.084532 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73dae054d72c4ff1886c3daad34ceb19', 'request_id': 'req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.114446 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] The token cache is being invalidate because project 73dae054d72c4ff1886c3daad34ceb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:00.114976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.117035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.125077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 833/1670] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:59 2022] DELETE /identity/v3/projects/73dae054d72c4ff1886c3daad34ceb19 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:00.128963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:00.132113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:00.212559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:00.261050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:00.261618 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:00.261896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:00.262174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] PATH_INFO: `/v3/users/f2154c0f8d4b44e688aefc064dca64d7` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:00.265320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2154c0f8d4b44e688aefc064dca64d7)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:00.266435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:21:00.266435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 31 00:21:00.266435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: Aug 31 00:21:00.267600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:00.320767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7a365-2b67-4b71-be05-2dc7e63c31a8 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:00.331368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55605115-c392-4243-90ad-4ab77276d396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:00.332077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605115-c392-4243-90ad-4ab77276d396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:00.332443 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605115-c392-4243-90ad-4ab77276d396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:00.332657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605115-c392-4243-90ad-4ab77276d396 admin admin] PATH_INFO: `/v3/users/6ace5e545ef14ffa98b2d01214e47779` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:00.340599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55605115-c392-4243-90ad-4ab77276d396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ace5e545ef14ffa98b2d01214e47779)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:00.343156 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55605115-c392-4243-90ad-4ab77276d396 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:00.442018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2154c0f8d4b44e688aefc064dca64d7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.460594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-55605115-c392-4243-90ad-4ab77276d396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ace5e545ef14ffa98b2d01214e47779'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.494826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-55605115-c392-4243-90ad-4ab77276d396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ace5e545ef14ffa98b2d01214e47779'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.495770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2154c0f8d4b44e688aefc064dca64d7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.518464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-55605115-c392-4243-90ad-4ab77276d396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ace5e545ef14ffa98b2d01214e47779'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.521492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2154c0f8d4b44e688aefc064dca64d7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.536331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-55605115-c392-4243-90ad-4ab77276d396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ace5e545ef14ffa98b2d01214e47779'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.536816 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-55605115-c392-4243-90ad-4ab77276d396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ace5e545ef14ffa98b2d01214e47779'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.541586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2154c0f8d4b44e688aefc064dca64d7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.542541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2154c0f8d4b44e688aefc064dca64d7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.552936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 834/1671] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:00 2022] DELETE /identity/v3/users/6ace5e545ef14ffa98b2d01214e47779 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:00.558504 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 838/1672] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:00 2022] DELETE /identity/v3/users/f2154c0f8d4b44e688aefc064dca64d7 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:00.563036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efc2e2-37a7-4da0-b298-c5c6c6d02265 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:00.563504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efc2e2-37a7-4da0-b298-c5c6c6d02265 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:00.563860 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efc2e2-37a7-4da0-b298-c5c6c6d02265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:00.620136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-f2efc2e2-37a7-4da0-b298-c5c6c6d02265 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:00.621788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f2efc2e2-37a7-4da0-b298-c5c6c6d02265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:00.704977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:00.763750 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 835/1673] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:00.837069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:00.839008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:00.937324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d146b-c25f-484a-a165-4c10f8e8078f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:00.956592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f6236-bb52-4dd4-8282-1b49fe6dc1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:00.957638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f6236-bb52-4dd4-8282-1b49fe6dc1bc service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:00.957854 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f6236-bb52-4dd4-8282-1b49fe6dc1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:00.958298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f6236-bb52-4dd4-8282-1b49fe6dc1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:00.972821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f6236-bb52-4dd4-8282-1b49fe6dc1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:00.974732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f6236-bb52-4dd4-8282-1b49fe6dc1bc service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:00.996671 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 839/1674] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:01.732232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bee26-894d-4ec4-a73f-7545a2120fa7 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:01.732727 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bee26-894d-4ec4-a73f-7545a2120fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:01.732819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bee26-894d-4ec4-a73f-7545a2120fa7 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:01.734500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 836/1675] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 31 00:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:21:02.108032 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41901da-2109-4889-9a3c-ea07776d0b9d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:02.109014 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41901da-2109-4889-9a3c-ea07776d0b9d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:02.109481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41901da-2109-4889-9a3c-ea07776d0b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:02.164691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e41901da-2109-4889-9a3c-ea07776d0b9d None None] MFA Rules not processed for user `d01dd2631a81402d8a5bba7007c7fd61`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:02.170483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e41901da-2109-4889-9a3c-ea07776d0b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:02.306263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:02.335909 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 840/1676] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 31 00:21:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:02.431107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bee26-894d-4ec4-a73f-7545a2120fa7 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:02.433414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-887bee26-894d-4ec4-a73f-7545a2120fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:02.471905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bee26-894d-4ec4-a73f-7545a2120fa7 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:02.481469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e56c7-db7e-4d64-8ac6-a7e7addbc1d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01dd2631a81402d8a5bba7007c7fd61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:02.483834 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e56c7-db7e-4d64-8ac6-a7e7addbc1d3 service placement] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:02.485319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e56c7-db7e-4d64-8ac6-a7e7addbc1d3 service placement] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:02.485693 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e56c7-db7e-4d64-8ac6-a7e7addbc1d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:02.510084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e56c7-db7e-4d64-8ac6-a7e7addbc1d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:02.511958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e56c7-db7e-4d64-8ac6-a7e7addbc1d3 service placement] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:02.542208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 837/1677] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:02.722317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41901da-2109-4889-9a3c-ea07776d0b9d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:02.724232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e41901da-2109-4889-9a3c-ea07776d0b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:02.747852 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41901da-2109-4889-9a3c-ea07776d0b9d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:02.758425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:02.760550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:02.761914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:02.762649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8 admin admin] PATH_INFO: `/v3/projects/32c2c148ac8e439d9ec80f0424e5bde9` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:02.765661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c2c148ac8e439d9ec80f0424e5bde9)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:02.770334 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:02.890281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c2c148ac8e439d9ec80f0424e5bde9', 'request_id': 'req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:02.909910 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c2c148ac8e439d9ec80f0424e5bde9', 'request_id': 'req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:02.917694 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c2c148ac8e439d9ec80f0424e5bde9', 'request_id': 'req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:02.951986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8 admin admin] The token cache is being invalidate because project 32c2c148ac8e439d9ec80f0424e5bde9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:02.952229 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:02.955015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f1bfc5ff-38a3-4846-a9a7-835eb2b70ea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:02.962288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 841/1678] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:02 2022] DELETE /identity/v3/projects/32c2c148ac8e439d9ec80f0424e5bde9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:02.964031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478fc82-b0fe-4fac-927d-d65da41616a2 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:02.964533 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478fc82-b0fe-4fac-927d-d65da41616a2 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:02.964618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478fc82-b0fe-4fac-927d-d65da41616a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.009187 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e478fc82-b0fe-4fac-927d-d65da41616a2 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:03.011548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e478fc82-b0fe-4fac-927d-d65da41616a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:03.106519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661af1d1-ca0e-4f87-964c-c5e11001e9c9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.106821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661af1d1-ca0e-4f87-964c-c5e11001e9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.107107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661af1d1-ca0e-4f87-964c-c5e11001e9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.116950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 838/1679] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:03.149596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-661af1d1-ca0e-4f87-964c-c5e11001e9c9 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:03.151883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-661af1d1-ca0e-4f87-964c-c5e11001e9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:03.182653 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478fc82-b0fe-4fac-927d-d65da41616a2 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:03.197075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478fc82-b0fe-4fac-927d-d65da41616a2 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:03.198681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 842/1680] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:03.208292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766eef1-7ac0-4c4a-9af2-36ed6a4237c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:03.209225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766eef1-7ac0-4c4a-9af2-36ed6a4237c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.209912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766eef1-7ac0-4c4a-9af2-36ed6a4237c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.210199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766eef1-7ac0-4c4a-9af2-36ed6a4237c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.210875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766eef1-7ac0-4c4a-9af2-36ed6a4237c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:03.212324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766eef1-7ac0-4c4a-9af2-36ed6a4237c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:03.213275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766eef1-7ac0-4c4a-9af2-36ed6a4237c0 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:03.230973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 839/1681] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:03.236443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661af1d1-ca0e-4f87-964c-c5e11001e9c9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:03.250559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661af1d1-ca0e-4f87-964c-c5e11001e9c9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:03.256562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc5671-b7f1-4adc-a4b1-1f4a8cb1a5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:03.261741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc5671-b7f1-4adc-a4b1-1f4a8cb1a5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.262148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc5671-b7f1-4adc-a4b1-1f4a8cb1a5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.262434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc5671-b7f1-4adc-a4b1-1f4a8cb1a5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.263276 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc5671-b7f1-4adc-a4b1-1f4a8cb1a5d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:03.267466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc5671-b7f1-4adc-a4b1-1f4a8cb1a5d7 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:03.335096 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 843/1682] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:03 2022] POST /identity/v3/projects => generated 355 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:03.340068 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766eef1-7ac0-4c4a-9af2-36ed6a4237c0 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:03.351610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766eef1-7ac0-4c4a-9af2-36ed6a4237c0 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:03.503740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f52156-0f90-4a6f-94ab-7c5bbe4f58aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:03.504464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f52156-0f90-4a6f-94ab-7c5bbe4f58aa admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.504817 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f52156-0f90-4a6f-94ab-7c5bbe4f58aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.505161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f52156-0f90-4a6f-94ab-7c5bbe4f58aa admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.505964 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f52156-0f90-4a6f-94ab-7c5bbe4f58aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:03.513833 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f52156-0f90-4a6f-94ab-7c5bbe4f58aa admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:03.565246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 840/1683] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:03 2022] POST /identity/v3/users => generated 278 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:03.570174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc5671-b7f1-4adc-a4b1-1f4a8cb1a5d7 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:03.602182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc5671-b7f1-4adc-a4b1-1f4a8cb1a5d7 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:03.614277 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff39d25-ada7-4e1f-9e89-ce6b4b9a4eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:03.619145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff39d25-ada7-4e1f-9e89-ce6b4b9a4eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.621604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff39d25-ada7-4e1f-9e89-ce6b4b9a4eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.622133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff39d25-ada7-4e1f-9e89-ce6b4b9a4eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.623173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff39d25-ada7-4e1f-9e89-ce6b4b9a4eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:03.625108 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff39d25-ada7-4e1f-9e89-ce6b4b9a4eaa admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:03.639236 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 844/1684] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:03.643474 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f52156-0f90-4a6f-94ab-7c5bbe4f58aa admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:03.654511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f52156-0f90-4a6f-94ab-7c5bbe4f58aa admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:03.675198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedebc4-6f30-4961-8976-0ea57744fa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:03.680448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedebc4-6f30-4961-8976-0ea57744fa8e admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.680815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedebc4-6f30-4961-8976-0ea57744fa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.681170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedebc4-6f30-4961-8976-0ea57744fa8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.682006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedebc4-6f30-4961-8976-0ea57744fa8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:03.684209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedebc4-6f30-4961-8976-0ea57744fa8e admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:03.704935 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff39d25-ada7-4e1f-9e89-ce6b4b9a4eaa admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:03.712205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 841/1685] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:03.720216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff39d25-ada7-4e1f-9e89-ce6b4b9a4eaa admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:03.726880 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b113363-f5ef-4585-812f-898fdc09097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:03.728363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b113363-f5ef-4585-812f-898fdc09097d admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.728917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b113363-f5ef-4585-812f-898fdc09097d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.729332 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b113363-f5ef-4585-812f-898fdc09097d admin admin] PATH_INFO: `/v3/projects/82a0073333dc4c1d80b1cfd9be0ef5cd/users/24437b22735c4999bcb4049f204a771d/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.768787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b113363-f5ef-4585-812f-898fdc09097d admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a0073333dc4c1d80b1cfd9be0ef5cd, user_id=24437b22735c4999bcb4049f204a771d, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:03.774919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b113363-f5ef-4585-812f-898fdc09097d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:03.816682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d824ef-36f0-425b-8deb-a14bbcc335f0 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.816971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d824ef-36f0-425b-8deb-a14bbcc335f0 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.817245 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d824ef-36f0-425b-8deb-a14bbcc335f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.821516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 845/1686] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:03 2022] PUT /identity/v3/projects/82a0073333dc4c1d80b1cfd9be0ef5cd/users/24437b22735c4999bcb4049f204a771d/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:03.857616 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e9d824ef-36f0-425b-8deb-a14bbcc335f0 None None] MFA Rules not processed for user `24437b22735c4999bcb4049f204a771d`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:03.858992 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e9d824ef-36f0-425b-8deb-a14bbcc335f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:03.867000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423caeec-3314-4e3b-bd6a-deffab2b1cff None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.867000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423caeec-3314-4e3b-bd6a-deffab2b1cff None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.867000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423caeec-3314-4e3b-bd6a-deffab2b1cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.935300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:03.946534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-423caeec-3314-4e3b-bd6a-deffab2b1cff None None] MFA Rules not processed for user `f73759f32c794f20bbab3a9887c9d37c`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:03.950187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-423caeec-3314-4e3b-bd6a-deffab2b1cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:04.066020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 842/1687] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:04.066876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d824ef-36f0-425b-8deb-a14bbcc335f0 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.069704 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e9d824ef-36f0-425b-8deb-a14bbcc335f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:04.133092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 846/1688] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:04.134050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423caeec-3314-4e3b-bd6a-deffab2b1cff None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.162889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:04.281852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d824ef-36f0-425b-8deb-a14bbcc335f0 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.295797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.296484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.297242 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.297535 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] PATH_INFO: `/v3/projects/1b34732c9fe14bcb98ec19ac2620ade0` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.298955 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b34732c9fe14bcb98ec19ac2620ade0)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.305177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.342931 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423caeec-3314-4e3b-bd6a-deffab2b1cff None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.353280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e9b71-1f1c-4ecd-b5b8-b130dbe70db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.353921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e9b71-1f1c-4ecd-b5b8-b130dbe70db9 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.354203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e9b71-1f1c-4ecd-b5b8-b130dbe70db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.354486 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e9b71-1f1c-4ecd-b5b8-b130dbe70db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.362520 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e9b71-1f1c-4ecd-b5b8-b130dbe70db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.364651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e9b71-1f1c-4ecd-b5b8-b130dbe70db9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.427626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b34732c9fe14bcb98ec19ac2620ade0', 'request_id': 'req-ec48f643-db90-46ed-91dd-2a0d6e403679'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.434064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 847/1689] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:04 2022] POST /identity/v3/projects => generated 357 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:04.438692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e9b71-1f1c-4ecd-b5b8-b130dbe70db9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.441589 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-785e9b71-1f1c-4ecd-b5b8-b130dbe70db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:04.448237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b34732c9fe14bcb98ec19ac2620ade0', 'request_id': 'req-ec48f643-db90-46ed-91dd-2a0d6e403679'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.457172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b34732c9fe14bcb98ec19ac2620ade0', 'request_id': 'req-ec48f643-db90-46ed-91dd-2a0d6e403679'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.487112 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] The token cache is being invalidate because project 1b34732c9fe14bcb98ec19ac2620ade0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:04.487363 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.491077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.493682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 843/1690] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:04 2022] DELETE /identity/v3/projects/1b34732c9fe14bcb98ec19ac2620ade0 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:04.495240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.498442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:04.676643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e9b71-1f1c-4ecd-b5b8-b130dbe70db9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.687570 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7abb82-5fae-41fc-a7af-6048c8f44f14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.688306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7abb82-5fae-41fc-a7af-6048c8f44f14 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.688589 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7abb82-5fae-41fc-a7af-6048c8f44f14 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.689888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7abb82-5fae-41fc-a7af-6048c8f44f14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.694868 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-de7abb82-5fae-41fc-a7af-6048c8f44f14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:04.697232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:04.733838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48f643-db90-46ed-91dd-2a0d6e403679 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.846283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7abb82-5fae-41fc-a7af-6048c8f44f14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.847947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7abb82-5fae-41fc-a7af-6048c8f44f14 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.870928 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14197-9796-4907-be12-6ffbd421b272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.871562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14197-9796-4907-be12-6ffbd421b272 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.871873 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14197-9796-4907-be12-6ffbd421b272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.872148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14197-9796-4907-be12-6ffbd421b272 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.872803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a14197-9796-4907-be12-6ffbd421b272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.875264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a14197-9796-4907-be12-6ffbd421b272 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.877320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 848/1691] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:04.878277 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7abb82-5fae-41fc-a7af-6048c8f44f14 service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.879660 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-de7abb82-5fae-41fc-a7af-6048c8f44f14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:04.904307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7abb82-5fae-41fc-a7af-6048c8f44f14 service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.913812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72a100-0af8-447f-bb85-038d24d29342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.914532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72a100-0af8-447f-bb85-038d24d29342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.914817 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72a100-0af8-447f-bb85-038d24d29342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.915094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72a100-0af8-447f-bb85-038d24d29342 admin admin] PATH_INFO: `/v3/users/00fc081664f7472ba7dee2cca28aa741` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.919623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 844/1692] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:04 2022] POST /identity/v3/users => generated 285 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:04.924196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14197-9796-4907-be12-6ffbd421b272 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.925691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72a100-0af8-447f-bb85-038d24d29342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00fc081664f7472ba7dee2cca28aa741)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.927383 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72a100-0af8-447f-bb85-038d24d29342 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.953477 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14197-9796-4907-be12-6ffbd421b272 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.975522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96218be-b8a9-4249-bceb-3deccdd15191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.976593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96218be-b8a9-4249-bceb-3deccdd15191 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.979426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96218be-b8a9-4249-bceb-3deccdd15191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.980430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96218be-b8a9-4249-bceb-3deccdd15191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.981350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96218be-b8a9-4249-bceb-3deccdd15191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.984042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96218be-b8a9-4249-bceb-3deccdd15191 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.012914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 845/1693] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:05.014259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96218be-b8a9-4249-bceb-3deccdd15191 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.025800 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:05.041812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96218be-b8a9-4249-bceb-3deccdd15191 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.050461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a68bb1-3318-4df5-9fe3-6cf042051b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.051399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a68bb1-3318-4df5-9fe3-6cf042051b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.051686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a68bb1-3318-4df5-9fe3-6cf042051b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.052674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a68bb1-3318-4df5-9fe3-6cf042051b01 admin admin] PATH_INFO: `/v3/projects/8b0b634264424d4e9c40f775417c0a0e/users/9b579e98d5864e7bb700c09bb8110a30/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.087464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a68bb1-3318-4df5-9fe3-6cf042051b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0b634264424d4e9c40f775417c0a0e, user_id=9b579e98d5864e7bb700c09bb8110a30, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.094463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a68bb1-3318-4df5-9fe3-6cf042051b01 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.114388 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9d72a100-0af8-447f-bb85-038d24d29342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00fc081664f7472ba7dee2cca28aa741'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:05.123278 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 846/1694] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:05 2022] PUT /identity/v3/projects/8b0b634264424d4e9c40f775417c0a0e/users/9b579e98d5864e7bb700c09bb8110a30/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:05.139749 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a68bb1-3318-4df5-9fe3-6cf042051b01 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.144013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9d72a100-0af8-447f-bb85-038d24d29342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00fc081664f7472ba7dee2cca28aa741'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:05.160182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9d72a100-0af8-447f-bb85-038d24d29342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00fc081664f7472ba7dee2cca28aa741'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:05.177343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9d72a100-0af8-447f-bb85-038d24d29342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00fc081664f7472ba7dee2cca28aa741'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:05.178177 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9d72a100-0af8-447f-bb85-038d24d29342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00fc081664f7472ba7dee2cca28aa741'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:05.187555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 849/1695] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:04 2022] DELETE /identity/v3/users/00fc081664f7472ba7dee2cca28aa741 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:05.292380 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a68bb1-3318-4df5-9fe3-6cf042051b01 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.400237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea247d-bb6d-42f6-95ca-b21e138b4929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.401455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea247d-bb6d-42f6-95ca-b21e138b4929 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.401892 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea247d-bb6d-42f6-95ca-b21e138b4929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.402303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea247d-bb6d-42f6-95ca-b21e138b4929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.403329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea247d-bb6d-42f6-95ca-b21e138b4929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.405752 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea247d-bb6d-42f6-95ca-b21e138b4929 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.412663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:05.450954 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72a100-0af8-447f-bb85-038d24d29342 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.453582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9d72a100-0af8-447f-bb85-038d24d29342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:05.463596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 847/1696] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:05.471417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72a100-0af8-447f-bb85-038d24d29342 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.479674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298690cf-8ca9-4c40-9f43-43577c7a560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.481772 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298690cf-8ca9-4c40-9f43-43577c7a560a admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.482733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298690cf-8ca9-4c40-9f43-43577c7a560a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.483295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298690cf-8ca9-4c40-9f43-43577c7a560a admin admin] PATH_INFO: `/v3/projects/8b0b634264424d4e9c40f775417c0a0e/users/9b579e98d5864e7bb700c09bb8110a30/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.486971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298690cf-8ca9-4c40-9f43-43577c7a560a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0b634264424d4e9c40f775417c0a0e, user_id=9b579e98d5864e7bb700c09bb8110a30, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.491895 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298690cf-8ca9-4c40-9f43-43577c7a560a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.506252 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 850/1697] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:05 2022] PUT /identity/v3/projects/8b0b634264424d4e9c40f775417c0a0e/users/9b579e98d5864e7bb700c09bb8110a30/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:05.517355 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b94145-47e8-4ff1-b7f0-f33ad0c6679d None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.517827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b94145-47e8-4ff1-b7f0-f33ad0c6679d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.518255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b94145-47e8-4ff1-b7f0-f33ad0c6679d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.568823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-88b94145-47e8-4ff1-b7f0-f33ad0c6679d None None] MFA Rules not processed for user `9b579e98d5864e7bb700c09bb8110a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:05.570437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-88b94145-47e8-4ff1-b7f0-f33ad0c6679d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:05.722484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 848/1698] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:05.731131 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298690cf-8ca9-4c40-9f43-43577c7a560a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.734256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-298690cf-8ca9-4c40-9f43-43577c7a560a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:05.885562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298690cf-8ca9-4c40-9f43-43577c7a560a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.890542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f784a-d6cc-4933-81c7-c9a8befba51f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.891331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f784a-d6cc-4933-81c7-c9a8befba51f service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.892013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f784a-d6cc-4933-81c7-c9a8befba51f service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.892361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f784a-d6cc-4933-81c7-c9a8befba51f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.911734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f784a-d6cc-4933-81c7-c9a8befba51f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.915974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f784a-d6cc-4933-81c7-c9a8befba51f service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.934416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 851/1699] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:06.085800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b94145-47e8-4ff1-b7f0-f33ad0c6679d None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.101427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b94145-47e8-4ff1-b7f0-f33ad0c6679d None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.111403 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453da57e-ac31-4baf-95bf-34a309caeb72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.112431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da57e-ac31-4baf-95bf-34a309caeb72 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.113273 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da57e-ac31-4baf-95bf-34a309caeb72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.113647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da57e-ac31-4baf-95bf-34a309caeb72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.115919 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-453da57e-ac31-4baf-95bf-34a309caeb72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.210473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b454b1-aec5-4568-b808-f1208bfa856e None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.210995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b454b1-aec5-4568-b808-f1208bfa856e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.211103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b454b1-aec5-4568-b808-f1208bfa856e None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.212798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 852/1700] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 31 00:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:21:06.272366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453da57e-ac31-4baf-95bf-34a309caeb72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.275376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453da57e-ac31-4baf-95bf-34a309caeb72 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.305343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 849/1701] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:06.449920 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa8c7c-ff8f-459f-aaf9-e1cb06693b96 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.450440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa8c7c-ff8f-459f-aaf9-e1cb06693b96 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.450923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa8c7c-ff8f-459f-aaf9-e1cb06693b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.498123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-cffa8c7c-ff8f-459f-aaf9-e1cb06693b96 None None] MFA Rules not processed for user `d01dd2631a81402d8a5bba7007c7fd61`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:06.499376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cffa8c7c-ff8f-459f-aaf9-e1cb06693b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.673951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 853/1702] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 31 00:21:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:06.755568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453da57e-ac31-4baf-95bf-34a309caeb72 service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.758887 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-453da57e-ac31-4baf-95bf-34a309caeb72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.793317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453da57e-ac31-4baf-95bf-34a309caeb72 service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.805096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6a6eb-389c-40f1-92df-352dfb116c91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01dd2631a81402d8a5bba7007c7fd61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.807436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a6eb-389c-40f1-92df-352dfb116c91 service placement] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.807901 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a6eb-389c-40f1-92df-352dfb116c91 service placement] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.808182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a6eb-389c-40f1-92df-352dfb116c91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.826056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6a6eb-389c-40f1-92df-352dfb116c91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.828011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6a6eb-389c-40f1-92df-352dfb116c91 service placement] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.845585 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 850/1703] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:06.894091 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432679cc-2ac3-419b-9f06-a5cc7e766b5b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.894192 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432679cc-2ac3-419b-9f06-a5cc7e766b5b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.894442 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432679cc-2ac3-419b-9f06-a5cc7e766b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.989023 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-432679cc-2ac3-419b-9f06-a5cc7e766b5b None None] MFA Rules not processed for user `27016a2b993e4cd69c89f8f49b3c5a84`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:06.990646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-432679cc-2ac3-419b-9f06-a5cc7e766b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:07.011629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:07.043767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e672-2bb6-4c97-97c5-4fd8f0a1a866 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:07.044419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e672-2bb6-4c97-97c5-4fd8f0a1a866 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:07.044419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e672-2bb6-4c97-97c5-4fd8f0a1a866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:07.120243 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e265e672-2bb6-4c97-97c5-4fd8f0a1a866 None None] MFA Rules not processed for user `0ae3ab8ab42b40739a90121bcbeaba2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:07.123015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e265e672-2bb6-4c97-97c5-4fd8f0a1a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:07.190287 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 854/1704] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:07.191748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432679cc-2ac3-419b-9f06-a5cc7e766b5b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:07.194120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-432679cc-2ac3-419b-9f06-a5cc7e766b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:07.278852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:07.294976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 851/1705] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:07.294976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc323f84-edc2-4399-8b6d-a5d70e002a67 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:07.294976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc323f84-edc2-4399-8b6d-a5d70e002a67 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:07.294976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc323f84-edc2-4399-8b6d-a5d70e002a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:07.320475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-dc323f84-edc2-4399-8b6d-a5d70e002a67 None None] MFA Rules not processed for user `27016a2b993e4cd69c89f8f49b3c5a84`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:07.324452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-dc323f84-edc2-4399-8b6d-a5d70e002a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:07.342064 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 852/1706] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:07.343108 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc323f84-edc2-4399-8b6d-a5d70e002a67 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:07.349652 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-dc323f84-edc2-4399-8b6d-a5d70e002a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:07.378947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432679cc-2ac3-419b-9f06-a5cc7e766b5b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:07.393494 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ad392-4623-48d1-8d80-102b5184f50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:07.395367 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ad392-4623-48d1-8d80-102b5184f50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:07.396040 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ad392-4623-48d1-8d80-102b5184f50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:07.396523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ad392-4623-48d1-8d80-102b5184f50f admin admin] PATH_INFO: `/v3/users/240514b7499042c688c7ed026d4c4c99` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:07.399957 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ad392-4623-48d1-8d80-102b5184f50f admin admin] RBAC: Authorizing `identity:delete_user(user_id=240514b7499042c688c7ed026d4c4c99)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:07.407446 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ad392-4623-48d1-8d80-102b5184f50f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:07.514220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-254ad392-4623-48d1-8d80-102b5184f50f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '240514b7499042c688c7ed026d4c4c99'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.536633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc323f84-edc2-4399-8b6d-a5d70e002a67 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:07.566438 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-254ad392-4623-48d1-8d80-102b5184f50f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '240514b7499042c688c7ed026d4c4c99'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.569976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d161-96c0-47b8-847b-0b9066ee4c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:07.569976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d161-96c0-47b8-847b-0b9066ee4c1a service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:07.569976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d161-96c0-47b8-847b-0b9066ee4c1a service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:07.569976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d161-96c0-47b8-847b-0b9066ee4c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:07.597001 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515d161-96c0-47b8-847b-0b9066ee4c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:07.600264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515d161-96c0-47b8-847b-0b9066ee4c1a service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:07.603470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-254ad392-4623-48d1-8d80-102b5184f50f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '240514b7499042c688c7ed026d4c4c99'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.612612 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 853/1707] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:07.613658 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d161-96c0-47b8-847b-0b9066ee4c1a service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:07.621586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-254ad392-4623-48d1-8d80-102b5184f50f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '240514b7499042c688c7ed026d4c4c99'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.622226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-254ad392-4623-48d1-8d80-102b5184f50f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '240514b7499042c688c7ed026d4c4c99'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:07.632156 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a515d161-96c0-47b8-847b-0b9066ee4c1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:07.640397 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 855/1708] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:07 2022] DELETE /identity/v3/users/240514b7499042c688c7ed026d4c4c99 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:07.678870 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d161-96c0-47b8-847b-0b9066ee4c1a service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:07.929824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e6ae2-e8cd-414b-b91e-9cb7d842eaac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:07.930457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e6ae2-e8cd-414b-b91e-9cb7d842eaac service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:07.930740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e6ae2-e8cd-414b-b91e-9cb7d842eaac service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:07.931012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e6ae2-e8cd-414b-b91e-9cb7d842eaac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:07.944137 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-929e6ae2-e8cd-414b-b91e-9cb7d842eaac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:08.021291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ad392-4623-48d1-8d80-102b5184f50f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:08.023051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-254ad392-4623-48d1-8d80-102b5184f50f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:08.128125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:08.150629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e6ae2-e8cd-414b-b91e-9cb7d842eaac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:08.155395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e6ae2-e8cd-414b-b91e-9cb7d842eaac service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:08.189604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ad392-4623-48d1-8d80-102b5184f50f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:08.191538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 854/1709] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:08.204513 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:08.205308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.205707 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.206073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] PATH_INFO: `/v3/projects/7e2153c52a074cbaa057d66c5314b054` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.208190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2153c52a074cbaa057d66c5314b054)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:08.211306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:08.348582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2153c52a074cbaa057d66c5314b054', 'request_id': 'req-80882cc8-fd46-46e0-9f98-6e36469d0d80'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.363131 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2153c52a074cbaa057d66c5314b054', 'request_id': 'req-80882cc8-fd46-46e0-9f98-6e36469d0d80'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.373879 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2153c52a074cbaa057d66c5314b054', 'request_id': 'req-80882cc8-fd46-46e0-9f98-6e36469d0d80'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.394215 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] The token cache is being invalidate because project 7e2153c52a074cbaa057d66c5314b054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:08.394929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.395035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.397164 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 856/1710] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:08 2022] DELETE /identity/v3/projects/7e2153c52a074cbaa057d66c5314b054 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:08.400981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e6ae2-e8cd-414b-b91e-9cb7d842eaac service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:08.415874 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e6ae2-e8cd-414b-b91e-9cb7d842eaac service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:08.436561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:08.470896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:08.478726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:08.573557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e393c-22a2-4e0d-b213-94ad892a7a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:08.574219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e393c-22a2-4e0d-b213-94ad892a7a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.574487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e393c-22a2-4e0d-b213-94ad892a7a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.574757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e393c-22a2-4e0d-b213-94ad892a7a6b admin admin] PATH_INFO: `/v3/users/2ce8772152314697a784a69331de863f` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.582799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e393c-22a2-4e0d-b213-94ad892a7a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce8772152314697a784a69331de863f)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:08.589046 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e393c-22a2-4e0d-b213-94ad892a7a6b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:08.653403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80882cc8-fd46-46e0-9f98-6e36469d0d80 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:08.663003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:08.663993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.664415 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.664983 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82 admin admin] PATH_INFO: `/v3/projects/216ceded9fd24214b217e3e244608b3b` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.671488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216ceded9fd24214b217e3e244608b3b)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:08.673866 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:08.704969 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6b9e393c-22a2-4e0d-b213-94ad892a7a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce8772152314697a784a69331de863f'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.746761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6b9e393c-22a2-4e0d-b213-94ad892a7a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce8772152314697a784a69331de863f'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.765567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6b9e393c-22a2-4e0d-b213-94ad892a7a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce8772152314697a784a69331de863f'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.785252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6b9e393c-22a2-4e0d-b213-94ad892a7a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce8772152314697a784a69331de863f'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.786098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6b9e393c-22a2-4e0d-b213-94ad892a7a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce8772152314697a784a69331de863f'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.797626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 855/1711] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:08 2022] DELETE /identity/v3/users/2ce8772152314697a784a69331de863f => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:08.800800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa169ac-99e0-45b5-b862-9539ae301ad3 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.801131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa169ac-99e0-45b5-b862-9539ae301ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.801393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa169ac-99e0-45b5-b862-9539ae301ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.831969 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216ceded9fd24214b217e3e244608b3b', 'request_id': 'req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.860011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216ceded9fd24214b217e3e244608b3b', 'request_id': 'req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.872635 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216ceded9fd24214b217e3e244608b3b', 'request_id': 'req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.872910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7fa169ac-99e0-45b5-b862-9539ae301ad3 None None] MFA Rules not processed for user `7b05f63c8a054e6dbfe70a70c50805cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:08.874942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:08.876271 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7fa169ac-99e0-45b5-b862-9539ae301ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:08.914343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82 admin admin] The token cache is being invalidate because project 216ceded9fd24214b217e3e244608b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:08.914636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.919264 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4aa2dd55-3d16-46ea-bfd9-8caf825fff82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.924061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 857/1712] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:08 2022] DELETE /identity/v3/projects/216ceded9fd24214b217e3e244608b3b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:08.926048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0608354-c74e-4c1a-9655-6af1fcbc8db9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.926331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0608354-c74e-4c1a-9655-6af1fcbc8db9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.926599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0608354-c74e-4c1a-9655-6af1fcbc8db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.974341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 856/1713] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:08.976198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676baa7-dd1d-43cf-acad-2dff7bf30b4d None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.976618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676baa7-dd1d-43cf-acad-2dff7bf30b4d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.977069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676baa7-dd1d-43cf-acad-2dff7bf30b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.018877 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e0608354-c74e-4c1a-9655-6af1fcbc8db9 None None] MFA Rules not processed for user `1aeead6fcbc54b39826b5da033dd9d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:09.020076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e0608354-c74e-4c1a-9655-6af1fcbc8db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:09.052926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-0676baa7-dd1d-43cf-acad-2dff7bf30b4d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:09.056980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-0676baa7-dd1d-43cf-acad-2dff7bf30b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:09.115039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:09.230600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 858/1714] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:09.232193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758f788-a43e-452d-b469-30b0bd92ecde None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.232483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758f788-a43e-452d-b469-30b0bd92ecde None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.232760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758f788-a43e-452d-b469-30b0bd92ecde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.258599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 857/1715] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:09.258599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676baa7-dd1d-43cf-acad-2dff7bf30b4d None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.258599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-0676baa7-dd1d-43cf-acad-2dff7bf30b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:09.294604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3758f788-a43e-452d-b469-30b0bd92ecde None None] MFA Rules not processed for user `7b05f63c8a054e6dbfe70a70c50805cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:09.297754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3758f788-a43e-452d-b469-30b0bd92ecde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:09.327281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 859/1716] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:09.327281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364fe29-f9d9-4829-ab37-0dce30c59d43 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.327281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364fe29-f9d9-4829-ab37-0dce30c59d43 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.327281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364fe29-f9d9-4829-ab37-0dce30c59d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.376170 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1364fe29-f9d9-4829-ab37-0dce30c59d43 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:09.377400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1364fe29-f9d9-4829-ab37-0dce30c59d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:09.396706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 860/1717] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:09.401600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364fe29-f9d9-4829-ab37-0dce30c59d43 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.420342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364fe29-f9d9-4829-ab37-0dce30c59d43 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.446236 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736addf-c50e-4a8c-aa02-c25fe0d5e6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.446884 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736addf-c50e-4a8c-aa02-c25fe0d5e6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.447171 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736addf-c50e-4a8c-aa02-c25fe0d5e6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.447596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736addf-c50e-4a8c-aa02-c25fe0d5e6e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.448324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736addf-c50e-4a8c-aa02-c25fe0d5e6e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:09.448629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736addf-c50e-4a8c-aa02-c25fe0d5e6e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.450280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736addf-c50e-4a8c-aa02-c25fe0d5e6e9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.450906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676baa7-dd1d-43cf-acad-2dff7bf30b4d None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.458547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e8a26-b33d-4088-91f2-9190f4bac604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.459215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8a26-b33d-4088-91f2-9190f4bac604 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.460167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8a26-b33d-4088-91f2-9190f4bac604 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.460435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8a26-b33d-4088-91f2-9190f4bac604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.472859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e8a26-b33d-4088-91f2-9190f4bac604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.477967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e8a26-b33d-4088-91f2-9190f4bac604 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.483820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 861/1718] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:09.485135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736addf-c50e-4a8c-aa02-c25fe0d5e6e9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.504616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736addf-c50e-4a8c-aa02-c25fe0d5e6e9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.520152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe57f8-a692-45c8-9a72-e33c6e031c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.520152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe57f8-a692-45c8-9a72-e33c6e031c63 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.520536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe57f8-a692-45c8-9a72-e33c6e031c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.520733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe57f8-a692-45c8-9a72-e33c6e031c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.521533 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe57f8-a692-45c8-9a72-e33c6e031c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.521681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 858/1719] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:09.523444 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe57f8-a692-45c8-9a72-e33c6e031c63 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.574959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7be69-a3d3-44de-8f84-c7a9790596a4 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.575482 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7be69-a3d3-44de-8f84-c7a9790596a4 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.575935 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7be69-a3d3-44de-8f84-c7a9790596a4 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.578632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 859/1720] 10.222.0.50 () {54 vars in 912 bytes} [Wed Aug 31 00:21:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:21:09.596694 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b7643-1d78-4b3f-8822-77068ca8dbb0 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.597853 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b7643-1d78-4b3f-8822-77068ca8dbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.598275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b7643-1d78-4b3f-8822-77068ca8dbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.602001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 862/1721] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:09 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:09.606455 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe57f8-a692-45c8-9a72-e33c6e031c63 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.726151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-986b7643-1d78-4b3f-8822-77068ca8dbb0 None None] MFA Rules not processed for user `5bde943833bb43e78879748c49ce3332`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:09.727439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-986b7643-1d78-4b3f-8822-77068ca8dbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:09.741092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe57f8-a692-45c8-9a72-e33c6e031c63 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.749210 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a720e9-6a81-4e25-aeb3-70e5a563d48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.751163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a720e9-6a81-4e25-aeb3-70e5a563d48c admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.751759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a720e9-6a81-4e25-aeb3-70e5a563d48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.752555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a720e9-6a81-4e25-aeb3-70e5a563d48c admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.753436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a720e9-6a81-4e25-aeb3-70e5a563d48c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.756218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a720e9-6a81-4e25-aeb3-70e5a563d48c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.808669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 863/1722] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:09 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:09.810961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a720e9-6a81-4e25-aeb3-70e5a563d48c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.869635 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 860/1723] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:21:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:09.871916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b7643-1d78-4b3f-8822-77068ca8dbb0 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.875042 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:09.902890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b7643-1d78-4b3f-8822-77068ca8dbb0 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.912467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935d65-1612-4012-b116-674337a303df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.913208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935d65-1612-4012-b116-674337a303df admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.914802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935d65-1612-4012-b116-674337a303df admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.915217 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935d65-1612-4012-b116-674337a303df admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.916758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e935d65-1612-4012-b116-674337a303df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.923572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e935d65-1612-4012-b116-674337a303df admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.958949 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 861/1724] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:09.958949 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935d65-1612-4012-b116-674337a303df admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.965417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7e935d65-1612-4012-b116-674337a303df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:09.984550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a720e9-6a81-4e25-aeb3-70e5a563d48c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.993999 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935d65-1612-4012-b116-674337a303df admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.998364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e7fe5-d543-426d-8a7d-ef3435e8d811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.999215 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e7fe5-d543-426d-8a7d-ef3435e8d811 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.000592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e7fe5-d543-426d-8a7d-ef3435e8d811 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.001664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e7fe5-d543-426d-8a7d-ef3435e8d811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.002530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f5cac-35dd-4698-a293-21d0c48d7507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:10.004290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f5cac-35dd-4698-a293-21d0c48d7507 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.004651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f5cac-35dd-4698-a293-21d0c48d7507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.006825 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f5cac-35dd-4698-a293-21d0c48d7507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.037356 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f5cac-35dd-4698-a293-21d0c48d7507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:10.039445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f5cac-35dd-4698-a293-21d0c48d7507 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:10.065340 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 862/1725] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:10.066831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f5cac-35dd-4698-a293-21d0c48d7507 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:10.094192 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f5cac-35dd-4698-a293-21d0c48d7507 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:10.120451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17159016-235d-4aae-b5c4-47c0249292a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:10.121177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159016-235d-4aae-b5c4-47c0249292a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.121527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159016-235d-4aae-b5c4-47c0249292a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.121868 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159016-235d-4aae-b5c4-47c0249292a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.122863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17159016-235d-4aae-b5c4-47c0249292a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:10.124879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17159016-235d-4aae-b5c4-47c0249292a8 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:10.169188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 863/1726] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:10.170436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17159016-235d-4aae-b5c4-47c0249292a8 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:10.175944 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e7fe5-d543-426d-8a7d-ef3435e8d811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:10.177723 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e7fe5-d543-426d-8a7d-ef3435e8d811 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:10.192962 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17159016-235d-4aae-b5c4-47c0249292a8 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:10.207656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f41f29-4232-47d7-8765-7844bb1001a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:10.208797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f41f29-4232-47d7-8765-7844bb1001a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.209284 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f41f29-4232-47d7-8765-7844bb1001a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.209805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f41f29-4232-47d7-8765-7844bb1001a8 admin admin] PATH_INFO: `/v3/projects/f2df477a087a45959b5fc53e1f706603/users/9b9ea87574054d1eb47bfc946a81f16a/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.212283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 864/1727] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:10.222313 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:10.244859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f41f29-4232-47d7-8765-7844bb1001a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2df477a087a45959b5fc53e1f706603, user_id=9b9ea87574054d1eb47bfc946a81f16a, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:10.248454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f41f29-4232-47d7-8765-7844bb1001a8 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:10.284752 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 864/1728] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:10 2022] PUT /identity/v3/projects/f2df477a087a45959b5fc53e1f706603/users/9b9ea87574054d1eb47bfc946a81f16a/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:10.287458 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a9933-f82d-44cc-a426-a388afdc8658 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.288046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a9933-f82d-44cc-a426-a388afdc8658 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.288647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a9933-f82d-44cc-a426-a388afdc8658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.356129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-999a9933-f82d-44cc-a426-a388afdc8658 None None] MFA Rules not processed for user `9b9ea87574054d1eb47bfc946a81f16a`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:10.357449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-999a9933-f82d-44cc-a426-a388afdc8658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:10.535087 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 865/1729] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:10.540984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f41f29-4232-47d7-8765-7844bb1001a8 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:10.719413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f41f29-4232-47d7-8765-7844bb1001a8 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:10.736037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a2879-5392-4a90-8464-e5b5fdbbd255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:10.736697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a2879-5392-4a90-8464-e5b5fdbbd255 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.736975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a2879-5392-4a90-8464-e5b5fdbbd255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.737255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a2879-5392-4a90-8464-e5b5fdbbd255 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.739034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a2879-5392-4a90-8464-e5b5fdbbd255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:10.741601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a2879-5392-4a90-8464-e5b5fdbbd255 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:10.797765 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 865/1730] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:10 2022] POST /identity/v3/projects => generated 365 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:10.802329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a9933-f82d-44cc-a426-a388afdc8658 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:10.822746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a9933-f82d-44cc-a426-a388afdc8658 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:10.959025 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:10.993495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74a68b-f399-4491-a055-703c2242199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:10.995102 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74a68b-f399-4491-a055-703c2242199b admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.995534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74a68b-f399-4491-a055-703c2242199b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.998558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74a68b-f399-4491-a055-703c2242199b admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.999969 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74a68b-f399-4491-a055-703c2242199b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:11.006285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74a68b-f399-4491-a055-703c2242199b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:11.091036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 866/1731] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:10 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:11.095830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a2879-5392-4a90-8464-e5b5fdbbd255 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:11.118673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a2879-5392-4a90-8464-e5b5fdbbd255 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:11.141089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1bb52-7dc5-444f-a6c8-c5f6dd36be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:11.143140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1bb52-7dc5-444f-a6c8-c5f6dd36be15 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:11.143335 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1bb52-7dc5-444f-a6c8-c5f6dd36be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:11.143733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1bb52-7dc5-444f-a6c8-c5f6dd36be15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:11.147793 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1bb52-7dc5-444f-a6c8-c5f6dd36be15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:11.157583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1bb52-7dc5-444f-a6c8-c5f6dd36be15 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:11.202809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74a68b-f399-4491-a055-703c2242199b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:11.203841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 866/1732] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:11.205588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1bb52-7dc5-444f-a6c8-c5f6dd36be15 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:11.206738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1e74a68b-f399-4491-a055-703c2242199b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:11.240518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1bb52-7dc5-444f-a6c8-c5f6dd36be15 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:11.256513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961d6e0-ce18-421f-a331-b1f41d093e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:11.257720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74a68b-f399-4491-a055-703c2242199b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:11.260389 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961d6e0-ce18-421f-a331-b1f41d093e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:11.261520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961d6e0-ce18-421f-a331-b1f41d093e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:11.261950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961d6e0-ce18-421f-a331-b1f41d093e1f admin admin] PATH_INFO: `/v3/projects/47be4cabb7c348ca81b69393f5b9c2de/users/381610b3712a43a2a9a97041885b77c0/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:11.295453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:11.296464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:11.296954 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:11.297439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] PATH_INFO: `/v3/projects/fbf89e2efeaa4088ae768762cadd3987` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:11.298816 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf89e2efeaa4088ae768762cadd3987)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:11.304419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:11.316010 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961d6e0-ce18-421f-a331-b1f41d093e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=47be4cabb7c348ca81b69393f5b9c2de, user_id=381610b3712a43a2a9a97041885b77c0, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:11.318920 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961d6e0-ce18-421f-a331-b1f41d093e1f admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:11.349473 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 867/1733] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:11 2022] PUT /identity/v3/projects/47be4cabb7c348ca81b69393f5b9c2de/users/381610b3712a43a2a9a97041885b77c0/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:11.356321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961d6e0-ce18-421f-a331-b1f41d093e1f admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:11.503476 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf89e2efeaa4088ae768762cadd3987', 'request_id': 'req-3d7cacb9-dde4-4635-98b2-5338c210739d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.520906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf89e2efeaa4088ae768762cadd3987', 'request_id': 'req-3d7cacb9-dde4-4635-98b2-5338c210739d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.532862 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf89e2efeaa4088ae768762cadd3987', 'request_id': 'req-3d7cacb9-dde4-4635-98b2-5338c210739d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.562379 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] The token cache is being invalidate because project fbf89e2efeaa4088ae768762cadd3987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:11.563017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.569048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.570751 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 867/1734] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:11 2022] DELETE /identity/v3/projects/fbf89e2efeaa4088ae768762cadd3987 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:11.571522 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:11.572960 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:11.595776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961d6e0-ce18-421f-a331-b1f41d093e1f admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:11.731208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:11.791392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bac32-a56a-447d-92ba-497303d143dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:11.792203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bac32-a56a-447d-92ba-497303d143dd admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:11.792575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bac32-a56a-447d-92ba-497303d143dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:11.793332 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bac32-a56a-447d-92ba-497303d143dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:11.794487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bac32-a56a-447d-92ba-497303d143dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:11.796840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bac32-a56a-447d-92ba-497303d143dd admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:11.832281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cacb9-dde4-4635-98b2-5338c210739d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:11.849450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f651a1-62a3-4ff5-b9c5-f1b70c6d1427 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01dd2631a81402d8a5bba7007c7fd61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:11.850316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f651a1-62a3-4ff5-b9c5-f1b70c6d1427 service placement] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:11.850759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f651a1-62a3-4ff5-b9c5-f1b70c6d1427 service placement] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:11.851157 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f651a1-62a3-4ff5-b9c5-f1b70c6d1427 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:11.853973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 868/1735] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:11.855740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9077e0-ae3b-44bf-b086-c6ff2c1e15df None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:11.856602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-34f651a1-62a3-4ff5-b9c5-f1b70c6d1427 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:11.858210 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9077e0-ae3b-44bf-b086-c6ff2c1e15df None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:11.859107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9077e0-ae3b-44bf-b086-c6ff2c1e15df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:11.878268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f651a1-62a3-4ff5-b9c5-f1b70c6d1427 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:11.886041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f651a1-62a3-4ff5-b9c5-f1b70c6d1427 service placement] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:11.902230 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-4a9077e0-ae3b-44bf-b086-c6ff2c1e15df None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:11.904422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-4a9077e0-ae3b-44bf-b086-c6ff2c1e15df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:11.915919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 868/1736] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:11.916636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f651a1-62a3-4ff5-b9c5-f1b70c6d1427 service placement] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:11.923727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-34f651a1-62a3-4ff5-b9c5-f1b70c6d1427 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:11.983851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 869/1737] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:11.987204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d260280-d1ab-4cd0-8dd0-7f6956123987 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:11.987486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d260280-d1ab-4cd0-8dd0-7f6956123987 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:11.987788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d260280-d1ab-4cd0-8dd0-7f6956123987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:11.994542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f651a1-62a3-4ff5-b9c5-f1b70c6d1427 service placement] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:12.010065 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c93bc5-78c1-4ed6-b3ea-0af0262a794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:12.011010 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c93bc5-78c1-4ed6-b3ea-0af0262a794d admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:12.013314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c93bc5-78c1-4ed6-b3ea-0af0262a794d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:12.013764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c93bc5-78c1-4ed6-b3ea-0af0262a794d admin admin] PATH_INFO: `/v3/projects/47be4cabb7c348ca81b69393f5b9c2de/users/381610b3712a43a2a9a97041885b77c0/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:12.021054 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c93bc5-78c1-4ed6-b3ea-0af0262a794d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47be4cabb7c348ca81b69393f5b9c2de, user_id=381610b3712a43a2a9a97041885b77c0, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:12.024242 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c93bc5-78c1-4ed6-b3ea-0af0262a794d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:12.083387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-1d260280-d1ab-4cd0-8dd0-7f6956123987 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:12.084653 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-1d260280-d1ab-4cd0-8dd0-7f6956123987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:12.104140 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 869/1738] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:11 2022] PUT /identity/v3/projects/47be4cabb7c348ca81b69393f5b9c2de/users/381610b3712a43a2a9a97041885b77c0/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:12.105791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab28a4a-1a71-456a-bd2c-890d4d4beef7 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:12.106114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab28a4a-1a71-456a-bd2c-890d4d4beef7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:12.106393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab28a4a-1a71-456a-bd2c-890d4d4beef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:12.215121 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-fab28a4a-1a71-456a-bd2c-890d4d4beef7 None None] MFA Rules not processed for user `381610b3712a43a2a9a97041885b77c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:12.217837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fab28a4a-1a71-456a-bd2c-890d4d4beef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:12.332031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 870/1739] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:12.335796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d260280-d1ab-4cd0-8dd0-7f6956123987 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:12.355075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:12.357252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d260280-d1ab-4cd0-8dd0-7f6956123987 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:12.394641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811d0a9-1670-4d8e-8de1-2bc8d0a2e924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:12.399190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d0a9-1670-4d8e-8de1-2bc8d0a2e924 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:12.400640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d0a9-1670-4d8e-8de1-2bc8d0a2e924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:12.401144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d0a9-1670-4d8e-8de1-2bc8d0a2e924 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:12.402771 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811d0a9-1670-4d8e-8de1-2bc8d0a2e924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:12.403414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811d0a9-1670-4d8e-8de1-2bc8d0a2e924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:12.411019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811d0a9-1670-4d8e-8de1-2bc8d0a2e924 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:12.493958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 871/1740] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:12.501382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811d0a9-1670-4d8e-8de1-2bc8d0a2e924 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:12.538165 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811d0a9-1670-4d8e-8de1-2bc8d0a2e924 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:12.565591 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767ba1a-8f80-49b5-91da-72c9a1915e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:12.570670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ba1a-8f80-49b5-91da-72c9a1915e63 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:12.571300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ba1a-8f80-49b5-91da-72c9a1915e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:12.571597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ba1a-8f80-49b5-91da-72c9a1915e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:12.573876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767ba1a-8f80-49b5-91da-72c9a1915e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:12.578071 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767ba1a-8f80-49b5-91da-72c9a1915e63 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:12.598641 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 870/1741] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:12.625633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab28a4a-1a71-456a-bd2c-890d4d4beef7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:12.644633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fab28a4a-1a71-456a-bd2c-890d4d4beef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:12.746402 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 872/1742] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:12 2022] POST /identity/v3/projects => generated 387 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:12.750765 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767ba1a-8f80-49b5-91da-72c9a1915e63 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:12.887624 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab28a4a-1a71-456a-bd2c-890d4d4beef7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:13.051790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65972854-2ee3-4cad-95db-0178c01774f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:13.055150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65972854-2ee3-4cad-95db-0178c01774f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:13.055821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65972854-2ee3-4cad-95db-0178c01774f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:13.057476 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767ba1a-8f80-49b5-91da-72c9a1915e63 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:13.058600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65972854-2ee3-4cad-95db-0178c01774f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:13.071544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b6fc7-a2cf-4513-863e-78700b0c0956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:13.074332 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b6fc7-a2cf-4513-863e-78700b0c0956 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:13.074623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b6fc7-a2cf-4513-863e-78700b0c0956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:13.077756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b6fc7-a2cf-4513-863e-78700b0c0956 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:13.078895 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b6fc7-a2cf-4513-863e-78700b0c0956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:13.090045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b6fc7-a2cf-4513-863e-78700b0c0956 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:13.180411 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 873/1743] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:12 2022] POST /identity/v3/users => generated 294 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:13.184294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af1cba-e7aa-4ba1-87a8-40dcd8096f96 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:13.186074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af1cba-e7aa-4ba1-87a8-40dcd8096f96 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:13.186359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af1cba-e7aa-4ba1-87a8-40dcd8096f96 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:13.194872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 874/1744] 10.222.0.50 () {54 vars in 912 bytes} [Wed Aug 31 00:21:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:21:13.198426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af1cba-e7aa-4ba1-87a8-40dcd8096f96 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:13.239231 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65972854-2ee3-4cad-95db-0178c01774f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:13.239425 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af1cba-e7aa-4ba1-87a8-40dcd8096f96 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:13.241118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65972854-2ee3-4cad-95db-0178c01774f0 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:13.255958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f57a94-02ba-49c1-9b5f-c293a54c6e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:13.258417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f57a94-02ba-49c1-9b5f-c293a54c6e62 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:13.258692 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f57a94-02ba-49c1-9b5f-c293a54c6e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:13.258972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f57a94-02ba-49c1-9b5f-c293a54c6e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:13.262322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 871/1745] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:13.265823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cd3a3-545c-4830-9200-80b850cec685 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:13.266333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cd3a3-545c-4830-9200-80b850cec685 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:13.266798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cd3a3-545c-4830-9200-80b850cec685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:13.277593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f57a94-02ba-49c1-9b5f-c293a54c6e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:13.283858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f57a94-02ba-49c1-9b5f-c293a54c6e62 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:13.324308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2f7cd3a3-545c-4830-9200-80b850cec685 None None] MFA Rules not processed for user `5bde943833bb43e78879748c49ce3332`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:13.325633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2f7cd3a3-545c-4830-9200-80b850cec685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:13.337073 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 875/1746] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:13.338861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f57a94-02ba-49c1-9b5f-c293a54c6e62 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:13.372714 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f57a94-02ba-49c1-9b5f-c293a54c6e62 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:13.389563 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84acbf-cb28-42ed-8b3d-0d01e37a5dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:13.390433 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84acbf-cb28-42ed-8b3d-0d01e37a5dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:13.390898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84acbf-cb28-42ed-8b3d-0d01e37a5dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:13.391342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84acbf-cb28-42ed-8b3d-0d01e37a5dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:13.392209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84acbf-cb28-42ed-8b3d-0d01e37a5dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:13.394244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84acbf-cb28-42ed-8b3d-0d01e37a5dcb admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:13.407548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 876/1747] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:13.412518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84acbf-cb28-42ed-8b3d-0d01e37a5dcb admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:13.434221 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:13.440950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:13.448580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84acbf-cb28-42ed-8b3d-0d01e37a5dcb admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:13.462837 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee61eb-1a98-42e1-8e10-6fe723a811ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:13.464448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee61eb-1a98-42e1-8e10-6fe723a811ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:13.465113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee61eb-1a98-42e1-8e10-6fe723a811ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:13.466569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee61eb-1a98-42e1-8e10-6fe723a811ef admin admin] PATH_INFO: `/v3/projects/a7e0c2edb38f49b6812ce16a6e068108/users/61d7155bb48a4684bf1fe86109798a99/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:13.504650 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 872/1748] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:21:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:13.522192 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee61eb-1a98-42e1-8e10-6fe723a811ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e0c2edb38f49b6812ce16a6e068108, user_id=61d7155bb48a4684bf1fe86109798a99, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:13.537490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee61eb-1a98-42e1-8e10-6fe723a811ef admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:13.582669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde23f5-25bf-422d-a985-33efe307fbee None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:13.583206 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde23f5-25bf-422d-a985-33efe307fbee None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:13.583726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde23f5-25bf-422d-a985-33efe307fbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:13.585597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 877/1749] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:13 2022] PUT /identity/v3/projects/a7e0c2edb38f49b6812ce16a6e068108/users/61d7155bb48a4684bf1fe86109798a99/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:13.603408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee61eb-1a98-42e1-8e10-6fe723a811ef admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:13.605177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d0ee61eb-1a98-42e1-8e10-6fe723a811ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:13.672834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1bde23f5-25bf-422d-a985-33efe307fbee None None] MFA Rules not processed for user `61d7155bb48a4684bf1fe86109798a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:13.685496 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1bde23f5-25bf-422d-a985-33efe307fbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:13.777299 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee61eb-1a98-42e1-8e10-6fe723a811ef admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:13.789513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89c879-ff2e-4a0d-97b3-c4d35ff1033e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:13.790306 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89c879-ff2e-4a0d-97b3-c4d35ff1033e service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:13.791858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89c879-ff2e-4a0d-97b3-c4d35ff1033e service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:13.792281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89c879-ff2e-4a0d-97b3-c4d35ff1033e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:13.814311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89c879-ff2e-4a0d-97b3-c4d35ff1033e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:13.818959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89c879-ff2e-4a0d-97b3-c4d35ff1033e service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:13.840639 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 878/1750] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:13.857154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 873/1751] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:13.862227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89c879-ff2e-4a0d-97b3-c4d35ff1033e service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:13.872465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba9697-502e-4337-a6c2-cc6057fd4c2c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:13.873026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba9697-502e-4337-a6c2-cc6057fd4c2c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:13.877203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba9697-502e-4337-a6c2-cc6057fd4c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:13.950872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7fba9697-502e-4337-a6c2-cc6057fd4c2c None None] MFA Rules not processed for user `0ae3ab8ab42b40739a90121bcbeaba2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:13.956547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7fba9697-502e-4337-a6c2-cc6057fd4c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:14.065098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89c879-ff2e-4a0d-97b3-c4d35ff1033e service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:14.076798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570789c4-f3c3-4744-99c1-0f73efe46901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:14.079757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570789c4-f3c3-4744-99c1-0f73efe46901 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:14.081141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570789c4-f3c3-4744-99c1-0f73efe46901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:14.089248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570789c4-f3c3-4744-99c1-0f73efe46901 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:14.093091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570789c4-f3c3-4744-99c1-0f73efe46901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:14.104026 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570789c4-f3c3-4744-99c1-0f73efe46901 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:14.133256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 874/1752] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:14.160024 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 879/1753] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:13 2022] POST /identity/v3/projects => generated 385 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:14.166509 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba9697-502e-4337-a6c2-cc6057fd4c2c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:14.186762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba9697-502e-4337-a6c2-cc6057fd4c2c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:14.258963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3bb02-3912-4769-b365-dc185dcaf435 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:14.259263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3bb02-3912-4769-b365-dc185dcaf435 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:14.259586 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3bb02-3912-4769-b365-dc185dcaf435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:14.338796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-45f3bb02-3912-4769-b365-dc185dcaf435 None None] MFA Rules not processed for user `f73759f32c794f20bbab3a9887c9d37c`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:14.347382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-45f3bb02-3912-4769-b365-dc185dcaf435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:14.388347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5191d2-60cd-4ab3-8345-f4be3498b213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:14.389524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5191d2-60cd-4ab3-8345-f4be3498b213 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:14.389947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5191d2-60cd-4ab3-8345-f4be3498b213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:14.390381 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5191d2-60cd-4ab3-8345-f4be3498b213 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:14.391174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5191d2-60cd-4ab3-8345-f4be3498b213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:14.393684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5191d2-60cd-4ab3-8345-f4be3498b213 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:14.422577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 875/1754] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:14 2022] POST /identity/v3/users => generated 299 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:14.424332 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5191d2-60cd-4ab3-8345-f4be3498b213 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:14.452462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5191d2-60cd-4ab3-8345-f4be3498b213 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:14.468404 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159800c-f443-4710-a1bc-592ca1019d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:14.469289 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159800c-f443-4710-a1bc-592ca1019d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:14.469716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159800c-f443-4710-a1bc-592ca1019d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:14.470145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159800c-f443-4710-a1bc-592ca1019d9d admin admin] PATH_INFO: `/v3/users/9b9ea87574054d1eb47bfc946a81f16a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:14.471664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159800c-f443-4710-a1bc-592ca1019d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9ea87574054d1eb47bfc946a81f16a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:14.477502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159800c-f443-4710-a1bc-592ca1019d9d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:14.481839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:14.498784 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 880/1755] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:14.499761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3bb02-3912-4769-b365-dc185dcaf435 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:14.523761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3bb02-3912-4769-b365-dc185dcaf435 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:14.534813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f603bb3-19af-4ea8-9f9b-2d2dcd94f83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:14.535453 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f603bb3-19af-4ea8-9f9b-2d2dcd94f83d admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:14.535904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f603bb3-19af-4ea8-9f9b-2d2dcd94f83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:14.536180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f603bb3-19af-4ea8-9f9b-2d2dcd94f83d admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:14.536875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f603bb3-19af-4ea8-9f9b-2d2dcd94f83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:14.538520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f603bb3-19af-4ea8-9f9b-2d2dcd94f83d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:14.568263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 881/1756] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:14.573748 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f603bb3-19af-4ea8-9f9b-2d2dcd94f83d admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:14.598779 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:14.607491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2159800c-f443-4710-a1bc-592ca1019d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9ea87574054d1eb47bfc946a81f16a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:14.614417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f603bb3-19af-4ea8-9f9b-2d2dcd94f83d admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:14.644493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c69e4-6cfa-4ac7-811c-40bafe8d3e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:14.645269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c69e4-6cfa-4ac7-811c-40bafe8d3e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:14.645548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c69e4-6cfa-4ac7-811c-40bafe8d3e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:14.645822 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c69e4-6cfa-4ac7-811c-40bafe8d3e81 admin admin] PATH_INFO: `/v3/projects/48a43065db01498a9b2f88d208c17c13/users/049e2c5a23b9460e9cc6959dc69bd9c6/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:14.663336 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2159800c-f443-4710-a1bc-592ca1019d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9ea87574054d1eb47bfc946a81f16a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:14.693188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2159800c-f443-4710-a1bc-592ca1019d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9ea87574054d1eb47bfc946a81f16a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:14.715004 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c69e4-6cfa-4ac7-811c-40bafe8d3e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a43065db01498a9b2f88d208c17c13, user_id=049e2c5a23b9460e9cc6959dc69bd9c6, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:14.724948 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c69e4-6cfa-4ac7-811c-40bafe8d3e81 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:14.736501 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2159800c-f443-4710-a1bc-592ca1019d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9ea87574054d1eb47bfc946a81f16a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:14.739249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2159800c-f443-4710-a1bc-592ca1019d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9ea87574054d1eb47bfc946a81f16a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:14.763041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 882/1757] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:14 2022] PUT /identity/v3/projects/48a43065db01498a9b2f88d208c17c13/users/049e2c5a23b9460e9cc6959dc69bd9c6/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:14.764490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c69e4-6cfa-4ac7-811c-40bafe8d3e81 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:14.771594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-4b7c69e4-6cfa-4ac7-811c-40bafe8d3e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:14.801546 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 876/1758] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:14 2022] DELETE /identity/v3/users/9b9ea87574054d1eb47bfc946a81f16a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:14.807333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf8fd2-c77b-43fe-8d57-1bd907d1027c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:14.808510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf8fd2-c77b-43fe-8d57-1bd907d1027c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:14.809748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf8fd2-c77b-43fe-8d57-1bd907d1027c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:14.848730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1baf8fd2-c77b-43fe-8d57-1bd907d1027c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:14.849982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1baf8fd2-c77b-43fe-8d57-1bd907d1027c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:14.913502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c69e4-6cfa-4ac7-811c-40bafe8d3e81 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:14.937279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 877/1759] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:15.018947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf8fd2-c77b-43fe-8d57-1bd907d1027c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:15.021569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1baf8fd2-c77b-43fe-8d57-1bd907d1027c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:15.023859 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b04ff-6315-4382-a8c2-ee584ec4862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:15.024629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b04ff-6315-4382-a8c2-ee584ec4862f admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:15.025115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b04ff-6315-4382-a8c2-ee584ec4862f admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:15.025515 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b04ff-6315-4382-a8c2-ee584ec4862f admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:15.026263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b04ff-6315-4382-a8c2-ee584ec4862f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:15.028364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b04ff-6315-4382-a8c2-ee584ec4862f admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:15.049512 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 883/1760] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:15.054765 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b04ff-6315-4382-a8c2-ee584ec4862f admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:15.091998 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b04ff-6315-4382-a8c2-ee584ec4862f admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:15.122331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e54fa0-0615-44bd-93f5-aabe0b300b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:15.123601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e54fa0-0615-44bd-93f5-aabe0b300b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:15.125507 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e54fa0-0615-44bd-93f5-aabe0b300b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:15.126349 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e54fa0-0615-44bd-93f5-aabe0b300b3a admin admin] PATH_INFO: `/v3/projects/48a43065db01498a9b2f88d208c17c13/users/049e2c5a23b9460e9cc6959dc69bd9c6/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:15.145839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e54fa0-0615-44bd-93f5-aabe0b300b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a43065db01498a9b2f88d208c17c13, user_id=049e2c5a23b9460e9cc6959dc69bd9c6, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:15.152832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e54fa0-0615-44bd-93f5-aabe0b300b3a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:15.186423 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf8fd2-c77b-43fe-8d57-1bd907d1027c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:15.196702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 884/1761] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:15 2022] PUT /identity/v3/projects/48a43065db01498a9b2f88d208c17c13/users/049e2c5a23b9460e9cc6959dc69bd9c6/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:15.207653 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201ef9a-6f3a-4764-af5d-ab4f2af01760 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:15.208518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201ef9a-6f3a-4764-af5d-ab4f2af01760 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:15.209065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201ef9a-6f3a-4764-af5d-ab4f2af01760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:15.272434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5201ef9a-6f3a-4764-af5d-ab4f2af01760 None None] MFA Rules not processed for user `049e2c5a23b9460e9cc6959dc69bd9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:15.273819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5201ef9a-6f3a-4764-af5d-ab4f2af01760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:15.282815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:15.338792 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9a2b0-5255-419d-9b7a-8f296909327b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:15.339337 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9a2b0-5255-419d-9b7a-8f296909327b service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:15.339623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9a2b0-5255-419d-9b7a-8f296909327b service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:15.339924 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9a2b0-5255-419d-9b7a-8f296909327b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:15.349362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:15.382195 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 885/1762] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:15.391384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201ef9a-6f3a-4764-af5d-ab4f2af01760 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:15.394905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5201ef9a-6f3a-4764-af5d-ab4f2af01760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:15.656489 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9a2b0-5255-419d-9b7a-8f296909327b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:15.666443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9a2b0-5255-419d-9b7a-8f296909327b service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:15.746722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 878/1763] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:15.766815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201ef9a-6f3a-4764-af5d-ab4f2af01760 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:15.781559 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ca739-ca4b-449d-b11a-b2bf6fcf4b05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:15.784092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ca739-ca4b-449d-b11a-b2bf6fcf4b05 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:15.787971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ca739-ca4b-449d-b11a-b2bf6fcf4b05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:15.790397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ca739-ca4b-449d-b11a-b2bf6fcf4b05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:15.846376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ca739-ca4b-449d-b11a-b2bf6fcf4b05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:15.851253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ca739-ca4b-449d-b11a-b2bf6fcf4b05 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:15.903406 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 886/1764] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:15.973377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9a2b0-5255-419d-9b7a-8f296909327b service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:15.988841 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9a2b0-5255-419d-9b7a-8f296909327b service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:16.007111 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31ee1b-3919-4638-82dd-2ddca20a60ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:16.007111 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31ee1b-3919-4638-82dd-2ddca20a60ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:16.007111 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31ee1b-3919-4638-82dd-2ddca20a60ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:16.007111 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31ee1b-3919-4638-82dd-2ddca20a60ac admin admin] PATH_INFO: `/v3/users/61d7155bb48a4684bf1fe86109798a99` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:16.008132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31ee1b-3919-4638-82dd-2ddca20a60ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d7155bb48a4684bf1fe86109798a99)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:16.020346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31ee1b-3919-4638-82dd-2ddca20a60ac admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:16.274921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8e31ee1b-3919-4638-82dd-2ddca20a60ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d7155bb48a4684bf1fe86109798a99'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:16.293454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1618222-d74d-4639-af34-d51f5ff45570 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:16.293978 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1618222-d74d-4639-af34-d51f5ff45570 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:16.294390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1618222-d74d-4639-af34-d51f5ff45570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:16.344432 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8e31ee1b-3919-4638-82dd-2ddca20a60ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d7155bb48a4684bf1fe86109798a99'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:16.375284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8e31ee1b-3919-4638-82dd-2ddca20a60ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d7155bb48a4684bf1fe86109798a99'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:16.400701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8e31ee1b-3919-4638-82dd-2ddca20a60ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d7155bb48a4684bf1fe86109798a99'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:16.402178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8e31ee1b-3919-4638-82dd-2ddca20a60ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d7155bb48a4684bf1fe86109798a99'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:16.410322 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-b1618222-d74d-4639-af34-d51f5ff45570 None None] MFA Rules not processed for user `7b05f63c8a054e6dbfe70a70c50805cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:16.411628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b1618222-d74d-4639-af34-d51f5ff45570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:16.412562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 879/1765] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:15 2022] DELETE /identity/v3/users/61d7155bb48a4684bf1fe86109798a99 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:16.417270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cde1d4-b4f7-489f-ad86-e51ca5da277e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:16.417876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cde1d4-b4f7-489f-ad86-e51ca5da277e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:16.418330 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cde1d4-b4f7-489f-ad86-e51ca5da277e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:16.449763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c0cde1d4-b4f7-489f-ad86-e51ca5da277e None None] MFA Rules not processed for user `1aeead6fcbc54b39826b5da033dd9d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:16.452043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c0cde1d4-b4f7-489f-ad86-e51ca5da277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:16.575907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 880/1766] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:16.577733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c614f9-ddd0-4ffc-a9a2-3d48102b2bcc None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:16.578312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c614f9-ddd0-4ffc-a9a2-3d48102b2bcc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:16.578883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c614f9-ddd0-4ffc-a9a2-3d48102b2bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:16.601352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:16.649936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a6c614f9-ddd0-4ffc-a9a2-3d48102b2bcc None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:16.651419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a6c614f9-ddd0-4ffc-a9a2-3d48102b2bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:16.676773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 887/1767] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:16.676773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94894e8e-5130-4d86-8c5e-d7abe8570b15 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:16.676773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94894e8e-5130-4d86-8c5e-d7abe8570b15 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:16.676773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94894e8e-5130-4d86-8c5e-d7abe8570b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:16.888923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 881/1768] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:16.912782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-94894e8e-5130-4d86-8c5e-d7abe8570b15 None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:16.922254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-94894e8e-5130-4d86-8c5e-d7abe8570b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:17.171860 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c614f9-ddd0-4ffc-a9a2-3d48102b2bcc None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:17.174524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a6c614f9-ddd0-4ffc-a9a2-3d48102b2bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:17.268638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 888/1769] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:21:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 598 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:17.520822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c614f9-ddd0-4ffc-a9a2-3d48102b2bcc None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:17.544463 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4767acb-481d-48d3-bf87-686cfcc4dc94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:17.545457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767acb-481d-48d3-bf87-686cfcc4dc94 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:17.545926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767acb-481d-48d3-bf87-686cfcc4dc94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:17.546401 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4767acb-481d-48d3-bf87-686cfcc4dc94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:17.627052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4767acb-481d-48d3-bf87-686cfcc4dc94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:17.627052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4767acb-481d-48d3-bf87-686cfcc4dc94 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:17.662675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94894e8e-5130-4d86-8c5e-d7abe8570b15 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:17.665019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-94894e8e-5130-4d86-8c5e-d7abe8570b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:17.700167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 882/1770] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:17.711393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:17.917892 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94894e8e-5130-4d86-8c5e-d7abe8570b15 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:17.931024 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242b35b-5de2-4a34-8701-89cde7581ff6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:17.932181 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242b35b-5de2-4a34-8701-89cde7581ff6 service swift] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:17.932670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242b35b-5de2-4a34-8701-89cde7581ff6 service swift] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:17.933152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242b35b-5de2-4a34-8701-89cde7581ff6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:17.950223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242b35b-5de2-4a34-8701-89cde7581ff6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:17.952229 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242b35b-5de2-4a34-8701-89cde7581ff6 service swift] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:17.973975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 889/1771] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:21:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:21:19.064970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4767acb-481d-48d3-bf87-686cfcc4dc94 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:19.066782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a4767acb-481d-48d3-bf87-686cfcc4dc94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:19.092982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4767acb-481d-48d3-bf87-686cfcc4dc94 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:19.105616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:19.107065 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:19.108401 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:19.109588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] PATH_INFO: `/v3/projects/f2df477a087a45959b5fc53e1f706603` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:19.113635 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2df477a087a45959b5fc53e1f706603)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:19.118754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:19.296433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2df477a087a45959b5fc53e1f706603', 'request_id': 'req-00280b9c-9673-4e66-a758-17d561871bf4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:19.321917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2df477a087a45959b5fc53e1f706603', 'request_id': 'req-00280b9c-9673-4e66-a758-17d561871bf4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:19.362655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2df477a087a45959b5fc53e1f706603', 'request_id': 'req-00280b9c-9673-4e66-a758-17d561871bf4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:19.384924 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] The token cache is being invalidate because project f2df477a087a45959b5fc53e1f706603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:19.392686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:19.392686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:19.413240 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 883/1772] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:19 2022] DELETE /identity/v3/projects/f2df477a087a45959b5fc53e1f706603 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:19.415493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242b35b-5de2-4a34-8701-89cde7581ff6 service swift] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:19.437206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242b35b-5de2-4a34-8701-89cde7581ff6 service swift] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:19.566888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84cc6c-8333-48cf-b53c-0523b1643202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:19.568567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84cc6c-8333-48cf-b53c-0523b1643202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:19.569320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84cc6c-8333-48cf-b53c-0523b1643202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:19.569960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84cc6c-8333-48cf-b53c-0523b1643202 admin admin] PATH_INFO: `/v3/users/381610b3712a43a2a9a97041885b77c0` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:19.573427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84cc6c-8333-48cf-b53c-0523b1643202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381610b3712a43a2a9a97041885b77c0)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:19.577848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84cc6c-8333-48cf-b53c-0523b1643202 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:19.700022 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-bd84cc6c-8333-48cf-b53c-0523b1643202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381610b3712a43a2a9a97041885b77c0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:19.742850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-bd84cc6c-8333-48cf-b53c-0523b1643202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381610b3712a43a2a9a97041885b77c0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:19.779569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-bd84cc6c-8333-48cf-b53c-0523b1643202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381610b3712a43a2a9a97041885b77c0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:19.830176 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-bd84cc6c-8333-48cf-b53c-0523b1643202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381610b3712a43a2a9a97041885b77c0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:19.832998 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-bd84cc6c-8333-48cf-b53c-0523b1643202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381610b3712a43a2a9a97041885b77c0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:19.863801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 890/1773] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:19 2022] DELETE /identity/v3/users/381610b3712a43a2a9a97041885b77c0 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:22.617539 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:22.619163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:22.644012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00280b9c-9673-4e66-a758-17d561871bf4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:22.700344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:22.780601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:22.781829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:22.782439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:22.782929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] PATH_INFO: `/v3/projects/a7e0c2edb38f49b6812ce16a6e068108` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:22.784454 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e0c2edb38f49b6812ce16a6e068108)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:22.786719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:22.884930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84cc6c-8333-48cf-b53c-0523b1643202 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:22.887359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-bd84cc6c-8333-48cf-b53c-0523b1643202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:22.896123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:22.911640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84cc6c-8333-48cf-b53c-0523b1643202 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:22.960431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e0c2edb38f49b6812ce16a6e068108', 'request_id': 'req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:22.995731 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e0c2edb38f49b6812ce16a6e068108', 'request_id': 'req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.016590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e0c2edb38f49b6812ce16a6e068108', 'request_id': 'req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.073123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] The token cache is being invalidate because project a7e0c2edb38f49b6812ce16a6e068108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:23.073576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.085631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.094599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 884/1774] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:22 2022] DELETE /identity/v3/projects/a7e0c2edb38f49b6812ce16a6e068108 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:23.098101 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:23.100520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3193563-6681-4a0b-b712-4b352fad9433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:23.100693 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:23.102073 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3193563-6681-4a0b-b712-4b352fad9433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:23.102379 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3193563-6681-4a0b-b712-4b352fad9433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:23.102661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3193563-6681-4a0b-b712-4b352fad9433 admin admin] PATH_INFO: `/v3/projects/47be4cabb7c348ca81b69393f5b9c2de` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:23.107386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3193563-6681-4a0b-b712-4b352fad9433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47be4cabb7c348ca81b69393f5b9c2de)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:23.118898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3193563-6681-4a0b-b712-4b352fad9433 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:23.132746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af6d6e-5e5c-49bd-bf68-f70926d5fd67 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:23.152766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9c444-5c76-45a7-a66a-61275e372121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:23.153442 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9c444-5c76-45a7-a66a-61275e372121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:23.153726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9c444-5c76-45a7-a66a-61275e372121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:23.154004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9c444-5c76-45a7-a66a-61275e372121 admin admin] PATH_INFO: `/v3/users/049e2c5a23b9460e9cc6959dc69bd9c6` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:23.156466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9c444-5c76-45a7-a66a-61275e372121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=049e2c5a23b9460e9cc6959dc69bd9c6)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:23.159082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9c444-5c76-45a7-a66a-61275e372121 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:23.326571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f3193563-6681-4a0b-b712-4b352fad9433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47be4cabb7c348ca81b69393f5b9c2de', 'request_id': 'req-f3193563-6681-4a0b-b712-4b352fad9433'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.331690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-66b9c444-5c76-45a7-a66a-61275e372121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '049e2c5a23b9460e9cc6959dc69bd9c6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.353838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f3193563-6681-4a0b-b712-4b352fad9433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47be4cabb7c348ca81b69393f5b9c2de', 'request_id': 'req-f3193563-6681-4a0b-b712-4b352fad9433'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.365067 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-66b9c444-5c76-45a7-a66a-61275e372121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '049e2c5a23b9460e9cc6959dc69bd9c6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.379311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f3193563-6681-4a0b-b712-4b352fad9433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47be4cabb7c348ca81b69393f5b9c2de', 'request_id': 'req-f3193563-6681-4a0b-b712-4b352fad9433'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.386101 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-66b9c444-5c76-45a7-a66a-61275e372121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '049e2c5a23b9460e9cc6959dc69bd9c6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.417438 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-66b9c444-5c76-45a7-a66a-61275e372121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '049e2c5a23b9460e9cc6959dc69bd9c6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.418140 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-66b9c444-5c76-45a7-a66a-61275e372121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '049e2c5a23b9460e9cc6959dc69bd9c6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.424668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f3193563-6681-4a0b-b712-4b352fad9433 admin admin] The token cache is being invalidate because project 47be4cabb7c348ca81b69393f5b9c2de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:23.425238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f3193563-6681-4a0b-b712-4b352fad9433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.439735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f3193563-6681-4a0b-b712-4b352fad9433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.439735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 891/1775] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:22 2022] DELETE /identity/v3/projects/47be4cabb7c348ca81b69393f5b9c2de => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:23.439735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320f247-03af-4cc1-974d-d639df6beaef None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:23.439735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320f247-03af-4cc1-974d-d639df6beaef None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:23.439735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320f247-03af-4cc1-974d-d639df6beaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:23.444644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 885/1776] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:23 2022] DELETE /identity/v3/users/049e2c5a23b9460e9cc6959dc69bd9c6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:23.489307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-6320f247-03af-4cc1-974d-d639df6beaef None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:23.492356 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6320f247-03af-4cc1-974d-d639df6beaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:23.672728 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 892/1777] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:23.674872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe0e4e-6626-4ee0-863e-ab832e3c51f5 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:23.675398 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe0e4e-6626-4ee0-863e-ab832e3c51f5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:23.675517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe0e4e-6626-4ee0-863e-ab832e3c51f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:23.723916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f360c-e17b-4583-bee3-d69f1d18c674 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:23.723916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f360c-e17b-4583-bee3-d69f1d18c674 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:23.724144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f360c-e17b-4583-bee3-d69f1d18c674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:23.777652 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-af7f360c-e17b-4583-bee3-d69f1d18c674 None None] MFA Rules not processed for user `5bde943833bb43e78879748c49ce3332`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:23.782218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-af7f360c-e17b-4583-bee3-d69f1d18c674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:23.787041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-5ffe0e4e-6626-4ee0-863e-ab832e3c51f5 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:23.788799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5ffe0e4e-6626-4ee0-863e-ab832e3c51f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:23.848752 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 886/1778] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:23.853349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe0e4e-6626-4ee0-863e-ab832e3c51f5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:23.873494 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe0e4e-6626-4ee0-863e-ab832e3c51f5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:23.881376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:23.891636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b8324-b4ee-416b-832e-09a4a7f0059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:23.892513 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b8324-b4ee-416b-832e-09a4a7f0059d admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:23.893649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b8324-b4ee-416b-832e-09a4a7f0059d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:23.894081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b8324-b4ee-416b-832e-09a4a7f0059d admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:23.895471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b8324-b4ee-416b-832e-09a4a7f0059d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:23.896018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b8324-b4ee-416b-832e-09a4a7f0059d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:23.901371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b8324-b4ee-416b-832e-09a4a7f0059d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:23.932974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 887/1779] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:21:23.936904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b8324-b4ee-416b-832e-09a4a7f0059d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:23.971845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b8324-b4ee-416b-832e-09a4a7f0059d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:23.987567 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc01b4f-51ab-4cbf-ab8a-4685c2557cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:23.988411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc01b4f-51ab-4cbf-ab8a-4685c2557cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:23.988693 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc01b4f-51ab-4cbf-ab8a-4685c2557cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:23.988970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc01b4f-51ab-4cbf-ab8a-4685c2557cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:23.990473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc01b4f-51ab-4cbf-ab8a-4685c2557cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:23.992433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc01b4f-51ab-4cbf-ab8a-4685c2557cf4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:24.012706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 893/1780] 10.222.0.66 () {58 vars in 1015 bytes} [Wed Aug 31 00:21:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:24.028198 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:24.100481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 888/1781] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:23 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:24.101630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f360c-e17b-4583-bee3-d69f1d18c674 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:24.132910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f360c-e17b-4583-bee3-d69f1d18c674 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:24.232696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc01b4f-51ab-4cbf-ab8a-4685c2557cf4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:24.234551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ebc01b4f-51ab-4cbf-ab8a-4685c2557cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:24.348582 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e43105-c8a6-4250-a075-e33587e92c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:24.349242 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e43105-c8a6-4250-a075-e33587e92c55 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:24.349520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e43105-c8a6-4250-a075-e33587e92c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:24.349820 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e43105-c8a6-4250-a075-e33587e92c55 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:24.350488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e43105-c8a6-4250-a075-e33587e92c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:24.352898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e43105-c8a6-4250-a075-e33587e92c55 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:24.398019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 894/1782] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:24 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:24.399157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e43105-c8a6-4250-a075-e33587e92c55 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:24.441427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc01b4f-51ab-4cbf-ab8a-4685c2557cf4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:24.457160 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e43105-c8a6-4250-a075-e33587e92c55 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:24.460450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03076101-22d5-4341-bc37-aaa623f4ec76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:24.463612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03076101-22d5-4341-bc37-aaa623f4ec76 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:24.464079 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03076101-22d5-4341-bc37-aaa623f4ec76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:24.464319 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03076101-22d5-4341-bc37-aaa623f4ec76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:24.487915 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850c1ae-2215-421c-80af-cde961cfd92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:24.488634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850c1ae-2215-421c-80af-cde961cfd92a service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:24.488921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850c1ae-2215-421c-80af-cde961cfd92a service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:24.489213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850c1ae-2215-421c-80af-cde961cfd92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:24.528417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850c1ae-2215-421c-80af-cde961cfd92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:24.530209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850c1ae-2215-421c-80af-cde961cfd92a service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:24.533079 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03076101-22d5-4341-bc37-aaa623f4ec76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:24.538982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03076101-22d5-4341-bc37-aaa623f4ec76 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:24.556322 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 895/1783] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:24.557475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850c1ae-2215-421c-80af-cde961cfd92a service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:24.596366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850c1ae-2215-421c-80af-cde961cfd92a service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:24.608297 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f5f49-3d8c-4636-93a6-ece7688f7595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:24.610269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5f49-3d8c-4636-93a6-ece7688f7595 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:24.611471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5f49-3d8c-4636-93a6-ece7688f7595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:24.615522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5f49-3d8c-4636-93a6-ece7688f7595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:24.616464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f5f49-3d8c-4636-93a6-ece7688f7595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:24.618241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f5f49-3d8c-4636-93a6-ece7688f7595 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:24.622393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 889/1784] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:24.650956 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 896/1785] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:24.652305 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03076101-22d5-4341-bc37-aaa623f4ec76 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:24.682729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03076101-22d5-4341-bc37-aaa623f4ec76 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:24.707850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61372b2-2e46-444b-a03d-d0793dbaf65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:24.711260 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61372b2-2e46-444b-a03d-d0793dbaf65b admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:24.713742 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61372b2-2e46-444b-a03d-d0793dbaf65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:24.716665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61372b2-2e46-444b-a03d-d0793dbaf65b admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:24.722162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61372b2-2e46-444b-a03d-d0793dbaf65b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:24.732487 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61372b2-2e46-444b-a03d-d0793dbaf65b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:24.762758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f5f49-3d8c-4636-93a6-ece7688f7595 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:24.773368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 890/1786] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:24.783964 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f5f49-3d8c-4636-93a6-ece7688f7595 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:24.802784 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb070e0-460f-45d9-88cf-e7cdeff8c72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:24.803477 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb070e0-460f-45d9-88cf-e7cdeff8c72f admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:24.803788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb070e0-460f-45d9-88cf-e7cdeff8c72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:24.804311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb070e0-460f-45d9-88cf-e7cdeff8c72f admin admin] PATH_INFO: `/v3/projects/021766efd140433ba090613b0f25f107/users/0853eab2a7744e7ca42b2643214cb2d8/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:24.869478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb070e0-460f-45d9-88cf-e7cdeff8c72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=021766efd140433ba090613b0f25f107, user_id=0853eab2a7744e7ca42b2643214cb2d8, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:24.872956 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb070e0-460f-45d9-88cf-e7cdeff8c72f admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:24.907112 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 897/1787] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:24 2022] PUT /identity/v3/projects/021766efd140433ba090613b0f25f107/users/0853eab2a7744e7ca42b2643214cb2d8/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:24.917812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964164d0-4854-4988-a09f-1e66dcfb16c8 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:24.918093 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964164d0-4854-4988-a09f-1e66dcfb16c8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:24.918556 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964164d0-4854-4988-a09f-1e66dcfb16c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:24.968562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb070e0-460f-45d9-88cf-e7cdeff8c72f admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:24.970493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-8bb070e0-460f-45d9-88cf-e7cdeff8c72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:25.008820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-964164d0-4854-4988-a09f-1e66dcfb16c8 None None] MFA Rules not processed for user `0853eab2a7744e7ca42b2643214cb2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:25.010114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-964164d0-4854-4988-a09f-1e66dcfb16c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:25.225383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb070e0-460f-45d9-88cf-e7cdeff8c72f admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:25.237892 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:25.240560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:25.241004 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:25.242320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] PATH_INFO: `/v3/projects/48a43065db01498a9b2f88d208c17c13` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:25.244710 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a43065db01498a9b2f88d208c17c13)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:25.250727 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:25.274267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 891/1788] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:25.275664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964164d0-4854-4988-a09f-1e66dcfb16c8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:25.291387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964164d0-4854-4988-a09f-1e66dcfb16c8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:25.301183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5166ea-db0e-4deb-aeae-94f84bfdc2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:25.301913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5166ea-db0e-4deb-aeae-94f84bfdc2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:25.302284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5166ea-db0e-4deb-aeae-94f84bfdc2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:25.302660 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5166ea-db0e-4deb-aeae-94f84bfdc2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:25.303380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5166ea-db0e-4deb-aeae-94f84bfdc2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:25.309099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5166ea-db0e-4deb-aeae-94f84bfdc2a9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:25.330246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:25.363204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a43065db01498a9b2f88d208c17c13', 'request_id': 'req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:25.380944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a43065db01498a9b2f88d208c17c13', 'request_id': 'req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:25.389852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a43065db01498a9b2f88d208c17c13', 'request_id': 'req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:25.424328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] The token cache is being invalidate because project 48a43065db01498a9b2f88d208c17c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:25.424679 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:25.425221 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 892/1789] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:25 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:25.427768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:25.427768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 898/1790] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:24 2022] DELETE /identity/v3/projects/48a43065db01498a9b2f88d208c17c13 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:25.431592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:25.436128 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:25.441683 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916b1ee-1ba2-40d1-b005-9d569992e648 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:25.442002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916b1ee-1ba2-40d1-b005-9d569992e648 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:25.442310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916b1ee-1ba2-40d1-b005-9d569992e648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:25.515960 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4916b1ee-1ba2-40d1-b005-9d569992e648 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:25.517012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4916b1ee-1ba2-40d1-b005-9d569992e648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:25.654133 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c234f-8e63-4413-9be4-c3fe6d0eeaa0 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:25.670887 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:25.708173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 893/1791] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:25.717206 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0ed48-190e-4af6-9266-a7902ca99087 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:25.717786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0ed48-190e-4af6-9266-a7902ca99087 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:25.718298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0ed48-190e-4af6-9266-a7902ca99087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:25.762260 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f0b0ed48-190e-4af6-9266-a7902ca99087 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:25.764481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f0b0ed48-190e-4af6-9266-a7902ca99087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:25.785255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 894/1792] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:25.789395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0ed48-190e-4af6-9266-a7902ca99087 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:25.813278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0ed48-190e-4af6-9266-a7902ca99087 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:25.848298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e432ba-298e-4b67-9d1e-ae91d2e930b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:25.848943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e432ba-298e-4b67-9d1e-ae91d2e930b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:25.849215 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e432ba-298e-4b67-9d1e-ae91d2e930b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:25.849494 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e432ba-298e-4b67-9d1e-ae91d2e930b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:25.850144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e432ba-298e-4b67-9d1e-ae91d2e930b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:25.850443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e432ba-298e-4b67-9d1e-ae91d2e930b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:25.853721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e432ba-298e-4b67-9d1e-ae91d2e930b8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:25.856236 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7c32-85a1-4b37-a800-871d572bb6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:25.856959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7c32-85a1-4b37-a800-871d572bb6ef admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:25.857277 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7c32-85a1-4b37-a800-871d572bb6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:25.857588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7c32-85a1-4b37-a800-871d572bb6ef admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:25.858409 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f7c32-85a1-4b37-a800-871d572bb6ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:25.863073 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f7c32-85a1-4b37-a800-871d572bb6ef admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:25.893777 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 895/1793] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:21:25.904987 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e432ba-298e-4b67-9d1e-ae91d2e930b8 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:25.937282 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 899/1794] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:25 2022] POST /identity/v3/users => generated 291 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:25.937497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e432ba-298e-4b67-9d1e-ae91d2e930b8 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:25.938367 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7c32-85a1-4b37-a800-871d572bb6ef admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:25.957051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05029a-e3f7-4200-a159-60e806db9023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:25.958098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05029a-e3f7-4200-a159-60e806db9023 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:25.958778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05029a-e3f7-4200-a159-60e806db9023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:25.959944 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05029a-e3f7-4200-a159-60e806db9023 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:25.960793 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05029a-e3f7-4200-a159-60e806db9023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:25.964781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05029a-e3f7-4200-a159-60e806db9023 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:25.968075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7c32-85a1-4b37-a800-871d572bb6ef admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:26.001570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb62b93-2406-4783-b17e-07bd6303585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:26.002472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb62b93-2406-4783-b17e-07bd6303585d admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:26.002922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb62b93-2406-4783-b17e-07bd6303585d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:26.003179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb62b93-2406-4783-b17e-07bd6303585d admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:26.003939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb62b93-2406-4783-b17e-07bd6303585d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:26.006124 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb62b93-2406-4783-b17e-07bd6303585d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:26.059046 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 900/1795] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:26.060041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 896/1796] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:25 2022] POST /identity/v3/projects => generated 393 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:26.063277 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05029a-e3f7-4200-a159-60e806db9023 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:26.065369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb62b93-2406-4783-b17e-07bd6303585d admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:26.116275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb62b93-2406-4783-b17e-07bd6303585d admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:26.225078 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05029a-e3f7-4200-a159-60e806db9023 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:26.242078 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ec7e3-d604-477b-b67b-0be6163a0e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:26.243118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ec7e3-d604-477b-b67b-0be6163a0e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:26.244387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ec7e3-d604-477b-b67b-0be6163a0e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:26.245278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ec7e3-d604-477b-b67b-0be6163a0e40 admin admin] PATH_INFO: `/v3/projects/851df0d212e14938b2ec515073a0aa37/users/6d0e8722399d42ea87c0cee23da98829/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:26.287849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ec7e3-d604-477b-b67b-0be6163a0e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=851df0d212e14938b2ec515073a0aa37, user_id=6d0e8722399d42ea87c0cee23da98829, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:26.290893 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ec7e3-d604-477b-b67b-0be6163a0e40 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:26.300359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:26.333752 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 897/1797] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:26 2022] PUT /identity/v3/projects/851df0d212e14938b2ec515073a0aa37/users/6d0e8722399d42ea87c0cee23da98829/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:26.335025 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ec7e3-d604-477b-b67b-0be6163a0e40 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:26.358147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0bfaa-214a-49aa-a8ab-1dd58118b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:26.361145 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0bfaa-214a-49aa-a8ab-1dd58118b052 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:26.361572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0bfaa-214a-49aa-a8ab-1dd58118b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:26.363263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0bfaa-214a-49aa-a8ab-1dd58118b052 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:26.364745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0bfaa-214a-49aa-a8ab-1dd58118b052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:26.367726 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0bfaa-214a-49aa-a8ab-1dd58118b052 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:26.450396 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 901/1798] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:26 2022] POST /identity/v3/users => generated 297 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:26.462513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0bfaa-214a-49aa-a8ab-1dd58118b052 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:26.488113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0bfaa-214a-49aa-a8ab-1dd58118b052 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:26.523291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ec7e3-d604-477b-b67b-0be6163a0e40 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:26.535679 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dc877-6497-4754-a240-f627b647994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:26.536474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dc877-6497-4754-a240-f627b647994d admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:26.536821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dc877-6497-4754-a240-f627b647994d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:26.537110 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dc877-6497-4754-a240-f627b647994d admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:26.538623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dc877-6497-4754-a240-f627b647994d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:26.540862 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dc877-6497-4754-a240-f627b647994d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:26.572296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 898/1799] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:26.575623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dc877-6497-4754-a240-f627b647994d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:26.598236 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dc877-6497-4754-a240-f627b647994d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:26.612352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5f1b6-5de9-4a69-b144-5244565188ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:26.614243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f1b6-5de9-4a69-b144-5244565188ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:26.615119 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f1b6-5de9-4a69-b144-5244565188ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:26.616042 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f1b6-5de9-4a69-b144-5244565188ef admin admin] PATH_INFO: `/v3/projects/851df0d212e14938b2ec515073a0aa37/users/6d0e8722399d42ea87c0cee23da98829/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:26.621012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5f1b6-5de9-4a69-b144-5244565188ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=851df0d212e14938b2ec515073a0aa37, user_id=6d0e8722399d42ea87c0cee23da98829, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:26.630146 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5f1b6-5de9-4a69-b144-5244565188ef admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:26.669105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 899/1800] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:26 2022] PUT /identity/v3/projects/851df0d212e14938b2ec515073a0aa37/users/6d0e8722399d42ea87c0cee23da98829/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:26.673197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e79e4-3b9a-46ca-aaaf-d7a4368f1830 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:26.673827 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e79e4-3b9a-46ca-aaaf-d7a4368f1830 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:26.674300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e79e4-3b9a-46ca-aaaf-d7a4368f1830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:26.710363 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ecaee-c2e2-484f-9099-76b07b494d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:26.710880 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ecaee-c2e2-484f-9099-76b07b494d8b admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:26.711164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ecaee-c2e2-484f-9099-76b07b494d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:26.711439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ecaee-c2e2-484f-9099-76b07b494d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:26.712188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ecaee-c2e2-484f-9099-76b07b494d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:26.719333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ecaee-c2e2-484f-9099-76b07b494d8b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:26.729363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:26.746642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3c8e79e4-3b9a-46ca-aaaf-d7a4368f1830 None None] MFA Rules not processed for user `6d0e8722399d42ea87c0cee23da98829`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:26.752648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 902/1801] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:26.758739 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3c8e79e4-3b9a-46ca-aaaf-d7a4368f1830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:26.765721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ecaee-c2e2-484f-9099-76b07b494d8b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:26.791460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ecaee-c2e2-484f-9099-76b07b494d8b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:26.953558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 900/1802] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:26.985725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e79e4-3b9a-46ca-aaaf-d7a4368f1830 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:26.989674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3c8e79e4-3b9a-46ca-aaaf-d7a4368f1830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:27.027267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da444595-d456-4534-8cea-42349023eaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:27.030440 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da444595-d456-4534-8cea-42349023eaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:27.030855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da444595-d456-4534-8cea-42349023eaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:27.031090 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da444595-d456-4534-8cea-42349023eaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:27.034896 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da444595-d456-4534-8cea-42349023eaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:27.042259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da444595-d456-4534-8cea-42349023eaf1 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:27.071224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 903/1803] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:27.075621 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da444595-d456-4534-8cea-42349023eaf1 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:27.096478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da444595-d456-4534-8cea-42349023eaf1 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:27.118269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c267438-c25d-4568-9f54-32a2ae471390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:27.119061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c267438-c25d-4568-9f54-32a2ae471390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:27.119227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c267438-c25d-4568-9f54-32a2ae471390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:27.119499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c267438-c25d-4568-9f54-32a2ae471390 admin admin] PATH_INFO: `/v3/projects/e9418e231eb94f4785d2e7b46a800b79/users/ed4c4aac7a3d4385847a4ac825c4596c/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:27.140130 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c267438-c25d-4568-9f54-32a2ae471390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9418e231eb94f4785d2e7b46a800b79, user_id=ed4c4aac7a3d4385847a4ac825c4596c, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:27.146306 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c267438-c25d-4568-9f54-32a2ae471390 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:27.174264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 904/1804] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:27 2022] PUT /identity/v3/projects/e9418e231eb94f4785d2e7b46a800b79/users/ed4c4aac7a3d4385847a4ac825c4596c/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:27.184696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e79e4-3b9a-46ca-aaaf-d7a4368f1830 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:27.191229 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2aa8-b3e1-4c7b-a6f7-8fed29eb4a77 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:27.193402 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2aa8-b3e1-4c7b-a6f7-8fed29eb4a77 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:27.194138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2aa8-b3e1-4c7b-a6f7-8fed29eb4a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:27.342204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-dfda2aa8-b3e1-4c7b-a6f7-8fed29eb4a77 None None] MFA Rules not processed for user `ed4c4aac7a3d4385847a4ac825c4596c`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:27.343786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34e6c0-a879-4097-81c9-89f7e1d0d98e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:27.344480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34e6c0-a879-4097-81c9-89f7e1d0d98e service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:27.344768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34e6c0-a879-4097-81c9-89f7e1d0d98e service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:27.345045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34e6c0-a879-4097-81c9-89f7e1d0d98e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:27.348193 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-dfda2aa8-b3e1-4c7b-a6f7-8fed29eb4a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:27.436419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:27.517104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34e6c0-a879-4097-81c9-89f7e1d0d98e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:27.520726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34e6c0-a879-4097-81c9-89f7e1d0d98e service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:27.552863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 901/1805] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:27.612019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 905/1806] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:27.616790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34e6c0-a879-4097-81c9-89f7e1d0d98e service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:27.623258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:27.845979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34e6c0-a879-4097-81c9-89f7e1d0d98e service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:27.857440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfe953-0b46-4511-9273-2ee32e2b3f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:27.858517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfe953-0b46-4511-9273-2ee32e2b3f50 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:27.858517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfe953-0b46-4511-9273-2ee32e2b3f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:27.858733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfe953-0b46-4511-9273-2ee32e2b3f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:27.859233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfe953-0b46-4511-9273-2ee32e2b3f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:27.865350 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfe953-0b46-4511-9273-2ee32e2b3f50 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:27.943844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda2aa8-b3e1-4c7b-a6f7-8fed29eb4a77 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:27.944588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 902/1807] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:27 2022] POST /identity/v3/projects => generated 391 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:27.966163 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda2aa8-b3e1-4c7b-a6f7-8fed29eb4a77 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:28.196755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb25303-b050-45a7-b519-4c51e0d032ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:28.197393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25303-b050-45a7-b519-4c51e0d032ac admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:28.197783 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25303-b050-45a7-b519-4c51e0d032ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:28.198800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25303-b050-45a7-b519-4c51e0d032ac admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:28.205995 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb25303-b050-45a7-b519-4c51e0d032ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:28.210365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb25303-b050-45a7-b519-4c51e0d032ac admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:28.258212 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 906/1808] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:27 2022] POST /identity/v3/users => generated 302 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:28.262019 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfe953-0b46-4511-9273-2ee32e2b3f50 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:28.286623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfe953-0b46-4511-9273-2ee32e2b3f50 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:28.310701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed4161-8122-475c-827c-0b606ca15a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:28.311358 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed4161-8122-475c-827c-0b606ca15a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:28.311641 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed4161-8122-475c-827c-0b606ca15a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:28.311958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed4161-8122-475c-827c-0b606ca15a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:28.312620 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed4161-8122-475c-827c-0b606ca15a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:28.316453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed4161-8122-475c-827c-0b606ca15a7f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:28.370486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb25303-b050-45a7-b519-4c51e0d032ac admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:28.372729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 903/1809] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:28.381871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb25303-b050-45a7-b519-4c51e0d032ac admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:28.407319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ac30b-318c-4eff-ac98-56dd74b334b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:28.409641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ac30b-318c-4eff-ac98-56dd74b334b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:28.410708 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ac30b-318c-4eff-ac98-56dd74b334b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:28.411885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ac30b-318c-4eff-ac98-56dd74b334b8 admin admin] PATH_INFO: `/v3/projects/9c4f8b1214e2421bba724d4fb414c279/users/741dd47393174d158825ef3a615ee3ac/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:28.470320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ac30b-318c-4eff-ac98-56dd74b334b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4f8b1214e2421bba724d4fb414c279, user_id=741dd47393174d158825ef3a615ee3ac, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:28.473875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ac30b-318c-4eff-ac98-56dd74b334b8 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:28.520039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 907/1810] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:28 2022] PUT /identity/v3/projects/9c4f8b1214e2421bba724d4fb414c279/users/741dd47393174d158825ef3a615ee3ac/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:28.524906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed4161-8122-475c-827c-0b606ca15a7f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:28.538328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed4161-8122-475c-827c-0b606ca15a7f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:28.612550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ac30b-318c-4eff-ac98-56dd74b334b8 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:28.614843 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3f8ac30b-318c-4eff-ac98-56dd74b334b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:28.769342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad0662-5748-4833-9e4f-d4a6365072af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:28.771775 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad0662-5748-4833-9e4f-d4a6365072af admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:28.776645 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad0662-5748-4833-9e4f-d4a6365072af admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:28.777220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad0662-5748-4833-9e4f-d4a6365072af admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:28.778361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad0662-5748-4833-9e4f-d4a6365072af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:28.782949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad0662-5748-4833-9e4f-d4a6365072af admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:28.828048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 904/1811] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:28.830957 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad0662-5748-4833-9e4f-d4a6365072af admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:28.834919 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ac30b-318c-4eff-ac98-56dd74b334b8 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:28.844451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afd0da-ea50-4441-a7de-fcf7daa54f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:28.845459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afd0da-ea50-4441-a7de-fcf7daa54f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:28.847391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afd0da-ea50-4441-a7de-fcf7daa54f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:28.847391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afd0da-ea50-4441-a7de-fcf7daa54f59 admin admin] PATH_INFO: `/v3/users/24437b22735c4999bcb4049f204a771d` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:28.861606 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad0662-5748-4833-9e4f-d4a6365072af admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:28.864485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afd0da-ea50-4441-a7de-fcf7daa54f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24437b22735c4999bcb4049f204a771d)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:28.869927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afd0da-ea50-4441-a7de-fcf7daa54f59 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:28.885953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2ecc3-d407-4a19-bc03-89e1ecee3e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:28.886623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ecc3-d407-4a19-bc03-89e1ecee3e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:28.886909 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ecc3-d407-4a19-bc03-89e1ecee3e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:28.887199 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ecc3-d407-4a19-bc03-89e1ecee3e26 admin admin] PATH_INFO: `/v3/projects/9c4f8b1214e2421bba724d4fb414c279/users/741dd47393174d158825ef3a615ee3ac/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:28.896543 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2ecc3-d407-4a19-bc03-89e1ecee3e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4f8b1214e2421bba724d4fb414c279, user_id=741dd47393174d158825ef3a615ee3ac, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:28.899453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2ecc3-d407-4a19-bc03-89e1ecee3e26 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:28.929327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 905/1812] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:28 2022] PUT /identity/v3/projects/9c4f8b1214e2421bba724d4fb414c279/users/741dd47393174d158825ef3a615ee3ac/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:28.945286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3695dfd-57a7-44e7-8185-f5c7676f6303 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:28.947292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3695dfd-57a7-44e7-8185-f5c7676f6303 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:28.948372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3695dfd-57a7-44e7-8185-f5c7676f6303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:29.054819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:29.067829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-25afd0da-ea50-4441-a7de-fcf7daa54f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24437b22735c4999bcb4049f204a771d'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:29.083936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-25afd0da-ea50-4441-a7de-fcf7daa54f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24437b22735c4999bcb4049f204a771d'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:29.106623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d3695dfd-57a7-44e7-8185-f5c7676f6303 None None] MFA Rules not processed for user `741dd47393174d158825ef3a615ee3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:29.109929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d3695dfd-57a7-44e7-8185-f5c7676f6303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:29.112259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-25afd0da-ea50-4441-a7de-fcf7daa54f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24437b22735c4999bcb4049f204a771d'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:29.129152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-25afd0da-ea50-4441-a7de-fcf7daa54f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24437b22735c4999bcb4049f204a771d'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:29.130180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-25afd0da-ea50-4441-a7de-fcf7daa54f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24437b22735c4999bcb4049f204a771d'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:29.182495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 908/1813] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:28 2022] DELETE /identity/v3/users/24437b22735c4999bcb4049f204a771d => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:29.192013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21033cab-94ea-4dbb-aa84-45b3c6ea4c43 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:29.192516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21033cab-94ea-4dbb-aa84-45b3c6ea4c43 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:29.192804 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21033cab-94ea-4dbb-aa84-45b3c6ea4c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:29.251386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-21033cab-94ea-4dbb-aa84-45b3c6ea4c43 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:29.254261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-21033cab-94ea-4dbb-aa84-45b3c6ea4c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:29.259675 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:29.347951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 906/1814] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:28 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:29.355588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3695dfd-57a7-44e7-8185-f5c7676f6303 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:29.357053 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d3695dfd-57a7-44e7-8185-f5c7676f6303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:29.440949 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 909/1815] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:29.472807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21033cab-94ea-4dbb-aa84-45b3c6ea4c43 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:29.474354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-21033cab-94ea-4dbb-aa84-45b3c6ea4c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:29.485217 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3695dfd-57a7-44e7-8185-f5c7676f6303 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:29.596152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369202c-7668-4369-9763-7962f05e2b4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:29.598543 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369202c-7668-4369-9763-7962f05e2b4b service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:29.599831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369202c-7668-4369-9763-7962f05e2b4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:29.601994 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369202c-7668-4369-9763-7962f05e2b4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:29.602883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21033cab-94ea-4dbb-aa84-45b3c6ea4c43 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:29.612452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a2b1e-da2d-49c7-959e-7c80c7d619ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:29.613380 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a2b1e-da2d-49c7-959e-7c80c7d619ec service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:29.613671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a2b1e-da2d-49c7-959e-7c80c7d619ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:29.613946 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a2b1e-da2d-49c7-959e-7c80c7d619ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:29.636987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a2b1e-da2d-49c7-959e-7c80c7d619ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:29.638510 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a2b1e-da2d-49c7-959e-7c80c7d619ec service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:29.680624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 910/1816] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:29.828768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369202c-7668-4369-9763-7962f05e2b4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:29.835166 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369202c-7668-4369-9763-7962f05e2b4b service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:29.849775 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 907/1817] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:30.076621 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a2b1e-da2d-49c7-959e-7c80c7d619ec service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:30.091056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a2b1e-da2d-49c7-959e-7c80c7d619ec service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:30.122397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b7bf9-4a99-41d2-a0c2-d37f428b9112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:30.124272 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b7bf9-4a99-41d2-a0c2-d37f428b9112 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:30.125689 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b7bf9-4a99-41d2-a0c2-d37f428b9112 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:30.126119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b7bf9-4a99-41d2-a0c2-d37f428b9112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:30.132759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-944b7bf9-4a99-41d2-a0c2-d37f428b9112 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:30.397696 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:30.410399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b7bf9-4a99-41d2-a0c2-d37f428b9112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:30.416656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b7bf9-4a99-41d2-a0c2-d37f428b9112 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:30.437500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 911/1818] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:30.956431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369202c-7668-4369-9763-7962f05e2b4b service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:30.957891 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8369202c-7668-4369-9763-7962f05e2b4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:30.998718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369202c-7668-4369-9763-7962f05e2b4b service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:31.016403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bd011-1281-4a10-9ed3-f41366b62fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:31.017462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bd011-1281-4a10-9ed3-f41366b62fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.018006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bd011-1281-4a10-9ed3-f41366b62fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.018592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bd011-1281-4a10-9ed3-f41366b62fe3 admin admin] PATH_INFO: `/v3/users/0853eab2a7744e7ca42b2643214cb2d8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.020918 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bd011-1281-4a10-9ed3-f41366b62fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0853eab2a7744e7ca42b2643214cb2d8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:31.023481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bd011-1281-4a10-9ed3-f41366b62fe3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:31.166441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357cd72-faa4-4065-9b9e-a49ae70c4b08 None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.167291 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357cd72-faa4-4065-9b9e-a49ae70c4b08 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.167755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357cd72-faa4-4065-9b9e-a49ae70c4b08 None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.171434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 912/1819] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 31 00:21:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:21:31.223112 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0791-5283-4308-a49a-bc44da951b12 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.223579 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0791-5283-4308-a49a-bc44da951b12 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.224004 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0791-5283-4308-a49a-bc44da951b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.225302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-410bd011-1281-4a10-9ed3-f41366b62fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0853eab2a7744e7ca42b2643214cb2d8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:31.228509 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:31.261429 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-254a0791-5283-4308-a49a-bc44da951b12 None None] MFA Rules not processed for user `cb9ef38ec3b448828826de5f76a552d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:31.269362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-254a0791-5283-4308-a49a-bc44da951b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:31.308225 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-410bd011-1281-4a10-9ed3-f41366b62fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0853eab2a7744e7ca42b2643214cb2d8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:31.346858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-410bd011-1281-4a10-9ed3-f41366b62fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0853eab2a7744e7ca42b2643214cb2d8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:31.365295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-410bd011-1281-4a10-9ed3-f41366b62fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0853eab2a7744e7ca42b2643214cb2d8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:31.368427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-410bd011-1281-4a10-9ed3-f41366b62fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0853eab2a7744e7ca42b2643214cb2d8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:31.395939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 908/1820] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:30 2022] DELETE /identity/v3/users/0853eab2a7744e7ca42b2643214cb2d8 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:31.407817 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa6d6-b7b9-4d44-820b-9f54d2607e38 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.410307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa6d6-b7b9-4d44-820b-9f54d2607e38 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.410620 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa6d6-b7b9-4d44-820b-9f54d2607e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.479298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 913/1821] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 31 00:21:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:31.483309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c3aaa6d6-b7b9-4d44-820b-9f54d2607e38 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:31.484831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c3aaa6d6-b7b9-4d44-820b-9f54d2607e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:31.625294 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 909/1822] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:31.703410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a0791-5283-4308-a49a-bc44da951b12 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:31.705695 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-254a0791-5283-4308-a49a-bc44da951b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:31.724943 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a0791-5283-4308-a49a-bc44da951b12 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:31.860143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9849ee-4f2e-4755-ae81-085124a8dd0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:31.860784 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9849ee-4f2e-4755-ae81-085124a8dd0f service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.862852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9849ee-4f2e-4755-ae81-085124a8dd0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.863139 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9849ee-4f2e-4755-ae81-085124a8dd0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.881511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9849ee-4f2e-4755-ae81-085124a8dd0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:31.882186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9849ee-4f2e-4755-ae81-085124a8dd0f service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:31.893881 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 914/1823] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:32.201468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aaa6d6-b7b9-4d44-820b-9f54d2607e38 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:32.203206 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c3aaa6d6-b7b9-4d44-820b-9f54d2607e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:32.240438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9849ee-4f2e-4755-ae81-085124a8dd0f service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:32.242178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ce9849ee-4f2e-4755-ae81-085124a8dd0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:32.267037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9849ee-4f2e-4755-ae81-085124a8dd0f service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:32.276062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:32.276902 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.277301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.277713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] PATH_INFO: `/v3/projects/82a0073333dc4c1d80b1cfd9be0ef5cd` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.280463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82a0073333dc4c1d80b1cfd9be0ef5cd)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:32.282681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:32.363499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a0073333dc4c1d80b1cfd9be0ef5cd', 'request_id': 'req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:32.371900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a0073333dc4c1d80b1cfd9be0ef5cd', 'request_id': 'req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:32.377718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aaa6d6-b7b9-4d44-820b-9f54d2607e38 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:32.379010 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a0073333dc4c1d80b1cfd9be0ef5cd', 'request_id': 'req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:32.392147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] The token cache is being invalidate because project 82a0073333dc4c1d80b1cfd9be0ef5cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:32.392786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:32.393466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:32.395736 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 915/1824] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:32 2022] DELETE /identity/v3/projects/82a0073333dc4c1d80b1cfd9be0ef5cd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:32.399451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:32.400868 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:32.426376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:32.497622 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:32.513896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f265ff-dc16-4221-a2e2-0f97eb5675ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:32.516022 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f265ff-dc16-4221-a2e2-0f97eb5675ba service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.516528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f265ff-dc16-4221-a2e2-0f97eb5675ba service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.517006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f265ff-dc16-4221-a2e2-0f97eb5675ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.524675 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e0f265ff-dc16-4221-a2e2-0f97eb5675ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:32.543728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f265ff-dc16-4221-a2e2-0f97eb5675ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:32.546913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f265ff-dc16-4221-a2e2-0f97eb5675ba service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:32.559618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d9c41-dade-4ac3-bd1a-cf4cb1e6a3c0 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:32.566597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 910/1825] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:32.574741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243f437-e4ff-4fd2-89e7-ca4284c69bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:32.574741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243f437-e4ff-4fd2-89e7-ca4284c69bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.574741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243f437-e4ff-4fd2-89e7-ca4284c69bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.575101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243f437-e4ff-4fd2-89e7-ca4284c69bfa admin admin] PATH_INFO: `/v3/users/9b579e98d5864e7bb700c09bb8110a30` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.576115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243f437-e4ff-4fd2-89e7-ca4284c69bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b579e98d5864e7bb700c09bb8110a30)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:32.578641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243f437-e4ff-4fd2-89e7-ca4284c69bfa admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:32.652501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a243f437-e4ff-4fd2-89e7-ca4284c69bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b579e98d5864e7bb700c09bb8110a30'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:32.672747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a243f437-e4ff-4fd2-89e7-ca4284c69bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b579e98d5864e7bb700c09bb8110a30'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:32.683293 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a243f437-e4ff-4fd2-89e7-ca4284c69bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b579e98d5864e7bb700c09bb8110a30'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:32.697753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a243f437-e4ff-4fd2-89e7-ca4284c69bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b579e98d5864e7bb700c09bb8110a30'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:32.698753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a243f437-e4ff-4fd2-89e7-ca4284c69bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b579e98d5864e7bb700c09bb8110a30'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:32.713404 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 916/1826] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:32 2022] DELETE /identity/v3/users/9b579e98d5864e7bb700c09bb8110a30 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:32.976783 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d685a-3e69-4e4a-86e3-7a26e424a5c5 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.977138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d685a-3e69-4e4a-86e3-7a26e424a5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.977370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d685a-3e69-4e4a-86e3-7a26e424a5c5 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.979175 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 911/1827] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 31 00:21:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:21:33.097325 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eee5c-658b-4276-aefb-e050c565382e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:33.097821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eee5c-658b-4276-aefb-e050c565382e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:33.098686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eee5c-658b-4276-aefb-e050c565382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:33.137983 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-a59eee5c-658b-4276-aefb-e050c565382e None None] MFA Rules not processed for user `cb9ef38ec3b448828826de5f76a552d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:33.145548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a59eee5c-658b-4276-aefb-e050c565382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:33.287518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 917/1828] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 31 00:21:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:33.765993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d685a-3e69-4e4a-86e3-7a26e424a5c5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:33.770221 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4e8d685a-3e69-4e4a-86e3-7a26e424a5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:33.880991 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d685a-3e69-4e4a-86e3-7a26e424a5c5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:33.886141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:33.886982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:33.887333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:33.887815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] PATH_INFO: `/v3/projects/021766efd140433ba090613b0f25f107` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:33.889224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=021766efd140433ba090613b0f25f107)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:33.891391 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:33.961106 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021766efd140433ba090613b0f25f107', 'request_id': 'req-99cffcb8-1269-4f4a-a421-2fb1357bb198'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:33.971383 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021766efd140433ba090613b0f25f107', 'request_id': 'req-99cffcb8-1269-4f4a-a421-2fb1357bb198'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:33.980007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021766efd140433ba090613b0f25f107', 'request_id': 'req-99cffcb8-1269-4f4a-a421-2fb1357bb198'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:34.004693 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] The token cache is being invalidate because project 021766efd140433ba090613b0f25f107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:34.005539 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:34.007536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:34.017226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 912/1829] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:33 2022] DELETE /identity/v3/projects/021766efd140433ba090613b0f25f107 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:34.017811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59eee5c-658b-4276-aefb-e050c565382e None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:34.033126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59eee5c-658b-4276-aefb-e050c565382e None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:34.053757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:34.115217 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4823409-6ce7-48b8-a602-06e187ce0fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:34.116208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4823409-6ce7-48b8-a602-06e187ce0fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:34.117428 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4823409-6ce7-48b8-a602-06e187ce0fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:34.118893 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4823409-6ce7-48b8-a602-06e187ce0fff admin admin] PATH_INFO: `/v3/users/6d0e8722399d42ea87c0cee23da98829` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:34.127279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4823409-6ce7-48b8-a602-06e187ce0fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0e8722399d42ea87c0cee23da98829)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:34.133114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:34.134575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:34.138770 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4823409-6ce7-48b8-a602-06e187ce0fff admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:34.228706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a4823409-6ce7-48b8-a602-06e187ce0fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0e8722399d42ea87c0cee23da98829'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:34.243654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a4823409-6ce7-48b8-a602-06e187ce0fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0e8722399d42ea87c0cee23da98829'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:34.258944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a4823409-6ce7-48b8-a602-06e187ce0fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0e8722399d42ea87c0cee23da98829'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:34.279588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a4823409-6ce7-48b8-a602-06e187ce0fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0e8722399d42ea87c0cee23da98829'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:34.281017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a4823409-6ce7-48b8-a602-06e187ce0fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0e8722399d42ea87c0cee23da98829'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:34.284198 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cffcb8-1269-4f4a-a421-2fb1357bb198 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:34.290690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e3f63-6903-4fc3-b90a-74b9c95e61f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:34.292417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e3f63-6903-4fc3-b90a-74b9c95e61f6 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:34.292708 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e3f63-6903-4fc3-b90a-74b9c95e61f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:34.293303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e3f63-6903-4fc3-b90a-74b9c95e61f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:34.295395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7e1e3f63-6903-4fc3-b90a-74b9c95e61f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:34.297178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 918/1830] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:34 2022] DELETE /identity/v3/users/6d0e8722399d42ea87c0cee23da98829 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:34.314185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e3f63-6903-4fc3-b90a-74b9c95e61f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:34.315938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e3f63-6903-4fc3-b90a-74b9c95e61f6 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:34.330520 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 913/1831] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:34.775743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4823409-6ce7-48b8-a602-06e187ce0fff admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:34.777463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a4823409-6ce7-48b8-a602-06e187ce0fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:34.793258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e3f63-6903-4fc3-b90a-74b9c95e61f6 service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:34.795467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7e1e3f63-6903-4fc3-b90a-74b9c95e61f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:34.807974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:34.818203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e3f63-6903-4fc3-b90a-74b9c95e61f6 service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:34.895332 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4823409-6ce7-48b8-a602-06e187ce0fff admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:34.901743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad99fc5-68fc-4bfa-b1a1-d8dad2a1840b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:34.902547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad99fc5-68fc-4bfa-b1a1-d8dad2a1840b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:34.903033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad99fc5-68fc-4bfa-b1a1-d8dad2a1840b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:34.903466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad99fc5-68fc-4bfa-b1a1-d8dad2a1840b admin admin] PATH_INFO: `/v3/users/ed4c4aac7a3d4385847a4ac825c4596c` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:34.905197 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad99fc5-68fc-4bfa-b1a1-d8dad2a1840b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4c4aac7a3d4385847a4ac825c4596c)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:34.908040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad99fc5-68fc-4bfa-b1a1-d8dad2a1840b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:34.919864 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4753f8a-fee5-4afa-951d-fab7a0b37807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:34.920556 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4753f8a-fee5-4afa-951d-fab7a0b37807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:34.920848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4753f8a-fee5-4afa-951d-fab7a0b37807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:34.921118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4753f8a-fee5-4afa-951d-fab7a0b37807 admin admin] PATH_INFO: `/v3/projects/8b0b634264424d4e9c40f775417c0a0e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:34.922821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4753f8a-fee5-4afa-951d-fab7a0b37807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b0b634264424d4e9c40f775417c0a0e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:34.926133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4753f8a-fee5-4afa-951d-fab7a0b37807 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.002286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c4753f8a-fee5-4afa-951d-fab7a0b37807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b0b634264424d4e9c40f775417c0a0e', 'request_id': 'req-c4753f8a-fee5-4afa-951d-fab7a0b37807'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.007680 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:35.016362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c4753f8a-fee5-4afa-951d-fab7a0b37807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b0b634264424d4e9c40f775417c0a0e', 'request_id': 'req-c4753f8a-fee5-4afa-951d-fab7a0b37807'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.024246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c4753f8a-fee5-4afa-951d-fab7a0b37807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b0b634264424d4e9c40f775417c0a0e', 'request_id': 'req-c4753f8a-fee5-4afa-951d-fab7a0b37807'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.025340 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6ad99fc5-68fc-4bfa-b1a1-d8dad2a1840b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4c4aac7a3d4385847a4ac825c4596c'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.037767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c4753f8a-fee5-4afa-951d-fab7a0b37807 admin admin] The token cache is being invalidate because project 8b0b634264424d4e9c40f775417c0a0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:35.038027 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c4753f8a-fee5-4afa-951d-fab7a0b37807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.038804 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c4753f8a-fee5-4afa-951d-fab7a0b37807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.039828 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6ad99fc5-68fc-4bfa-b1a1-d8dad2a1840b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4c4aac7a3d4385847a4ac825c4596c'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.043606 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 914/1832] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:34 2022] DELETE /identity/v3/projects/8b0b634264424d4e9c40f775417c0a0e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:35.045395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c9296-30e4-4fd6-8831-687391cc7cd9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.045683 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c9296-30e4-4fd6-8831-687391cc7cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.045965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c9296-30e4-4fd6-8831-687391cc7cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.049764 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6ad99fc5-68fc-4bfa-b1a1-d8dad2a1840b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4c4aac7a3d4385847a4ac825c4596c'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.063125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6ad99fc5-68fc-4bfa-b1a1-d8dad2a1840b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4c4aac7a3d4385847a4ac825c4596c'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.064933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6ad99fc5-68fc-4bfa-b1a1-d8dad2a1840b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4c4aac7a3d4385847a4ac825c4596c'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.073452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 919/1833] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:34 2022] DELETE /identity/v3/users/ed4c4aac7a3d4385847a4ac825c4596c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:35.079840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d865cb-b4d5-4d7c-81ef-8de1f95d5ace None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.080247 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d865cb-b4d5-4d7c-81ef-8de1f95d5ace None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.080663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d865cb-b4d5-4d7c-81ef-8de1f95d5ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.098292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-180c9296-30e4-4fd6-8831-687391cc7cd9 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:35.099585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-180c9296-30e4-4fd6-8831-687391cc7cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:35.104076 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-61d865cb-b4d5-4d7c-81ef-8de1f95d5ace None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:35.105758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-61d865cb-b4d5-4d7c-81ef-8de1f95d5ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:35.188072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 920/1834] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:35.200468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 915/1835] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:35.209924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1a1c0-ccf3-41ce-8a2d-8aef75043901 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.210248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1a1c0-ccf3-41ce-8a2d-8aef75043901 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.210524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1a1c0-ccf3-41ce-8a2d-8aef75043901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.213010 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c9296-30e4-4fd6-8831-687391cc7cd9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.214758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-180c9296-30e4-4fd6-8831-687391cc7cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:35.233841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-07c1a1c0-ccf3-41ce-8a2d-8aef75043901 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:35.236437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-07c1a1c0-ccf3-41ce-8a2d-8aef75043901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:35.256719 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 921/1836] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:35.260085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1a1c0-ccf3-41ce-8a2d-8aef75043901 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.260085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-07c1a1c0-ccf3-41ce-8a2d-8aef75043901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:35.271896 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1a1c0-ccf3-41ce-8a2d-8aef75043901 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.277407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:35.277540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfef16b-6aef-416a-a40a-d6acefa037d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.278304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef16b-6aef-416a-a40a-d6acefa037d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.278628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef16b-6aef-416a-a40a-d6acefa037d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.278907 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef16b-6aef-416a-a40a-d6acefa037d6 admin admin] PATH_INFO: `/v3/projects/851df0d212e14938b2ec515073a0aa37` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.280553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfef16b-6aef-416a-a40a-d6acefa037d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=851df0d212e14938b2ec515073a0aa37)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:35.283566 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfef16b-6aef-416a-a40a-d6acefa037d6 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.315648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c9296-30e4-4fd6-8831-687391cc7cd9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.320526 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a357f4-badf-4da0-871b-4e5fac0179a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.321644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a357f4-badf-4da0-871b-4e5fac0179a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.321929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a357f4-badf-4da0-871b-4e5fac0179a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.322204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a357f4-badf-4da0-871b-4e5fac0179a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.335037 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a357f4-badf-4da0-871b-4e5fac0179a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:35.337228 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a357f4-badf-4da0-871b-4e5fac0179a5 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.348144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ddfef16b-6aef-416a-a40a-d6acefa037d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '851df0d212e14938b2ec515073a0aa37', 'request_id': 'req-ddfef16b-6aef-416a-a40a-d6acefa037d6'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.356443 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ddfef16b-6aef-416a-a40a-d6acefa037d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '851df0d212e14938b2ec515073a0aa37', 'request_id': 'req-ddfef16b-6aef-416a-a40a-d6acefa037d6'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.356608 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 916/1837] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:35.362581 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ddfef16b-6aef-416a-a40a-d6acefa037d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '851df0d212e14938b2ec515073a0aa37', 'request_id': 'req-ddfef16b-6aef-416a-a40a-d6acefa037d6'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.365608 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a357f4-badf-4da0-871b-4e5fac0179a5 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.374239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ddfef16b-6aef-416a-a40a-d6acefa037d6 admin admin] The token cache is being invalidate because project 851df0d212e14938b2ec515073a0aa37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:35.374531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ddfef16b-6aef-416a-a40a-d6acefa037d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.375218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ddfef16b-6aef-416a-a40a-d6acefa037d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:35.377993 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 922/1838] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:35 2022] DELETE /identity/v3/projects/851df0d212e14938b2ec515073a0aa37 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:35.378827 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a357f4-badf-4da0-871b-4e5fac0179a5 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.383675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad2d9f-6ca4-40fe-898a-cbe5f3709dcb None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.384024 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad2d9f-6ca4-40fe-898a-cbe5f3709dcb None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.384296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad2d9f-6ca4-40fe-898a-cbe5f3709dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.428307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-9dad2d9f-6ca4-40fe-898a-cbe5f3709dcb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:35.432915 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-9dad2d9f-6ca4-40fe-898a-cbe5f3709dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:35.483225 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c04ad-c70f-400f-baf3-3a6831c8d7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.483992 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c04ad-c70f-400f-baf3-3a6831c8d7cc admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.484256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c04ad-c70f-400f-baf3-3a6831c8d7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.484518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c04ad-c70f-400f-baf3-3a6831c8d7cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.485177 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c04ad-c70f-400f-baf3-3a6831c8d7cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:35.485538 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c04ad-c70f-400f-baf3-3a6831c8d7cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:35.487866 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c04ad-c70f-400f-baf3-3a6831c8d7cc admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.490022 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:35.502813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 917/1839] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:35.507510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c04ad-c70f-400f-baf3-3a6831c8d7cc admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.509381 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-da7c04ad-c70f-400f-baf3-3a6831c8d7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:35.522293 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c04ad-c70f-400f-baf3-3a6831c8d7cc admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.529599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eba4ff-d8e6-4b3a-847d-130b846ba04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.530222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eba4ff-d8e6-4b3a-847d-130b846ba04b admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.530496 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eba4ff-d8e6-4b3a-847d-130b846ba04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.530773 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eba4ff-d8e6-4b3a-847d-130b846ba04b admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.531411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eba4ff-d8e6-4b3a-847d-130b846ba04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:35.533375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eba4ff-d8e6-4b3a-847d-130b846ba04b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.533596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 923/1840] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:35.550941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d6c74-fdd1-4a91-9f82-f2479744c52e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.553451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d6c74-fdd1-4a91-9f82-f2479744c52e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.553972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d6c74-fdd1-4a91-9f82-f2479744c52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.566071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 918/1841] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:35 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:35.570457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eba4ff-d8e6-4b3a-847d-130b846ba04b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.579554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-d32d6c74-fdd1-4a91-9f82-f2479744c52e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:35.581082 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d32d6c74-fdd1-4a91-9f82-f2479744c52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:35.683623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eba4ff-d8e6-4b3a-847d-130b846ba04b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.692492 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 924/1842] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:35.693629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d6c74-fdd1-4a91-9f82-f2479744c52e None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.696659 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425975e2-9162-42ff-8cd0-659c5ecac3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.697311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425975e2-9162-42ff-8cd0-659c5ecac3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.697595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425975e2-9162-42ff-8cd0-659c5ecac3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.697873 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425975e2-9162-42ff-8cd0-659c5ecac3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.699810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425975e2-9162-42ff-8cd0-659c5ecac3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:35.704280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425975e2-9162-42ff-8cd0-659c5ecac3b6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.709843 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d6c74-fdd1-4a91-9f82-f2479744c52e None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.715439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a474b4-f5f2-48af-8199-9ab0167e0208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.716140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a474b4-f5f2-48af-8199-9ab0167e0208 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.716415 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a474b4-f5f2-48af-8199-9ab0167e0208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.716681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a474b4-f5f2-48af-8199-9ab0167e0208 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.717559 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a474b4-f5f2-48af-8199-9ab0167e0208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:35.717668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a474b4-f5f2-48af-8199-9ab0167e0208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:35.719716 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a474b4-f5f2-48af-8199-9ab0167e0208 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.743670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 925/1843] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:35.744261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 919/1844] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:35 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:35.744993 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a474b4-f5f2-48af-8199-9ab0167e0208 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.745771 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425975e2-9162-42ff-8cd0-659c5ecac3b6 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.759549 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425975e2-9162-42ff-8cd0-659c5ecac3b6 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.759979 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a474b4-f5f2-48af-8199-9ab0167e0208 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.768384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebdba7-d3f8-42e7-8857-b1b57729290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.769812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebdba7-d3f8-42e7-8857-b1b57729290e admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.769812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebdba7-d3f8-42e7-8857-b1b57729290e admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.770202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebdba7-d3f8-42e7-8857-b1b57729290e admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.770917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f04cff-a1e1-43bc-9f71-43da421d2519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.771709 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebdba7-d3f8-42e7-8857-b1b57729290e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:35.772346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f04cff-a1e1-43bc-9f71-43da421d2519 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.772848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f04cff-a1e1-43bc-9f71-43da421d2519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.773463 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f04cff-a1e1-43bc-9f71-43da421d2519 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.774420 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebdba7-d3f8-42e7-8857-b1b57729290e admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.775382 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f04cff-a1e1-43bc-9f71-43da421d2519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:35.777851 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f04cff-a1e1-43bc-9f71-43da421d2519 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.795401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 926/1845] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:35.797729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebdba7-d3f8-42e7-8857-b1b57729290e admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.814386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebdba7-d3f8-42e7-8857-b1b57729290e admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.826055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6917-9bb2-4a6e-bdf3-707ee2e6b091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.826555 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6917-9bb2-4a6e-bdf3-707ee2e6b091 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.827188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6917-9bb2-4a6e-bdf3-707ee2e6b091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.827550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f6917-9bb2-4a6e-bdf3-707ee2e6b091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.827846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 920/1846] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:35 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:35.828323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f6917-9bb2-4a6e-bdf3-707ee2e6b091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:35.829810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f04cff-a1e1-43bc-9f71-43da421d2519 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.829997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f6917-9bb2-4a6e-bdf3-707ee2e6b091 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.851443 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 927/1847] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:35.852512 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6917-9bb2-4a6e-bdf3-707ee2e6b091 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.856487 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:35.868301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f6917-9bb2-4a6e-bdf3-707ee2e6b091 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.926902 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f04cff-a1e1-43bc-9f71-43da421d2519 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.938484 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738acca2-aed6-431d-a8ae-7cad2de7254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.939387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738acca2-aed6-431d-a8ae-7cad2de7254d admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.939768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738acca2-aed6-431d-a8ae-7cad2de7254d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.940057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738acca2-aed6-431d-a8ae-7cad2de7254d admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.940976 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738acca2-aed6-431d-a8ae-7cad2de7254d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:35.955736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738acca2-aed6-431d-a8ae-7cad2de7254d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.970775 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1dddf-7be9-4308-b657-ccc8e11d1632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.971062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 921/1848] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:35 2022] POST /identity/v3/users => generated 283 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:35.972433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738acca2-aed6-431d-a8ae-7cad2de7254d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.975736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-738acca2-aed6-431d-a8ae-7cad2de7254d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:35.983464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1dddf-7be9-4308-b657-ccc8e11d1632 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.983953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1dddf-7be9-4308-b657-ccc8e11d1632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.984241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1dddf-7be9-4308-b657-ccc8e11d1632 admin admin] PATH_INFO: `/v3/projects/26d32f0a836047e78d6bd77303321045/users/43852199ee5f44cebebc9393398406a2/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.989970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738acca2-aed6-431d-a8ae-7cad2de7254d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.995913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.996687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.997053 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.997412 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad admin admin] PATH_INFO: `/v3/projects/e9418e231eb94f4785d2e7b46a800b79` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.998777 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9418e231eb94f4785d2e7b46a800b79)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.001059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.004072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1dddf-7be9-4308-b657-ccc8e11d1632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d32f0a836047e78d6bd77303321045, user_id=43852199ee5f44cebebc9393398406a2, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.008769 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1dddf-7be9-4308-b657-ccc8e11d1632 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.026567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 928/1849] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:35 2022] PUT /identity/v3/projects/26d32f0a836047e78d6bd77303321045/users/43852199ee5f44cebebc9393398406a2/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:36.026991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1dddf-7be9-4308-b657-ccc8e11d1632 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.065404 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9418e231eb94f4785d2e7b46a800b79', 'request_id': 'req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.067844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:36.076821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9418e231eb94f4785d2e7b46a800b79', 'request_id': 'req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.085219 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9418e231eb94f4785d2e7b46a800b79', 'request_id': 'req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.103000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad admin admin] The token cache is being invalidate because project e9418e231eb94f4785d2e7b46a800b79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:36.103151 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.108155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1dc7cf9f-e73f-4425-aa00-9c84907f1dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.110010 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 922/1850] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:35 2022] DELETE /identity/v3/projects/e9418e231eb94f4785d2e7b46a800b79 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:36.110806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1dddf-7be9-4308-b657-ccc8e11d1632 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.111599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b5ada-6003-441d-a295-36a03ca34765 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.112222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b5ada-6003-441d-a295-36a03ca34765 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.112655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b5ada-6003-441d-a295-36a03ca34765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.150397 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ef2b5ada-6003-441d-a295-36a03ca34765 None None] MFA Rules not processed for user `43852199ee5f44cebebc9393398406a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:36.152013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ef2b5ada-6003-441d-a295-36a03ca34765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.187811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc94d0b-0f6f-459a-a63f-5379be40b0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.188637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc94d0b-0f6f-459a-a63f-5379be40b0be admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.189396 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc94d0b-0f6f-459a-a63f-5379be40b0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.189819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc94d0b-0f6f-459a-a63f-5379be40b0be admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.190905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc94d0b-0f6f-459a-a63f-5379be40b0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.192815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc94d0b-0f6f-459a-a63f-5379be40b0be admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.209179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 929/1851] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:36.210141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc94d0b-0f6f-459a-a63f-5379be40b0be admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.211975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2dc94d0b-0f6f-459a-a63f-5379be40b0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.234097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc94d0b-0f6f-459a-a63f-5379be40b0be admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.251349 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d4c38-bb32-4060-b601-dcbc0e122e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.253177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d4c38-bb32-4060-b601-dcbc0e122e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.253177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d4c38-bb32-4060-b601-dcbc0e122e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.253177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d4c38-bb32-4060-b601-dcbc0e122e8d admin admin] PATH_INFO: `/v3/users/741dd47393174d158825ef3a615ee3ac` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.254562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d4c38-bb32-4060-b601-dcbc0e122e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=741dd47393174d158825ef3a615ee3ac)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.257714 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d4c38-bb32-4060-b601-dcbc0e122e8d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.261737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 923/1852] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:36.265950 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b5ada-6003-441d-a295-36a03ca34765 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.269421 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ef2b5ada-6003-441d-a295-36a03ca34765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.300719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b5ada-6003-441d-a295-36a03ca34765 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.308126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc62e33-e3a5-406e-bace-ebf7262ab030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.309003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc62e33-e3a5-406e-bace-ebf7262ab030 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.309445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc62e33-e3a5-406e-bace-ebf7262ab030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.309751 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc62e33-e3a5-406e-bace-ebf7262ab030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.310687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc62e33-e3a5-406e-bace-ebf7262ab030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.324517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc62e33-e3a5-406e-bace-ebf7262ab030 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.343579 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 924/1853] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:36.344515 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc62e33-e3a5-406e-bace-ebf7262ab030 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.346464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ffc62e33-e3a5-406e-bace-ebf7262ab030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.365955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc62e33-e3a5-406e-bace-ebf7262ab030 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.369182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d88d4c38-bb32-4060-b601-dcbc0e122e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '741dd47393174d158825ef3a615ee3ac'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.371338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405440fe-0c2e-4a54-9ce3-147b7d26dd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.372062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405440fe-0c2e-4a54-9ce3-147b7d26dd5e admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.372415 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405440fe-0c2e-4a54-9ce3-147b7d26dd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.373142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405440fe-0c2e-4a54-9ce3-147b7d26dd5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.373999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405440fe-0c2e-4a54-9ce3-147b7d26dd5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.376153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405440fe-0c2e-4a54-9ce3-147b7d26dd5e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.383502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:36.402571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d88d4c38-bb32-4060-b601-dcbc0e122e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '741dd47393174d158825ef3a615ee3ac'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.420219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d88d4c38-bb32-4060-b601-dcbc0e122e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '741dd47393174d158825ef3a615ee3ac'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.424373 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 925/1854] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:36 2022] POST /identity/v3/projects => generated 389 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:36.424373 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405440fe-0c2e-4a54-9ce3-147b7d26dd5e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.434720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d88d4c38-bb32-4060-b601-dcbc0e122e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '741dd47393174d158825ef3a615ee3ac'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.435689 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d88d4c38-bb32-4060-b601-dcbc0e122e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '741dd47393174d158825ef3a615ee3ac'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.446243 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 930/1855] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:36 2022] DELETE /identity/v3/users/741dd47393174d158825ef3a615ee3ac => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:36.447553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d4c38-bb32-4060-b601-dcbc0e122e8d admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.451762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d88d4c38-bb32-4060-b601-dcbc0e122e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.512646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:36.524581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405440fe-0c2e-4a54-9ce3-147b7d26dd5e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.567030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d4c38-bb32-4060-b601-dcbc0e122e8d admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.572967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d47d3-0b25-44fd-9c4f-22dd37f7b842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.574152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d47d3-0b25-44fd-9c4f-22dd37f7b842 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.574767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d47d3-0b25-44fd-9c4f-22dd37f7b842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.576306 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d47d3-0b25-44fd-9c4f-22dd37f7b842 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.577264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d47d3-0b25-44fd-9c4f-22dd37f7b842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.582060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d47d3-0b25-44fd-9c4f-22dd37f7b842 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.614886 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 931/1856] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:36 2022] POST /identity/v3/users => generated 301 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:36.615252 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eac142-31d1-4278-9b9e-b87e438536ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.615727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eac142-31d1-4278-9b9e-b87e438536ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.615938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d47d3-0b25-44fd-9c4f-22dd37f7b842 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.616089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eac142-31d1-4278-9b9e-b87e438536ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.616352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eac142-31d1-4278-9b9e-b87e438536ed admin admin] PATH_INFO: `/v3/projects/3b0830fef7134ab5ad5b671377388dd1/users/ef7469a8b97f4a11b1850e13068001a8/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.627029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d47d3-0b25-44fd-9c4f-22dd37f7b842 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.632340 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8908ad7-1743-4b2f-856d-3e3cffa33d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.632963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8908ad7-1743-4b2f-856d-3e3cffa33d2c admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.633242 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8908ad7-1743-4b2f-856d-3e3cffa33d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.633652 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8908ad7-1743-4b2f-856d-3e3cffa33d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.634303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8908ad7-1743-4b2f-856d-3e3cffa33d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.635979 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8908ad7-1743-4b2f-856d-3e3cffa33d2c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.646596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 932/1857] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:36.647187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eac142-31d1-4278-9b9e-b87e438536ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0830fef7134ab5ad5b671377388dd1, user_id=ef7469a8b97f4a11b1850e13068001a8, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.650062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eac142-31d1-4278-9b9e-b87e438536ed admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.650719 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8908ad7-1743-4b2f-856d-3e3cffa33d2c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.662755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8908ad7-1743-4b2f-856d-3e3cffa33d2c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.667011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 926/1858] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:36 2022] PUT /identity/v3/projects/3b0830fef7134ab5ad5b671377388dd1/users/ef7469a8b97f4a11b1850e13068001a8/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:36.678681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcee2e1-67ba-4a1c-89f2-68ed2de86fd7 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.679460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcee2e1-67ba-4a1c-89f2-68ed2de86fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.679772 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcee2e1-67ba-4a1c-89f2-68ed2de86fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.716726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-6dcee2e1-67ba-4a1c-89f2-68ed2de86fd7 None None] MFA Rules not processed for user `ef7469a8b97f4a11b1850e13068001a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:36.717956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6dcee2e1-67ba-4a1c-89f2-68ed2de86fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.733700 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86fb06-fdc0-4cf8-ab23-9f75afe87637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.734379 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86fb06-fdc0-4cf8-ab23-9f75afe87637 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.734659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86fb06-fdc0-4cf8-ab23-9f75afe87637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.734933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86fb06-fdc0-4cf8-ab23-9f75afe87637 admin admin] PATH_INFO: `/v3/projects/cbff3594dbcb433db93a0f07e37acc21/users/3623b062d88a43df9561a91723203b0f/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.753105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86fb06-fdc0-4cf8-ab23-9f75afe87637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbff3594dbcb433db93a0f07e37acc21, user_id=3623b062d88a43df9561a91723203b0f, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.755830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86fb06-fdc0-4cf8-ab23-9f75afe87637 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.782014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 933/1859] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:36 2022] PUT /identity/v3/projects/cbff3594dbcb433db93a0f07e37acc21/users/3623b062d88a43df9561a91723203b0f/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:36.787378 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86fb06-fdc0-4cf8-ab23-9f75afe87637 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.791361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 927/1860] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:36.796425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcee2e1-67ba-4a1c-89f2-68ed2de86fd7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.800614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6dcee2e1-67ba-4a1c-89f2-68ed2de86fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.815310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcee2e1-67ba-4a1c-89f2-68ed2de86fd7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.819146 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:36.865068 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86fb06-fdc0-4cf8-ab23-9f75afe87637 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.869754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e41f16-b35f-4779-8857-afad99dbf380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.870367 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e41f16-b35f-4779-8857-afad99dbf380 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.870656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e41f16-b35f-4779-8857-afad99dbf380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.870929 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e41f16-b35f-4779-8857-afad99dbf380 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.871572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e41f16-b35f-4779-8857-afad99dbf380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.873278 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e41f16-b35f-4779-8857-afad99dbf380 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.880860 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf1ce6-3010-4d31-9467-8f57561798d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.881480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1ce6-3010-4d31-9467-8f57561798d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.881763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1ce6-3010-4d31-9467-8f57561798d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.882038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1ce6-3010-4d31-9467-8f57561798d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.882677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf1ce6-3010-4d31-9467-8f57561798d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.883594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 934/1861] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:36.884484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e41f16-b35f-4779-8857-afad99dbf380 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.884687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf1ce6-3010-4d31-9467-8f57561798d9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.886128 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-59e41f16-b35f-4779-8857-afad99dbf380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.898724 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e41f16-b35f-4779-8857-afad99dbf380 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.903271 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.903916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.904190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.904466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] PATH_INFO: `/v3/projects/9c4f8b1214e2421bba724d4fb414c279` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.905600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4f8b1214e2421bba724d4fb414c279)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.907487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.915034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 928/1862] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:36 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:36.915034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf1ce6-3010-4d31-9467-8f57561798d9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.955430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:36.981950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4f8b1214e2421bba724d4fb414c279', 'request_id': 'req-f960fefa-410f-4233-900f-89e71d1c238c'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.987188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf1ce6-3010-4d31-9467-8f57561798d9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.992986 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4f8b1214e2421bba724d4fb414c279', 'request_id': 'req-f960fefa-410f-4233-900f-89e71d1c238c'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.000391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4f8b1214e2421bba724d4fb414c279', 'request_id': 'req-f960fefa-410f-4233-900f-89e71d1c238c'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.013194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] The token cache is being invalidate because project 9c4f8b1214e2421bba724d4fb414c279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:37.013722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.014565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.016550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 935/1863] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:36 2022] DELETE /identity/v3/projects/9c4f8b1214e2421bba724d4fb414c279 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:37.017440 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.018934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.059638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9c476-fba7-4fbc-8bf7-5b0203458b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.060443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9c476-fba7-4fbc-8bf7-5b0203458b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.060806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9c476-fba7-4fbc-8bf7-5b0203458b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.061152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9c476-fba7-4fbc-8bf7-5b0203458b89 admin admin] PATH_INFO: `/v3/projects/cbff3594dbcb433db93a0f07e37acc21/users/3623b062d88a43df9561a91723203b0f/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.063678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9c476-fba7-4fbc-8bf7-5b0203458b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbff3594dbcb433db93a0f07e37acc21, user_id=3623b062d88a43df9561a91723203b0f, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.066512 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9c476-fba7-4fbc-8bf7-5b0203458b89 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.081484 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 929/1864] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:36 2022] PUT /identity/v3/projects/cbff3594dbcb433db93a0f07e37acc21/users/3623b062d88a43df9561a91723203b0f/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:37.082856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9b5f6-a7c1-4fdc-a909-bf9f1890a326 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.083220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9b5f6-a7c1-4fdc-a909-bf9f1890a326 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.083569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9b5f6-a7c1-4fdc-a909-bf9f1890a326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.111662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e7a9b5f6-a7c1-4fdc-a909-bf9f1890a326 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:37.112955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e7a9b5f6-a7c1-4fdc-a909-bf9f1890a326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.146437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960fefa-410f-4233-900f-89e71d1c238c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.158910 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:37.217590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 930/1865] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:37.217590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaf179-b033-4566-8be6-db648becb2fe None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.217590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaf179-b033-4566-8be6-db648becb2fe None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.217590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaf179-b033-4566-8be6-db648becb2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.224708 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4f64a-a462-4ced-bf3f-2d414b3d8e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.225339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f64a-a462-4ced-bf3f-2d414b3d8e58 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.225607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f64a-a462-4ced-bf3f-2d414b3d8e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.225953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f64a-a462-4ced-bf3f-2d414b3d8e58 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.226592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4f64a-a462-4ced-bf3f-2d414b3d8e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.230413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4f64a-a462-4ced-bf3f-2d414b3d8e58 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.271986 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 936/1866] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:37 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:37.273250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ea18d-fbfc-458e-a348-a87344584b92 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.273541 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ea18d-fbfc-458e-a348-a87344584b92 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.273815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ea18d-fbfc-458e-a348-a87344584b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.280424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-70eaf179-b033-4566-8be6-db648becb2fe None None] MFA Rules not processed for user `3623b062d88a43df9561a91723203b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:37.281646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-70eaf179-b033-4566-8be6-db648becb2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.317781 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-4a6ea18d-fbfc-458e-a348-a87344584b92 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:37.321032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-4a6ea18d-fbfc-458e-a348-a87344584b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.357043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 937/1867] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:37.358096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ea18d-fbfc-458e-a348-a87344584b92 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.376237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ea18d-fbfc-458e-a348-a87344584b92 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.388346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c29e60-bc1b-4989-a2c4-0f0b7dc97835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.389164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c29e60-bc1b-4989-a2c4-0f0b7dc97835 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.389543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c29e60-bc1b-4989-a2c4-0f0b7dc97835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.389915 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c29e60-bc1b-4989-a2c4-0f0b7dc97835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.390673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c29e60-bc1b-4989-a2c4-0f0b7dc97835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.396512 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c29e60-bc1b-4989-a2c4-0f0b7dc97835 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.399724 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 931/1868] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:37 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:37.405556 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaf179-b033-4566-8be6-db648becb2fe None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.420291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaf179-b033-4566-8be6-db648becb2fe None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.425653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467dbff-9192-4dd2-8682-0cdbcaf876c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.426362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467dbff-9192-4dd2-8682-0cdbcaf876c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.426733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467dbff-9192-4dd2-8682-0cdbcaf876c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.427091 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467dbff-9192-4dd2-8682-0cdbcaf876c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.427849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467dbff-9192-4dd2-8682-0cdbcaf876c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:37.428222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467dbff-9192-4dd2-8682-0cdbcaf876c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.429946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467dbff-9192-4dd2-8682-0cdbcaf876c5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.440480 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 938/1869] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:37.441529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c29e60-bc1b-4989-a2c4-0f0b7dc97835 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.443269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-28c29e60-bc1b-4989-a2c4-0f0b7dc97835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.451360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 932/1870] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:37.452505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467dbff-9192-4dd2-8682-0cdbcaf876c5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.464203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467dbff-9192-4dd2-8682-0cdbcaf876c5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.469985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b628d-5a12-46f6-9bdf-1b5976fd6299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.470673 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b628d-5a12-46f6-9bdf-1b5976fd6299 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.470949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b628d-5a12-46f6-9bdf-1b5976fd6299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.471356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b628d-5a12-46f6-9bdf-1b5976fd6299 admin admin] PATH_INFO: `/v3/projects/9694d655df4d4ceeba7d23553fefb677/users/03074e36f7db4395978ae0aec15ef1f0/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.493949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b628d-5a12-46f6-9bdf-1b5976fd6299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9694d655df4d4ceeba7d23553fefb677, user_id=03074e36f7db4395978ae0aec15ef1f0, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.496822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b628d-5a12-46f6-9bdf-1b5976fd6299 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.506003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:37.516292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 933/1871] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:37 2022] PUT /identity/v3/projects/9694d655df4d4ceeba7d23553fefb677/users/03074e36f7db4395978ae0aec15ef1f0/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:37.517252 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b628d-5a12-46f6-9bdf-1b5976fd6299 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.525928 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c29e60-bc1b-4989-a2c4-0f0b7dc97835 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.583606 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd98970-a740-490b-ba6d-efea55c64561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.584458 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd98970-a740-490b-ba6d-efea55c64561 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.584873 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd98970-a740-490b-ba6d-efea55c64561 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.585277 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd98970-a740-490b-ba6d-efea55c64561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.591730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b628d-5a12-46f6-9bdf-1b5976fd6299 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.596798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f051ed-4743-42cb-8944-4ca7c69857e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.597827 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f051ed-4743-42cb-8944-4ca7c69857e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.598114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f051ed-4743-42cb-8944-4ca7c69857e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.598420 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f051ed-4743-42cb-8944-4ca7c69857e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.599064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f051ed-4743-42cb-8944-4ca7c69857e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.601033 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f051ed-4743-42cb-8944-4ca7c69857e3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.632605 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 934/1872] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:37 2022] POST /identity/v3/projects => generated 399 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:37.633439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f051ed-4743-42cb-8944-4ca7c69857e3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.650175 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:37.659079 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd98970-a740-490b-ba6d-efea55c64561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.660565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd98970-a740-490b-ba6d-efea55c64561 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.670715 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 939/1873] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:37 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:37.671419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd98970-a740-490b-ba6d-efea55c64561 service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.682295 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd98970-a740-490b-ba6d-efea55c64561 service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.720678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f051ed-4743-42cb-8944-4ca7c69857e3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.725680 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d5825-9bbf-40b4-90f8-365e38e67624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.726769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5825-9bbf-40b4-90f8-365e38e67624 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.727157 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5825-9bbf-40b4-90f8-365e38e67624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.727507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5825-9bbf-40b4-90f8-365e38e67624 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.728516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d5825-9bbf-40b4-90f8-365e38e67624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.730885 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d5825-9bbf-40b4-90f8-365e38e67624 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.744598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 935/1874] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:37.749652 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d5825-9bbf-40b4-90f8-365e38e67624 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.764731 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d5825-9bbf-40b4-90f8-365e38e67624 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.772930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572edd76-2117-4b47-9f57-8becf1b66b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.774090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572edd76-2117-4b47-9f57-8becf1b66b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.774460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572edd76-2117-4b47-9f57-8becf1b66b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.774748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572edd76-2117-4b47-9f57-8becf1b66b4b admin admin] PATH_INFO: `/v3/projects/9694d655df4d4ceeba7d23553fefb677/users/03074e36f7db4395978ae0aec15ef1f0/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.777468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572edd76-2117-4b47-9f57-8becf1b66b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9694d655df4d4ceeba7d23553fefb677, user_id=03074e36f7db4395978ae0aec15ef1f0, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.781481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572edd76-2117-4b47-9f57-8becf1b66b4b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.792470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56488868-a0a8-4d40-824d-875378f07247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.793084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56488868-a0a8-4d40-824d-875378f07247 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.793364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56488868-a0a8-4d40-824d-875378f07247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.793681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56488868-a0a8-4d40-824d-875378f07247 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.794272 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56488868-a0a8-4d40-824d-875378f07247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.795927 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 936/1875] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:37 2022] PUT /identity/v3/projects/9694d655df4d4ceeba7d23553fefb677/users/03074e36f7db4395978ae0aec15ef1f0/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:37.797545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56488868-a0a8-4d40-824d-875378f07247 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.809404 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6ac83-e549-4194-a3ff-742f2ec6a17b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.810400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6ac83-e549-4194-a3ff-742f2ec6a17b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.810590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6ac83-e549-4194-a3ff-742f2ec6a17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.830101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 940/1876] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:37 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:37.832307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56488868-a0a8-4d40-824d-875378f07247 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.846883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56488868-a0a8-4d40-824d-875378f07247 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.847361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-67f6ac83-e549-4194-a3ff-742f2ec6a17b None None] MFA Rules not processed for user `03074e36f7db4395978ae0aec15ef1f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:37.848543 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-67f6ac83-e549-4194-a3ff-742f2ec6a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.884454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:37.910066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce258f-392c-44f2-a26f-f5ae34b5830c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.910688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce258f-392c-44f2-a26f-f5ae34b5830c admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.910970 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce258f-392c-44f2-a26f-f5ae34b5830c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.911248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce258f-392c-44f2-a26f-f5ae34b5830c admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.911989 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce258f-392c-44f2-a26f-f5ae34b5830c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.913601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce258f-392c-44f2-a26f-f5ae34b5830c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.920931 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 937/1877] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:37.921834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6ac83-e549-4194-a3ff-742f2ec6a17b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.923672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-67f6ac83-e549-4194-a3ff-742f2ec6a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.924059 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 941/1878] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:37.927730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce258f-392c-44f2-a26f-f5ae34b5830c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.937678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce258f-392c-44f2-a26f-f5ae34b5830c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.938648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6ac83-e549-4194-a3ff-742f2ec6a17b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.942274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40232d-8b2c-4205-bb00-558785045433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.942942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40232d-8b2c-4205-bb00-558785045433 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.943222 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40232d-8b2c-4205-bb00-558785045433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.943342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101888c5-db13-4155-8a27-a2a5eee5303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.943496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40232d-8b2c-4205-bb00-558785045433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.944135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101888c5-db13-4155-8a27-a2a5eee5303d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.944248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40232d-8b2c-4205-bb00-558785045433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.944417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101888c5-db13-4155-8a27-a2a5eee5303d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.944691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101888c5-db13-4155-8a27-a2a5eee5303d admin admin] PATH_INFO: `/v3/users/43852199ee5f44cebebc9393398406a2` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.945776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40232d-8b2c-4205-bb00-558785045433 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.945894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101888c5-db13-4155-8a27-a2a5eee5303d admin admin] RBAC: Authorizing `identity:delete_user(user_id=43852199ee5f44cebebc9393398406a2)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.947732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101888c5-db13-4155-8a27-a2a5eee5303d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.956253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 942/1879] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:37.957164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40232d-8b2c-4205-bb00-558785045433 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.001377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-101888c5-db13-4155-8a27-a2a5eee5303d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43852199ee5f44cebebc9393398406a2'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:38.015095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40232d-8b2c-4205-bb00-558785045433 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:38.015822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-101888c5-db13-4155-8a27-a2a5eee5303d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43852199ee5f44cebebc9393398406a2'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:38.018989 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283dd8-fd32-4801-b7a4-07f0f41e0140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:38.019627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283dd8-fd32-4801-b7a4-07f0f41e0140 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.019935 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283dd8-fd32-4801-b7a4-07f0f41e0140 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.020209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283dd8-fd32-4801-b7a4-07f0f41e0140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.021810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:38.025595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-101888c5-db13-4155-8a27-a2a5eee5303d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43852199ee5f44cebebc9393398406a2'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:38.029948 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1283dd8-fd32-4801-b7a4-07f0f41e0140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.031439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1283dd8-fd32-4801-b7a4-07f0f41e0140 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.038274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-101888c5-db13-4155-8a27-a2a5eee5303d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43852199ee5f44cebebc9393398406a2'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:38.039088 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-101888c5-db13-4155-8a27-a2a5eee5303d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43852199ee5f44cebebc9393398406a2'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:38.042781 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 943/1880] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:38.043655 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283dd8-fd32-4801-b7a4-07f0f41e0140 service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.049796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 938/1881] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:37 2022] DELETE /identity/v3/users/43852199ee5f44cebebc9393398406a2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:38.052313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fd1a8-6ee3-4071-920a-2d2d0c464afa None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.052609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fd1a8-6ee3-4071-920a-2d2d0c464afa None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.052889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fd1a8-6ee3-4071-920a-2d2d0c464afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.054787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283dd8-fd32-4801-b7a4-07f0f41e0140 service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:38.079219 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a57fd1a8-6ee3-4071-920a-2d2d0c464afa None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:38.080566 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a57fd1a8-6ee3-4071-920a-2d2d0c464afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:38.123394 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dac3cb-52e1-4854-8fde-1a4a6a27b95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:38.124352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dac3cb-52e1-4854-8fde-1a4a6a27b95b admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.124352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dac3cb-52e1-4854-8fde-1a4a6a27b95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.124637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dac3cb-52e1-4854-8fde-1a4a6a27b95b admin admin] PATH_INFO: `/v3/projects/92d148c859ae4f66ab609fcc5491444f/users/dffdeb461e9444c582eb52bdb65a008c/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.146149 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dac3cb-52e1-4854-8fde-1a4a6a27b95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d148c859ae4f66ab609fcc5491444f, user_id=dffdeb461e9444c582eb52bdb65a008c, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.149016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dac3cb-52e1-4854-8fde-1a4a6a27b95b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.173400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 939/1882] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:38.173400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fd1a8-6ee3-4071-920a-2d2d0c464afa None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.179743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 944/1883] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:38 2022] PUT /identity/v3/projects/92d148c859ae4f66ab609fcc5491444f/users/dffdeb461e9444c582eb52bdb65a008c/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:38.181419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432ed1d-ca44-4af9-8060-3302098c1ec6 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.181707 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432ed1d-ca44-4af9-8060-3302098c1ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.181974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432ed1d-ca44-4af9-8060-3302098c1ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.184462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a57fd1a8-6ee3-4071-920a-2d2d0c464afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:38.216527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-a432ed1d-ca44-4af9-8060-3302098c1ec6 None None] MFA Rules not processed for user `dffdeb461e9444c582eb52bdb65a008c`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:38.217739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a432ed1d-ca44-4af9-8060-3302098c1ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:38.262023 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:38.270333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fd1a8-6ee3-4071-920a-2d2d0c464afa None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:38.309508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 945/1884] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:38 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:38.309508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432ed1d-ca44-4af9-8060-3302098c1ec6 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.311263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a432ed1d-ca44-4af9-8060-3302098c1ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:38.356789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91be65-92f2-4452-a17c-f27918852279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:38.357421 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91be65-92f2-4452-a17c-f27918852279 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.357697 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91be65-92f2-4452-a17c-f27918852279 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.357979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91be65-92f2-4452-a17c-f27918852279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.360378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1b91be65-92f2-4452-a17c-f27918852279 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:38.373367 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432ed1d-ca44-4af9-8060-3302098c1ec6 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:38.377082 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f07e34-ea13-4c45-a4cd-00b97ce6deae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:38.377755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f07e34-ea13-4c45-a4cd-00b97ce6deae service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.378007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f07e34-ea13-4c45-a4cd-00b97ce6deae service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.378282 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f07e34-ea13-4c45-a4cd-00b97ce6deae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.427313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91be65-92f2-4452-a17c-f27918852279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.428783 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91be65-92f2-4452-a17c-f27918852279 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.432255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:38.438728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 940/1885] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:38.440205 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91be65-92f2-4452-a17c-f27918852279 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.442069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1b91be65-92f2-4452-a17c-f27918852279 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:38.445578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f07e34-ea13-4c45-a4cd-00b97ce6deae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.447031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f07e34-ea13-4c45-a4cd-00b97ce6deae service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.458034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91be65-92f2-4452-a17c-f27918852279 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:38.459345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 946/1886] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:38.464406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99709647-92d2-4990-91b8-29f40901884b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:38.464998 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709647-92d2-4990-91b8-29f40901884b admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.465281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709647-92d2-4990-91b8-29f40901884b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.465553 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709647-92d2-4990-91b8-29f40901884b admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.466190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99709647-92d2-4990-91b8-29f40901884b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.468288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99709647-92d2-4990-91b8-29f40901884b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.508319 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 941/1887] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:38 2022] POST /identity/v3/projects => generated 401 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:38.511298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f07e34-ea13-4c45-a4cd-00b97ce6deae service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.525994 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f07e34-ea13-4c45-a4cd-00b97ce6deae service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:38.629881 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696bce3-e4b9-4629-9f9b-e4b6021fb87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:38.631177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696bce3-e4b9-4629-9f9b-e4b6021fb87e admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.631867 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696bce3-e4b9-4629-9f9b-e4b6021fb87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.632153 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696bce3-e4b9-4629-9f9b-e4b6021fb87e admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.632818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696bce3-e4b9-4629-9f9b-e4b6021fb87e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.635036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696bce3-e4b9-4629-9f9b-e4b6021fb87e admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.663862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 947/1888] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:38 2022] POST /identity/v3/users => generated 307 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:38.668582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99709647-92d2-4990-91b8-29f40901884b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.683403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99709647-92d2-4990-91b8-29f40901884b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:38.689413 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3e417-7edf-4d36-a3e9-b75437eb169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:38.690046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3e417-7edf-4d36-a3e9-b75437eb169a admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.690361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3e417-7edf-4d36-a3e9-b75437eb169a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.690636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3e417-7edf-4d36-a3e9-b75437eb169a admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.691294 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3e417-7edf-4d36-a3e9-b75437eb169a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.692966 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3e417-7edf-4d36-a3e9-b75437eb169a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.712615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 942/1889] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:38.716970 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696bce3-e4b9-4629-9f9b-e4b6021fb87e admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.728263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696bce3-e4b9-4629-9f9b-e4b6021fb87e admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:38.733403 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b138e0-1ab7-4a2c-bcb8-f19b774b823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:38.734079 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b138e0-1ab7-4a2c-bcb8-f19b774b823e admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.734357 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b138e0-1ab7-4a2c-bcb8-f19b774b823e admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.734633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b138e0-1ab7-4a2c-bcb8-f19b774b823e admin admin] PATH_INFO: `/v3/projects/f562a3c82622421ba409e6e2a572c4bf/users/7b107266b0c842e9b18b0fe4f8a7f8d5/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.753530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b138e0-1ab7-4a2c-bcb8-f19b774b823e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f562a3c82622421ba409e6e2a572c4bf, user_id=7b107266b0c842e9b18b0fe4f8a7f8d5, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.761073 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b138e0-1ab7-4a2c-bcb8-f19b774b823e admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.764111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:38.784235 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 948/1890] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:38 2022] PUT /identity/v3/projects/f562a3c82622421ba409e6e2a572c4bf/users/7b107266b0c842e9b18b0fe4f8a7f8d5/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:38.788516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3e417-7edf-4d36-a3e9-b75437eb169a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.803155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3e417-7edf-4d36-a3e9-b75437eb169a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:38.887789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a8113-b690-4457-a820-6a75e70f08b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:38.888420 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a8113-b690-4457-a820-6a75e70f08b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.888700 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a8113-b690-4457-a820-6a75e70f08b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.888974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a8113-b690-4457-a820-6a75e70f08b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.889767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a8113-b690-4457-a820-6a75e70f08b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.891446 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a8113-b690-4457-a820-6a75e70f08b8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.908596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 943/1891] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:38.913711 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b138e0-1ab7-4a2c-bcb8-f19b774b823e admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.929589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b138e0-1ab7-4a2c-bcb8-f19b774b823e admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:38.936804 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa61223-3c00-4a5a-b548-a734bc23fc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:38.937685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa61223-3c00-4a5a-b548-a734bc23fc83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.937973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa61223-3c00-4a5a-b548-a734bc23fc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.938252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa61223-3c00-4a5a-b548-a734bc23fc83 admin admin] PATH_INFO: `/v3/projects/f562a3c82622421ba409e6e2a572c4bf/users/7b107266b0c842e9b18b0fe4f8a7f8d5/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.940435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa61223-3c00-4a5a-b548-a734bc23fc83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f562a3c82622421ba409e6e2a572c4bf, user_id=7b107266b0c842e9b18b0fe4f8a7f8d5, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.944330 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa61223-3c00-4a5a-b548-a734bc23fc83 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.959392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 949/1892] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:38 2022] PUT /identity/v3/projects/f562a3c82622421ba409e6e2a572c4bf/users/7b107266b0c842e9b18b0fe4f8a7f8d5/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:38.973572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b679e5-ad2c-4cda-acc1-1730d51a2af6 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.974421 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b679e5-ad2c-4cda-acc1-1730d51a2af6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.974912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b679e5-ad2c-4cda-acc1-1730d51a2af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:39.009767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b2b679e5-ad2c-4cda-acc1-1730d51a2af6 None None] MFA Rules not processed for user `7b107266b0c842e9b18b0fe4f8a7f8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:39.011011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b2b679e5-ad2c-4cda-acc1-1730d51a2af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:39.097992 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 944/1893] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:38 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:39.109061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa61223-3c00-4a5a-b548-a734bc23fc83 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:39.179162 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa61223-3c00-4a5a-b548-a734bc23fc83 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:39.185037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb439eab-efbb-4cd1-97a1-113ca43c61f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:39.185387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb439eab-efbb-4cd1-97a1-113ca43c61f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:39.185681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb439eab-efbb-4cd1-97a1-113ca43c61f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:39.185958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb439eab-efbb-4cd1-97a1-113ca43c61f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:39.200444 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb439eab-efbb-4cd1-97a1-113ca43c61f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:39.202016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb439eab-efbb-4cd1-97a1-113ca43c61f0 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:39.214827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 950/1894] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:39 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:39.334814 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b679e5-ad2c-4cda-acc1-1730d51a2af6 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:39.352782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b679e5-ad2c-4cda-acc1-1730d51a2af6 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:39.360054 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ffc25-b901-43a1-83b1-6d3b4bfd6f7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:39.360342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ffc25-b901-43a1-83b1-6d3b4bfd6f7f service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:39.360632 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ffc25-b901-43a1-83b1-6d3b4bfd6f7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:39.361286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ffc25-b901-43a1-83b1-6d3b4bfd6f7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:39.420389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:39.451158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ffc25-b901-43a1-83b1-6d3b4bfd6f7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:39.452655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ffc25-b901-43a1-83b1-6d3b4bfd6f7f service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:39.482012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 945/1895] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:39 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:39.584222 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb439eab-efbb-4cd1-97a1-113ca43c61f0 service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:39.585702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-cb439eab-efbb-4cd1-97a1-113ca43c61f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:39.642981 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92346-e129-4184-b130-06d1000ea3f7 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:39.643331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92346-e129-4184-b130-06d1000ea3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:39.643588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92346-e129-4184-b130-06d1000ea3f7 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:39.645167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 946/1896] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 31 00:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:21:39.656229 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c190d-e078-44ec-a56c-7e53fcb57190 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:39.656521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c190d-e078-44ec-a56c-7e53fcb57190 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:39.656859 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c190d-e078-44ec-a56c-7e53fcb57190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:39.698401 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-268c190d-e078-44ec-a56c-7e53fcb57190 None None] MFA Rules not processed for user `cb9ef38ec3b448828826de5f76a552d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:39.699744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-268c190d-e078-44ec-a56c-7e53fcb57190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:39.768285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb439eab-efbb-4cd1-97a1-113ca43c61f0 service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:39.785339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:39.786404 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:39.786918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:39.787408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] PATH_INFO: `/v3/projects/26d32f0a836047e78d6bd77303321045` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:39.790425 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d32f0a836047e78d6bd77303321045)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:39.793194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:39.858226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 947/1897] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 31 00:21:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:39.943233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d32f0a836047e78d6bd77303321045', 'request_id': 'req-19640976-9b06-4131-a476-7698c85d538f'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:39.962173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d32f0a836047e78d6bd77303321045', 'request_id': 'req-19640976-9b06-4131-a476-7698c85d538f'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:39.969810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d32f0a836047e78d6bd77303321045', 'request_id': 'req-19640976-9b06-4131-a476-7698c85d538f'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:39.999204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] The token cache is being invalidate because project 26d32f0a836047e78d6bd77303321045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:39.999500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:40.002321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:40.007092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 951/1898] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:39 2022] DELETE /identity/v3/projects/26d32f0a836047e78d6bd77303321045 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:40.008446 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c190d-e078-44ec-a56c-7e53fcb57190 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:40.032120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c190d-e078-44ec-a56c-7e53fcb57190 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:40.164806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5773d-17ac-4f0e-ae81-b1df99ef3348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:40.166702 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5773d-17ac-4f0e-ae81-b1df99ef3348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:40.167061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5773d-17ac-4f0e-ae81-b1df99ef3348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:40.167743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5773d-17ac-4f0e-ae81-b1df99ef3348 admin admin] PATH_INFO: `/v3/users/3623b062d88a43df9561a91723203b0f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:40.172385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5773d-17ac-4f0e-ae81-b1df99ef3348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3623b062d88a43df9561a91723203b0f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:40.177756 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5773d-17ac-4f0e-ae81-b1df99ef3348 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:40.289914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:40.291353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:40.301448 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-65b5773d-17ac-4f0e-ae81-b1df99ef3348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3623b062d88a43df9561a91723203b0f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:40.318702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:40.334550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-65b5773d-17ac-4f0e-ae81-b1df99ef3348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3623b062d88a43df9561a91723203b0f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:40.354773 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-65b5773d-17ac-4f0e-ae81-b1df99ef3348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3623b062d88a43df9561a91723203b0f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:40.360991 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:40.373975 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-65b5773d-17ac-4f0e-ae81-b1df99ef3348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3623b062d88a43df9561a91723203b0f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:40.374664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-65b5773d-17ac-4f0e-ae81-b1df99ef3348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3623b062d88a43df9561a91723203b0f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:40.385972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 948/1899] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:40 2022] DELETE /identity/v3/users/3623b062d88a43df9561a91723203b0f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:40.416697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19640976-9b06-4131-a476-7698c85d538f admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:40.517630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e981d-2180-43a4-8958-3a051e195db8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:40.518290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e981d-2180-43a4-8958-3a051e195db8 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:40.518603 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e981d-2180-43a4-8958-3a051e195db8 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:40.518997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e981d-2180-43a4-8958-3a051e195db8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:40.520927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-332e981d-2180-43a4-8958-3a051e195db8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:40.535098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e981d-2180-43a4-8958-3a051e195db8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:40.536641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e981d-2180-43a4-8958-3a051e195db8 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:40.548938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 952/1900] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:40.896392 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5773d-17ac-4f0e-ae81-b1df99ef3348 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:40.897958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-65b5773d-17ac-4f0e-ae81-b1df99ef3348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:40.970064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5773d-17ac-4f0e-ae81-b1df99ef3348 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:40.974868 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65263c-5bf4-474f-b3f4-4a76144143e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:40.975627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65263c-5bf4-474f-b3f4-4a76144143e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:40.975996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65263c-5bf4-474f-b3f4-4a76144143e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:40.976365 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65263c-5bf4-474f-b3f4-4a76144143e4 admin admin] PATH_INFO: `/v3/projects/cbff3594dbcb433db93a0f07e37acc21` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:40.977548 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65263c-5bf4-474f-b3f4-4a76144143e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbff3594dbcb433db93a0f07e37acc21)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:40.979485 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65263c-5bf4-474f-b3f4-4a76144143e4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:41.041914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-db65263c-5bf4-474f-b3f4-4a76144143e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbff3594dbcb433db93a0f07e37acc21', 'request_id': 'req-db65263c-5bf4-474f-b3f4-4a76144143e4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.050909 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-db65263c-5bf4-474f-b3f4-4a76144143e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbff3594dbcb433db93a0f07e37acc21', 'request_id': 'req-db65263c-5bf4-474f-b3f4-4a76144143e4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.057343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-db65263c-5bf4-474f-b3f4-4a76144143e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbff3594dbcb433db93a0f07e37acc21', 'request_id': 'req-db65263c-5bf4-474f-b3f4-4a76144143e4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.069197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-db65263c-5bf4-474f-b3f4-4a76144143e4 admin admin] The token cache is being invalidate because project cbff3594dbcb433db93a0f07e37acc21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:41.069488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-db65263c-5bf4-474f-b3f4-4a76144143e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.070145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-db65263c-5bf4-474f-b3f4-4a76144143e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.071960 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 949/1901] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:40 2022] DELETE /identity/v3/projects/cbff3594dbcb433db93a0f07e37acc21 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:41.076675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b8d05-9cd3-4739-b6c8-a31cf28ec022 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.077148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b8d05-9cd3-4739-b6c8-a31cf28ec022 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.077224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b8d05-9cd3-4739-b6c8-a31cf28ec022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.099340 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-ec9b8d05-9cd3-4739-b6c8-a31cf28ec022 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:41.100579 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ec9b8d05-9cd3-4739-b6c8-a31cf28ec022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:41.211568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 953/1902] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:41.219907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4ac7-5b7f-4023-aa05-40a4b37fa916 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.220225 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4ac7-5b7f-4023-aa05-40a4b37fa916 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.220473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4ac7-5b7f-4023-aa05-40a4b37fa916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.244241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-318e4ac7-5b7f-4023-aa05-40a4b37fa916 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:41.245731 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-318e4ac7-5b7f-4023-aa05-40a4b37fa916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:41.255624 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 950/1903] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:41.259090 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b8d05-9cd3-4739-b6c8-a31cf28ec022 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:41.271235 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b8d05-9cd3-4739-b6c8-a31cf28ec022 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:41.280973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a24ed-f68b-4ca5-9467-030093c16193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:41.281846 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a24ed-f68b-4ca5-9467-030093c16193 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.284067 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a24ed-f68b-4ca5-9467-030093c16193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.284513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a24ed-f68b-4ca5-9467-030093c16193 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.287469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a24ed-f68b-4ca5-9467-030093c16193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:41.287974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a24ed-f68b-4ca5-9467-030093c16193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:41.290613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a24ed-f68b-4ca5-9467-030093c16193 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:41.316863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 954/1904] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:41.317683 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e4ac7-5b7f-4023-aa05-40a4b37fa916 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:41.343330 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e4ac7-5b7f-4023-aa05-40a4b37fa916 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:41.350612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae423c-d9fa-4fa8-9d7a-d62203bd4f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:41.351251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae423c-d9fa-4fa8-9d7a-d62203bd4f7c admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.351535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae423c-d9fa-4fa8-9d7a-d62203bd4f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.351860 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae423c-d9fa-4fa8-9d7a-d62203bd4f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.352938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae423c-d9fa-4fa8-9d7a-d62203bd4f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:41.354871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae423c-d9fa-4fa8-9d7a-d62203bd4f7c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:41.392517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 951/1905] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:41 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:41.394027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a24ed-f68b-4ca5-9467-030093c16193 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:41.417829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a24ed-f68b-4ca5-9467-030093c16193 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:41.485822 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:41.550624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aea784-bbdc-428d-bfa8-dcfc71aae8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:41.552337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aea784-bbdc-428d-bfa8-dcfc71aae8bf admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.552943 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aea784-bbdc-428d-bfa8-dcfc71aae8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.553749 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aea784-bbdc-428d-bfa8-dcfc71aae8bf admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.554987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aea784-bbdc-428d-bfa8-dcfc71aae8bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:41.558730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aea784-bbdc-428d-bfa8-dcfc71aae8bf admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:41.605674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 955/1906] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:41 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:41.609587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae423c-d9fa-4fa8-9d7a-d62203bd4f7c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:41.621532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae423c-d9fa-4fa8-9d7a-d62203bd4f7c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:41.627368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aff456-944d-4f7d-abdc-5813deb8d789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:41.627368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aff456-944d-4f7d-abdc-5813deb8d789 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.627719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aff456-944d-4f7d-abdc-5813deb8d789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.627968 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aff456-944d-4f7d-abdc-5813deb8d789 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.628571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aff456-944d-4f7d-abdc-5813deb8d789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:41.630386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aff456-944d-4f7d-abdc-5813deb8d789 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:41.646126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 952/1907] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:41.647304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aea784-bbdc-428d-bfa8-dcfc71aae8bf admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:41.659418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aea784-bbdc-428d-bfa8-dcfc71aae8bf admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:41.665655 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f46c09-8d70-4c1e-97c5-0590d531a403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:41.666611 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f46c09-8d70-4c1e-97c5-0590d531a403 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.667213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f46c09-8d70-4c1e-97c5-0590d531a403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.667682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f46c09-8d70-4c1e-97c5-0590d531a403 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.668785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f46c09-8d70-4c1e-97c5-0590d531a403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:41.670929 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f46c09-8d70-4c1e-97c5-0590d531a403 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:41.689901 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 956/1908] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:41.694485 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aff456-944d-4f7d-abdc-5813deb8d789 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:41.710986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aff456-944d-4f7d-abdc-5813deb8d789 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:41.717969 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c071db2-f93e-4f2d-b023-a306839d1a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:41.718723 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c071db2-f93e-4f2d-b023-a306839d1a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.719218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c071db2-f93e-4f2d-b023-a306839d1a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.719752 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c071db2-f93e-4f2d-b023-a306839d1a40 admin admin] PATH_INFO: `/v3/projects/f8af635af9f74f7b881ac5ea6c8778e2/users/fe46045132f24eaabc75e1c58e29098a/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.762642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c071db2-f93e-4f2d-b023-a306839d1a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8af635af9f74f7b881ac5ea6c8778e2, user_id=fe46045132f24eaabc75e1c58e29098a, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:41.765673 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c071db2-f93e-4f2d-b023-a306839d1a40 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:41.798936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 953/1909] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:41 2022] PUT /identity/v3/projects/f8af635af9f74f7b881ac5ea6c8778e2/users/fe46045132f24eaabc75e1c58e29098a/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:41.809622 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f7f1c-f4b9-49b3-8226-54b0077ff008 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.811440 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f7f1c-f4b9-49b3-8226-54b0077ff008 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.812066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f7f1c-f4b9-49b3-8226-54b0077ff008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.877141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-309f7f1c-f4b9-49b3-8226-54b0077ff008 None None] MFA Rules not processed for user `fe46045132f24eaabc75e1c58e29098a`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:41.880204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-309f7f1c-f4b9-49b3-8226-54b0077ff008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:41.979597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 957/1910] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:41.983602 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c071db2-f93e-4f2d-b023-a306839d1a40 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:42.020737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:42.074201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c071db2-f93e-4f2d-b023-a306839d1a40 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:42.108711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de95692-a3f8-4d72-a009-1557b794d732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:42.110089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de95692-a3f8-4d72-a009-1557b794d732 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:42.110619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de95692-a3f8-4d72-a009-1557b794d732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:42.111085 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de95692-a3f8-4d72-a009-1557b794d732 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:42.112096 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de95692-a3f8-4d72-a009-1557b794d732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:42.116309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de95692-a3f8-4d72-a009-1557b794d732 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:42.176608 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 954/1911] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:41 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:42.177943 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f7f1c-f4b9-49b3-8226-54b0077ff008 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:42.191791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f7f1c-f4b9-49b3-8226-54b0077ff008 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:42.356933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094769c-f617-4e4f-b99a-17f67a7b0ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:42.357836 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094769c-f617-4e4f-b99a-17f67a7b0ccd admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:42.358211 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094769c-f617-4e4f-b99a-17f67a7b0ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:42.358557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094769c-f617-4e4f-b99a-17f67a7b0ccd admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:42.360003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094769c-f617-4e4f-b99a-17f67a7b0ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:42.362808 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094769c-f617-4e4f-b99a-17f67a7b0ccd admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:42.423755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 958/1912] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:42 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:42.426184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de95692-a3f8-4d72-a009-1557b794d732 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:42.444432 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de95692-a3f8-4d72-a009-1557b794d732 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:42.458806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ef65f-9fd3-4317-bea8-0d39001b1652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:42.459468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ef65f-9fd3-4317-bea8-0d39001b1652 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:42.459769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ef65f-9fd3-4317-bea8-0d39001b1652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:42.460053 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ef65f-9fd3-4317-bea8-0d39001b1652 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:42.460716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ef65f-9fd3-4317-bea8-0d39001b1652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:42.462331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ef65f-9fd3-4317-bea8-0d39001b1652 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:42.491832 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 955/1913] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:42.495544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094769c-f617-4e4f-b99a-17f67a7b0ccd admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:42.506658 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094769c-f617-4e4f-b99a-17f67a7b0ccd admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:42.539141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa9f2c-80da-494e-8f40-1ad76df0a5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:42.540074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa9f2c-80da-494e-8f40-1ad76df0a5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:42.540353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa9f2c-80da-494e-8f40-1ad76df0a5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:42.540705 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa9f2c-80da-494e-8f40-1ad76df0a5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:42.541385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa9f2c-80da-494e-8f40-1ad76df0a5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:42.543217 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa9f2c-80da-494e-8f40-1ad76df0a5c6 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:42.558750 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 959/1914] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:42.560186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ef65f-9fd3-4317-bea8-0d39001b1652 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:42.574239 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ef65f-9fd3-4317-bea8-0d39001b1652 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:42.584408 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33f5ee-37fc-42cb-b946-4171f5af4f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:42.585134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33f5ee-37fc-42cb-b946-4171f5af4f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:42.585380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33f5ee-37fc-42cb-b946-4171f5af4f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:42.585659 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33f5ee-37fc-42cb-b946-4171f5af4f95 admin admin] PATH_INFO: `/v3/projects/e8ed04f8e383472fb50b6f4ec0c869bc/users/65326127b4f54a7e82303ae2920d6190/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:42.606597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33f5ee-37fc-42cb-b946-4171f5af4f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ed04f8e383472fb50b6f4ec0c869bc, user_id=65326127b4f54a7e82303ae2920d6190, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:42.612983 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33f5ee-37fc-42cb-b946-4171f5af4f95 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:42.639917 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d816cd-610d-403c-970b-3e56c866a0ef None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:42.640208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d816cd-610d-403c-970b-3e56c866a0ef None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:42.640511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d816cd-610d-403c-970b-3e56c866a0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:42.644429 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 956/1915] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:42 2022] PUT /identity/v3/projects/e8ed04f8e383472fb50b6f4ec0c869bc/users/65326127b4f54a7e82303ae2920d6190/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:42.665933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:42.675029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-53d816cd-610d-403c-970b-3e56c866a0ef None None] MFA Rules not processed for user `65326127b4f54a7e82303ae2920d6190`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:42.676910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-53d816cd-610d-403c-970b-3e56c866a0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:42.735870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33f5ee-37fc-42cb-b946-4171f5af4f95 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:42.737899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ba33f5ee-37fc-42cb-b946-4171f5af4f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:42.770686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 960/1916] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:42.771020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d816cd-610d-403c-970b-3e56c866a0ef None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:42.860140 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33f5ee-37fc-42cb-b946-4171f5af4f95 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:42.871546 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee32aa-df3c-4138-a0d9-18fa5c7a514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:42.873210 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee32aa-df3c-4138-a0d9-18fa5c7a514a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:42.873503 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee32aa-df3c-4138-a0d9-18fa5c7a514a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:42.873783 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee32aa-df3c-4138-a0d9-18fa5c7a514a admin admin] PATH_INFO: `/v3/users/ef7469a8b97f4a11b1850e13068001a8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:42.875736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee32aa-df3c-4138-a0d9-18fa5c7a514a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef7469a8b97f4a11b1850e13068001a8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:42.878635 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee32aa-df3c-4138-a0d9-18fa5c7a514a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:42.892362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d816cd-610d-403c-970b-3e56c866a0ef None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:42.911957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9cc06-b5bf-4857-a12d-d21ace41e64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:42.912660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9cc06-b5bf-4857-a12d-d21ace41e64a admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:42.913005 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9cc06-b5bf-4857-a12d-d21ace41e64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:42.913416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9cc06-b5bf-4857-a12d-d21ace41e64a admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:42.914404 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9cc06-b5bf-4857-a12d-d21ace41e64a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:42.916587 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9cc06-b5bf-4857-a12d-d21ace41e64a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:42.992375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 961/1917] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:42 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:42.993292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9cc06-b5bf-4857-a12d-d21ace41e64a admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:43.000329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6aee32aa-df3c-4138-a0d9-18fa5c7a514a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef7469a8b97f4a11b1850e13068001a8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.015804 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6aee32aa-df3c-4138-a0d9-18fa5c7a514a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef7469a8b97f4a11b1850e13068001a8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.024351 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6aee32aa-df3c-4138-a0d9-18fa5c7a514a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef7469a8b97f4a11b1850e13068001a8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.026680 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:43.037817 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6aee32aa-df3c-4138-a0d9-18fa5c7a514a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef7469a8b97f4a11b1850e13068001a8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.039262 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6aee32aa-df3c-4138-a0d9-18fa5c7a514a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef7469a8b97f4a11b1850e13068001a8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.059754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 957/1918] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:42 2022] DELETE /identity/v3/users/ef7469a8b97f4a11b1850e13068001a8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:43.063974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec293d70-e2d6-4454-958e-b7b5861fe7a4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.064542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec293d70-e2d6-4454-958e-b7b5861fe7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.065355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec293d70-e2d6-4454-958e-b7b5861fe7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.102672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ec293d70-e2d6-4454-958e-b7b5861fe7a4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:43.103957 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ec293d70-e2d6-4454-958e-b7b5861fe7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:43.117404 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9cc06-b5bf-4857-a12d-d21ace41e64a admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:43.170008 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:43.217705 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 958/1919] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:43.237860 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb77c-6c29-47e1-a088-057dbff9503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:43.240246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb77c-6c29-47e1-a088-057dbff9503e admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.240745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb77c-6c29-47e1-a088-057dbff9503e admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.241207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb77c-6c29-47e1-a088-057dbff9503e admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.241590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec293d70-e2d6-4454-958e-b7b5861fe7a4 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:43.242258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fb77c-6c29-47e1-a088-057dbff9503e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:43.245012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ec293d70-e2d6-4454-958e-b7b5861fe7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:43.246820 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fb77c-6c29-47e1-a088-057dbff9503e admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:43.279452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 962/1920] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:42 2022] POST /identity/v3/users => generated 296 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:43.283977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb77c-6c29-47e1-a088-057dbff9503e admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:43.287537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-589fb77c-6c29-47e1-a088-057dbff9503e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:43.304236 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb77c-6c29-47e1-a088-057dbff9503e admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:43.310328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c87882-5e21-4093-9cf7-eb86cbe6e962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:43.311434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c87882-5e21-4093-9cf7-eb86cbe6e962 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.311831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c87882-5e21-4093-9cf7-eb86cbe6e962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.312121 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c87882-5e21-4093-9cf7-eb86cbe6e962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.312787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c87882-5e21-4093-9cf7-eb86cbe6e962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:43.316360 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c87882-5e21-4093-9cf7-eb86cbe6e962 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:43.361199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 963/1921] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:43.363015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c87882-5e21-4093-9cf7-eb86cbe6e962 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:43.382749 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec293d70-e2d6-4454-958e-b7b5861fe7a4 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:43.383420 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c87882-5e21-4093-9cf7-eb86cbe6e962 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:43.389326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d178e-59fc-42d0-bfb4-0c334b5f8106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:43.390078 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d178e-59fc-42d0-bfb4-0c334b5f8106 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.390435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d178e-59fc-42d0-bfb4-0c334b5f8106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.390746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d178e-59fc-42d0-bfb4-0c334b5f8106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.391466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a3639-352d-4bae-8da0-381074746d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:43.392305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a3639-352d-4bae-8da0-381074746d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.392727 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a3639-352d-4bae-8da0-381074746d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.393148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a3639-352d-4bae-8da0-381074746d9b admin admin] PATH_INFO: `/v3/projects/690d42dbc4fb4ca1917ba42859794657/users/c3b3a8356f4e4ec3909fe416868f674f/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.405354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d178e-59fc-42d0-bfb4-0c334b5f8106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:43.406807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d178e-59fc-42d0-bfb4-0c334b5f8106 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:43.421181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 959/1922] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:43.425203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a3639-352d-4bae-8da0-381074746d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=690d42dbc4fb4ca1917ba42859794657, user_id=c3b3a8356f4e4ec3909fe416868f674f, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:43.428144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a3639-352d-4bae-8da0-381074746d9b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:43.454253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 964/1923] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:43 2022] PUT /identity/v3/projects/690d42dbc4fb4ca1917ba42859794657/users/c3b3a8356f4e4ec3909fe416868f674f/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:43.458300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d178e-59fc-42d0-bfb4-0c334b5f8106 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:43.470090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d178e-59fc-42d0-bfb4-0c334b5f8106 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:43.562548 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e4142-3148-4460-ae04-ab62c68a3407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:43.563190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e4142-3148-4460-ae04-ab62c68a3407 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.563474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e4142-3148-4460-ae04-ab62c68a3407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.563845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e4142-3148-4460-ae04-ab62c68a3407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.564542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e4142-3148-4460-ae04-ab62c68a3407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:43.566597 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e4142-3148-4460-ae04-ab62c68a3407 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:43.583441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 960/1924] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:43.587460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a3639-352d-4bae-8da0-381074746d9b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:43.600142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a3639-352d-4bae-8da0-381074746d9b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:43.606029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d33b2a-2dd4-4d61-af3f-cb384aa124d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:43.607371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d33b2a-2dd4-4d61-af3f-cb384aa124d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.607681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d33b2a-2dd4-4d61-af3f-cb384aa124d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.608009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d33b2a-2dd4-4d61-af3f-cb384aa124d7 admin admin] PATH_INFO: `/v3/projects/690d42dbc4fb4ca1917ba42859794657/users/c3b3a8356f4e4ec3909fe416868f674f/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.610978 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d33b2a-2dd4-4d61-af3f-cb384aa124d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=690d42dbc4fb4ca1917ba42859794657, user_id=c3b3a8356f4e4ec3909fe416868f674f, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:43.615009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d33b2a-2dd4-4d61-af3f-cb384aa124d7 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:43.631751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 965/1925] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:43 2022] PUT /identity/v3/projects/690d42dbc4fb4ca1917ba42859794657/users/c3b3a8356f4e4ec3909fe416868f674f/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:43.641643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7205069-4667-4def-a7d8-f3e65751f160 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.642113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7205069-4667-4def-a7d8-f3e65751f160 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.643609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7205069-4667-4def-a7d8-f3e65751f160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.681360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c7205069-4667-4def-a7d8-f3e65751f160 None None] MFA Rules not processed for user `c3b3a8356f4e4ec3909fe416868f674f`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:43.682745 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c7205069-4667-4def-a7d8-f3e65751f160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:43.704834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:43.800918 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 961/1926] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:43.815193 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d33b2a-2dd4-4d61-af3f-cb384aa124d7 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:43.817088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a2d33b2a-2dd4-4d61-af3f-cb384aa124d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:43.880250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d33b2a-2dd4-4d61-af3f-cb384aa124d7 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:43.883900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909315c-88cb-4dca-a251-8b164c9bc86b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:43.884613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909315c-88cb-4dca-a251-8b164c9bc86b service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.884960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909315c-88cb-4dca-a251-8b164c9bc86b service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.885298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909315c-88cb-4dca-a251-8b164c9bc86b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.895317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909315c-88cb-4dca-a251-8b164c9bc86b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:43.896865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909315c-88cb-4dca-a251-8b164c9bc86b service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:43.911745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 966/1927] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:43.945210 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7205069-4667-4def-a7d8-f3e65751f160 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:43.945210 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c7205069-4667-4def-a7d8-f3e65751f160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:43.954829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909315c-88cb-4dca-a251-8b164c9bc86b service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:43.958742 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2909315c-88cb-4dca-a251-8b164c9bc86b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:43.983125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909315c-88cb-4dca-a251-8b164c9bc86b service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:43.986925 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadd048-7cbf-4bb0-af99-48f64bcda5cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:43.988295 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadd048-7cbf-4bb0-af99-48f64bcda5cc service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.988571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadd048-7cbf-4bb0-af99-48f64bcda5cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.988842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadd048-7cbf-4bb0-af99-48f64bcda5cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.991103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3eadd048-7cbf-4bb0-af99-48f64bcda5cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:44.060392 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7205069-4667-4def-a7d8-f3e65751f160 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:44.065605 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:44.066257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:44.066536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:44.066810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] PATH_INFO: `/v3/projects/3b0830fef7134ab5ad5b671377388dd1` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:44.068039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b0830fef7134ab5ad5b671377388dd1)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:44.069930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:44.079577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadd048-7cbf-4bb0-af99-48f64bcda5cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:44.081560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadd048-7cbf-4bb0-af99-48f64bcda5cc service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:44.091688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 967/1928] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:44.142283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0830fef7134ab5ad5b671377388dd1', 'request_id': 'req-7e1efd72-5954-4561-ad9a-81c3554d6a45'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.153837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0830fef7134ab5ad5b671377388dd1', 'request_id': 'req-7e1efd72-5954-4561-ad9a-81c3554d6a45'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.170030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0830fef7134ab5ad5b671377388dd1', 'request_id': 'req-7e1efd72-5954-4561-ad9a-81c3554d6a45'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.199309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] The token cache is being invalidate because project 3b0830fef7134ab5ad5b671377388dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:44.199841 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.201626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.204448 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 962/1929] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:43 2022] DELETE /identity/v3/projects/3b0830fef7134ab5ad5b671377388dd1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:44.208693 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadd048-7cbf-4bb0-af99-48f64bcda5cc service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:44.224786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadd048-7cbf-4bb0-af99-48f64bcda5cc service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:44.253065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:44.330376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58a09b-df71-4caa-87ae-de18c1f2d589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:44.331259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58a09b-df71-4caa-87ae-de18c1f2d589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:44.331653 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58a09b-df71-4caa-87ae-de18c1f2d589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:44.332013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58a09b-df71-4caa-87ae-de18c1f2d589 admin admin] PATH_INFO: `/v3/users/03074e36f7db4395978ae0aec15ef1f0` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:44.333309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58a09b-df71-4caa-87ae-de18c1f2d589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03074e36f7db4395978ae0aec15ef1f0)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:44.335283 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58a09b-df71-4caa-87ae-de18c1f2d589 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:44.385594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ec58a09b-df71-4caa-87ae-de18c1f2d589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03074e36f7db4395978ae0aec15ef1f0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.398321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ec58a09b-df71-4caa-87ae-de18c1f2d589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03074e36f7db4395978ae0aec15ef1f0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.405310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ec58a09b-df71-4caa-87ae-de18c1f2d589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03074e36f7db4395978ae0aec15ef1f0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.414268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ec58a09b-df71-4caa-87ae-de18c1f2d589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03074e36f7db4395978ae0aec15ef1f0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.415284 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ec58a09b-df71-4caa-87ae-de18c1f2d589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03074e36f7db4395978ae0aec15ef1f0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.422858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 968/1930] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:44 2022] DELETE /identity/v3/users/03074e36f7db4395978ae0aec15ef1f0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:44.668031 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:44.670129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:44.687738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1efd72-5954-4561-ad9a-81c3554d6a45 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:44.781172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:44.802627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ace0ac-a8b4-4a89-a854-1afb01e131f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:44.802816 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58a09b-df71-4caa-87ae-de18c1f2d589 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:44.804156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace0ac-a8b4-4a89-a854-1afb01e131f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:44.804269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ec58a09b-df71-4caa-87ae-de18c1f2d589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:44.804903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace0ac-a8b4-4a89-a854-1afb01e131f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:44.805385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace0ac-a8b4-4a89-a854-1afb01e131f1 admin admin] PATH_INFO: `/v3/users/dffdeb461e9444c582eb52bdb65a008c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:44.807018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ace0ac-a8b4-4a89-a854-1afb01e131f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dffdeb461e9444c582eb52bdb65a008c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:44.809358 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ace0ac-a8b4-4a89-a854-1afb01e131f1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:44.833806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58a09b-df71-4caa-87ae-de18c1f2d589 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:44.844506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f94ac-4c89-4591-8a7e-fb11128b1abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:44.845253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f94ac-4c89-4591-8a7e-fb11128b1abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:44.845536 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f94ac-4c89-4591-8a7e-fb11128b1abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:44.845924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f94ac-4c89-4591-8a7e-fb11128b1abb admin admin] PATH_INFO: `/v3/projects/9694d655df4d4ceeba7d23553fefb677` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:44.850945 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f94ac-4c89-4591-8a7e-fb11128b1abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9694d655df4d4ceeba7d23553fefb677)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:44.853589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f94ac-4c89-4591-8a7e-fb11128b1abb admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:44.894838 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-83ace0ac-a8b4-4a89-a854-1afb01e131f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dffdeb461e9444c582eb52bdb65a008c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.912519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-83ace0ac-a8b4-4a89-a854-1afb01e131f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dffdeb461e9444c582eb52bdb65a008c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.923585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-83ace0ac-a8b4-4a89-a854-1afb01e131f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dffdeb461e9444c582eb52bdb65a008c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.936428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-83ace0ac-a8b4-4a89-a854-1afb01e131f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dffdeb461e9444c582eb52bdb65a008c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.938956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-83ace0ac-a8b4-4a89-a854-1afb01e131f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dffdeb461e9444c582eb52bdb65a008c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.959372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 963/1931] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:44 2022] DELETE /identity/v3/users/dffdeb461e9444c582eb52bdb65a008c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:44.961556 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a18b9c-cc9e-4e9a-8bb6-9946c8b7edb4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:44.961556 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a18b9c-cc9e-4e9a-8bb6-9946c8b7edb4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:44.961766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a18b9c-cc9e-4e9a-8bb6-9946c8b7edb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:44.971490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-266f94ac-4c89-4591-8a7e-fb11128b1abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9694d655df4d4ceeba7d23553fefb677', 'request_id': 'req-266f94ac-4c89-4591-8a7e-fb11128b1abb'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.984950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-266f94ac-4c89-4591-8a7e-fb11128b1abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9694d655df4d4ceeba7d23553fefb677', 'request_id': 'req-266f94ac-4c89-4591-8a7e-fb11128b1abb'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.998962 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-266f94ac-4c89-4591-8a7e-fb11128b1abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9694d655df4d4ceeba7d23553fefb677', 'request_id': 'req-266f94ac-4c89-4591-8a7e-fb11128b1abb'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.003727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-15a18b9c-cc9e-4e9a-8bb6-9946c8b7edb4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:45.006626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-15a18b9c-cc9e-4e9a-8bb6-9946c8b7edb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:45.028605 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-266f94ac-4c89-4591-8a7e-fb11128b1abb admin admin] The token cache is being invalidate because project 9694d655df4d4ceeba7d23553fefb677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:45.028885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-266f94ac-4c89-4591-8a7e-fb11128b1abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.030737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-266f94ac-4c89-4591-8a7e-fb11128b1abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.032102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 969/1932] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:44 2022] DELETE /identity/v3/projects/9694d655df4d4ceeba7d23553fefb677 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:45.037291 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bca91-b003-4903-b8f5-8c7f640afb2a None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.037658 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bca91-b003-4903-b8f5-8c7f640afb2a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.038059 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bca91-b003-4903-b8f5-8c7f640afb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.081665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-bb5bca91-b003-4903-b8f5-8c7f640afb2a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:45.093918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-bb5bca91-b003-4903-b8f5-8c7f640afb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:45.129127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:45.173323 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 964/1933] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:45.184837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a18b9c-cc9e-4e9a-8bb6-9946c8b7edb4 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.188062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-15a18b9c-cc9e-4e9a-8bb6-9946c8b7edb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:45.281125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 970/1934] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:45.288416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3900d-aef2-437e-95cd-00550a479260 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.288633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3900d-aef2-437e-95cd-00550a479260 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.288916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3900d-aef2-437e-95cd-00550a479260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.338541 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7df3900d-aef2-437e-95cd-00550a479260 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:45.341813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7df3900d-aef2-437e-95cd-00550a479260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:45.350937 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a18b9c-cc9e-4e9a-8bb6-9946c8b7edb4 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:45.360472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284a8d3-04da-41f7-95ca-70487caf042c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:45.362206 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284a8d3-04da-41f7-95ca-70487caf042c service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.362490 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284a8d3-04da-41f7-95ca-70487caf042c service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.362763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284a8d3-04da-41f7-95ca-70487caf042c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.366826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 971/1935] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:45.368573 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3900d-aef2-437e-95cd-00550a479260 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.388674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284a8d3-04da-41f7-95ca-70487caf042c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:45.389810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3900d-aef2-437e-95cd-00550a479260 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:45.391289 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284a8d3-04da-41f7-95ca-70487caf042c service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:45.411942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee897db0-c9a5-4661-8d11-e4e8f9bbb949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:45.419674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee897db0-c9a5-4661-8d11-e4e8f9bbb949 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.419997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee897db0-c9a5-4661-8d11-e4e8f9bbb949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.420256 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee897db0-c9a5-4661-8d11-e4e8f9bbb949 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.422067 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee897db0-c9a5-4661-8d11-e4e8f9bbb949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:45.422381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee897db0-c9a5-4661-8d11-e4e8f9bbb949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:45.424152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee897db0-c9a5-4661-8d11-e4e8f9bbb949 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:45.434718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 965/1936] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:45.451008 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 972/1937] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:45.452331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284a8d3-04da-41f7-95ca-70487caf042c service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.477332 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284a8d3-04da-41f7-95ca-70487caf042c service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:45.491084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb9629-135b-496d-91f3-53ab3fcaf844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:45.492196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb9629-135b-496d-91f3-53ab3fcaf844 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.506023 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb9629-135b-496d-91f3-53ab3fcaf844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.506515 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb9629-135b-496d-91f3-53ab3fcaf844 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.507664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb9629-135b-496d-91f3-53ab3fcaf844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:45.526954 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb9629-135b-496d-91f3-53ab3fcaf844 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:45.551253 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:45.609970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 966/1938] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:45 2022] POST /identity/v3/projects => generated 407 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:45.610437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee897db0-c9a5-4661-8d11-e4e8f9bbb949 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.624541 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee897db0-c9a5-4661-8d11-e4e8f9bbb949 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:45.722849 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938fe49-c129-47e6-9185-8a206e63ddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:45.723581 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938fe49-c129-47e6-9185-8a206e63ddc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.723944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938fe49-c129-47e6-9185-8a206e63ddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.724281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938fe49-c129-47e6-9185-8a206e63ddc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.725016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938fe49-c129-47e6-9185-8a206e63ddc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:45.727117 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938fe49-c129-47e6-9185-8a206e63ddc2 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:45.752369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 973/1939] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:45 2022] POST /identity/v3/users => generated 304 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:45.756524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb9629-135b-496d-91f3-53ab3fcaf844 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.768839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb9629-135b-496d-91f3-53ab3fcaf844 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:45.775281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bae51-5dcf-4807-95e3-2149778359b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:45.776015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bae51-5dcf-4807-95e3-2149778359b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.776397 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bae51-5dcf-4807-95e3-2149778359b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.776643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bae51-5dcf-4807-95e3-2149778359b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.777406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bae51-5dcf-4807-95e3-2149778359b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:45.779086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bae51-5dcf-4807-95e3-2149778359b4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:45.795849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 967/1940] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:45.800509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938fe49-c129-47e6-9185-8a206e63ddc2 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.811748 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938fe49-c129-47e6-9185-8a206e63ddc2 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:45.822032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a3955-975e-4712-a72e-45c9a365c54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:45.823885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a3955-975e-4712-a72e-45c9a365c54f admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.824286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a3955-975e-4712-a72e-45c9a365c54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.824738 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a3955-975e-4712-a72e-45c9a365c54f admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.825528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a3955-975e-4712-a72e-45c9a365c54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:45.827399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a3955-975e-4712-a72e-45c9a365c54f admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:45.843677 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 974/1941] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:45.844915 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bae51-5dcf-4807-95e3-2149778359b4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.861294 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bae51-5dcf-4807-95e3-2149778359b4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:45.866310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dbcf4-739d-4a0c-bf83-489e1b9ef572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:45.866980 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dbcf4-739d-4a0c-bf83-489e1b9ef572 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.867546 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dbcf4-739d-4a0c-bf83-489e1b9ef572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.867546 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dbcf4-739d-4a0c-bf83-489e1b9ef572 admin admin] PATH_INFO: `/v3/projects/1639b9d3f4cc47f98e48f58d05e01f41/users/a5095909daad41d99898af6beb62578c/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.884610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dbcf4-739d-4a0c-bf83-489e1b9ef572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1639b9d3f4cc47f98e48f58d05e01f41, user_id=a5095909daad41d99898af6beb62578c, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:45.888516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dbcf4-739d-4a0c-bf83-489e1b9ef572 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:45.907848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 968/1942] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:45 2022] PUT /identity/v3/projects/1639b9d3f4cc47f98e48f58d05e01f41/users/a5095909daad41d99898af6beb62578c/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:45.919860 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081229e5-b8ec-4df3-91da-fbac37335b6d None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.920195 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081229e5-b8ec-4df3-91da-fbac37335b6d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.920471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081229e5-b8ec-4df3-91da-fbac37335b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.995954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-081229e5-b8ec-4df3-91da-fbac37335b6d None None] MFA Rules not processed for user `a5095909daad41d99898af6beb62578c`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:46.000170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-081229e5-b8ec-4df3-91da-fbac37335b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.019465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dbcf4-739d-4a0c-bf83-489e1b9ef572 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.021415 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9a9dbcf4-739d-4a0c-bf83-489e1b9ef572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.131480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dbcf4-739d-4a0c-bf83-489e1b9ef572 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.134764 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 975/1943] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:45 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:46.141591 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081229e5-b8ec-4df3-91da-fbac37335b6d None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.145795 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.146541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.146831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.147108 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] PATH_INFO: `/v3/projects/92d148c859ae4f66ab609fcc5491444f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.148689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d148c859ae4f66ab609fcc5491444f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.150858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.160193 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081229e5-b8ec-4df3-91da-fbac37335b6d None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.171387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d4adb-0d0d-499a-be08-33ae1c4e8c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.172726 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d4adb-0d0d-499a-be08-33ae1c4e8c62 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.173180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d4adb-0d0d-499a-be08-33ae1c4e8c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.173553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d4adb-0d0d-499a-be08-33ae1c4e8c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.174426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d4adb-0d0d-499a-be08-33ae1c4e8c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.176917 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d4adb-0d0d-499a-be08-33ae1c4e8c62 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.182067 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:46.221613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 976/1944] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:46 2022] POST /identity/v3/projects => generated 407 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:46.224588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d4adb-0d0d-499a-be08-33ae1c4e8c62 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.229414 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d148c859ae4f66ab609fcc5491444f', 'request_id': 'req-b1633297-fc85-4338-bce2-5d5d85eb9fbb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.256309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d148c859ae4f66ab609fcc5491444f', 'request_id': 'req-b1633297-fc85-4338-bce2-5d5d85eb9fbb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.267044 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d148c859ae4f66ab609fcc5491444f', 'request_id': 'req-b1633297-fc85-4338-bce2-5d5d85eb9fbb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.284851 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] The token cache is being invalidate because project 92d148c859ae4f66ab609fcc5491444f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:46.285562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.286904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.290506 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 969/1945] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:46 2022] DELETE /identity/v3/projects/92d148c859ae4f66ab609fcc5491444f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:46.295819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.297785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.299996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d4adb-0d0d-499a-be08-33ae1c4e8c62 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.304979 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18391c17-6cca-4080-b25e-96f1ed03d92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.305612 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391c17-6cca-4080-b25e-96f1ed03d92e admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.305890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391c17-6cca-4080-b25e-96f1ed03d92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.306214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391c17-6cca-4080-b25e-96f1ed03d92e admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.306878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18391c17-6cca-4080-b25e-96f1ed03d92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.308931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18391c17-6cca-4080-b25e-96f1ed03d92e admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.334523 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 977/1946] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:46 2022] POST /identity/v3/users => generated 310 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:46.340975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18391c17-6cca-4080-b25e-96f1ed03d92e admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.342912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-18391c17-6cca-4080-b25e-96f1ed03d92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.356500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18391c17-6cca-4080-b25e-96f1ed03d92e admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.362590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a8ff5-411a-4cb5-ad95-8cc9c05e7349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.363509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a8ff5-411a-4cb5-ad95-8cc9c05e7349 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.363619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a8ff5-411a-4cb5-ad95-8cc9c05e7349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.363953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a8ff5-411a-4cb5-ad95-8cc9c05e7349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.364760 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a8ff5-411a-4cb5-ad95-8cc9c05e7349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.366669 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a8ff5-411a-4cb5-ad95-8cc9c05e7349 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.376155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:46.382537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 978/1947] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:46.383941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a8ff5-411a-4cb5-ad95-8cc9c05e7349 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.413085 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1633297-fc85-4338-bce2-5d5d85eb9fbb admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.420630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4189d5-368c-46cb-a231-363566e613a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.420798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a8ff5-411a-4cb5-ad95-8cc9c05e7349 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.422089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4189d5-368c-46cb-a231-363566e613a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.424619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4189d5-368c-46cb-a231-363566e613a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.424619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4189d5-368c-46cb-a231-363566e613a8 admin admin] PATH_INFO: `/v3/users/7b107266b0c842e9b18b0fe4f8a7f8d5` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.424619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4189d5-368c-46cb-a231-363566e613a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b107266b0c842e9b18b0fe4f8a7f8d5)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.437668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4189d5-368c-46cb-a231-363566e613a8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.439748 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944948b-e81c-4e71-9276-a24f111be488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.440525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944948b-e81c-4e71-9276-a24f111be488 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.440835 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944948b-e81c-4e71-9276-a24f111be488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.441204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944948b-e81c-4e71-9276-a24f111be488 admin admin] PATH_INFO: `/v3/projects/3b205f30ae9643ac8e681bd3f6cee0d6/users/263e482224fd4ea6a0e3808cfb5edc84/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.477849 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944948b-e81c-4e71-9276-a24f111be488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b205f30ae9643ac8e681bd3f6cee0d6, user_id=263e482224fd4ea6a0e3808cfb5edc84, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.481194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944948b-e81c-4e71-9276-a24f111be488 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.499953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 979/1948] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:46 2022] PUT /identity/v3/projects/3b205f30ae9643ac8e681bd3f6cee0d6/users/263e482224fd4ea6a0e3808cfb5edc84/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:46.503351 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5b4189d5-368c-46cb-a231-363566e613a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b107266b0c842e9b18b0fe4f8a7f8d5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.504040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944948b-e81c-4e71-9276-a24f111be488 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.518565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5b4189d5-368c-46cb-a231-363566e613a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b107266b0c842e9b18b0fe4f8a7f8d5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.529218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5b4189d5-368c-46cb-a231-363566e613a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b107266b0c842e9b18b0fe4f8a7f8d5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.540547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5b4189d5-368c-46cb-a231-363566e613a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b107266b0c842e9b18b0fe4f8a7f8d5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.541297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5b4189d5-368c-46cb-a231-363566e613a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b107266b0c842e9b18b0fe4f8a7f8d5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.549208 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 970/1949] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:46 2022] DELETE /identity/v3/users/7b107266b0c842e9b18b0fe4f8a7f8d5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:46.582373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944948b-e81c-4e71-9276-a24f111be488 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.647733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:46.662243 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79900319-bb72-4ced-8ae0-e989a831300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.662876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79900319-bb72-4ced-8ae0-e989a831300b admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.663154 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79900319-bb72-4ced-8ae0-e989a831300b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.663425 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79900319-bb72-4ced-8ae0-e989a831300b admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.664126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79900319-bb72-4ced-8ae0-e989a831300b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.665767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79900319-bb72-4ced-8ae0-e989a831300b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.677523 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 980/1950] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:46.681713 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4189d5-368c-46cb-a231-363566e613a8 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.683235 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5b4189d5-368c-46cb-a231-363566e613a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.698573 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4189d5-368c-46cb-a231-363566e613a8 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.704031 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52287d77-fb07-4f5f-bc11-86b0afbe3312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.704707 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52287d77-fb07-4f5f-bc11-86b0afbe3312 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.704991 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52287d77-fb07-4f5f-bc11-86b0afbe3312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.705268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52287d77-fb07-4f5f-bc11-86b0afbe3312 admin admin] PATH_INFO: `/v3/projects/3b205f30ae9643ac8e681bd3f6cee0d6/users/263e482224fd4ea6a0e3808cfb5edc84/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.708202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52287d77-fb07-4f5f-bc11-86b0afbe3312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b205f30ae9643ac8e681bd3f6cee0d6, user_id=263e482224fd4ea6a0e3808cfb5edc84, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.719288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52287d77-fb07-4f5f-bc11-86b0afbe3312 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.731068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 971/1951] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:46 2022] PUT /identity/v3/projects/3b205f30ae9643ac8e681bd3f6cee0d6/users/263e482224fd4ea6a0e3808cfb5edc84/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:46.741494 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1d96a-231f-4d99-87aa-cafa6cf1c2a8 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.741808 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1d96a-231f-4d99-87aa-cafa6cf1c2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.742113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1d96a-231f-4d99-87aa-cafa6cf1c2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.773179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-38c1d96a-231f-4d99-87aa-cafa6cf1c2a8 None None] MFA Rules not processed for user `263e482224fd4ea6a0e3808cfb5edc84`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:46.774601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-38c1d96a-231f-4d99-87aa-cafa6cf1c2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.876589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 981/1952] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:46 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:46.890838 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52287d77-fb07-4f5f-bc11-86b0afbe3312 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.892916 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-52287d77-fb07-4f5f-bc11-86b0afbe3312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.968050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52287d77-fb07-4f5f-bc11-86b0afbe3312 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.969959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1d96a-231f-4d99-87aa-cafa6cf1c2a8 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.971655 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-38c1d96a-231f-4d99-87aa-cafa6cf1c2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.974162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03a79a-5143-4517-b1f4-538c60a30a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.974859 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a79a-5143-4517-b1f4-538c60a30a12 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.975202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a79a-5143-4517-b1f4-538c60a30a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.975399 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a79a-5143-4517-b1f4-538c60a30a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.992785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03a79a-5143-4517-b1f4-538c60a30a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.995042 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03a79a-5143-4517-b1f4-538c60a30a12 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.008762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 972/1953] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:46 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:47.058351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1d96a-231f-4d99-87aa-cafa6cf1c2a8 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.079415 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.080280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.080564 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.080847 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] PATH_INFO: `/v3/projects/f562a3c82622421ba409e6e2a572c4bf` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.082207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f562a3c82622421ba409e6e2a572c4bf)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.084398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.135662 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f562a3c82622421ba409e6e2a572c4bf', 'request_id': 'req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:47.150128 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f562a3c82622421ba409e6e2a572c4bf', 'request_id': 'req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:47.156337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f562a3c82622421ba409e6e2a572c4bf', 'request_id': 'req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:47.163656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:47.168211 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] The token cache is being invalidate because project f562a3c82622421ba409e6e2a572c4bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:47.168675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:47.169670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:47.171480 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 982/1954] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:46 2022] DELETE /identity/v3/projects/f562a3c82622421ba409e6e2a572c4bf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:47.181644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b3ab1-3a2e-4764-a814-94fb0bc6219a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.181935 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b3ab1-3a2e-4764-a814-94fb0bc6219a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.182211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b3ab1-3a2e-4764-a814-94fb0bc6219a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.192568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.194051 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:47.202865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-480b3ab1-3a2e-4764-a814-94fb0bc6219a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:47.204076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-480b3ab1-3a2e-4764-a814-94fb0bc6219a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:47.255467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:47.258113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b6626-a565-4be9-bb0c-7e96e5a2fb47 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.262503 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9914b-6aac-46d1-9fc8-aae43139ea63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.263144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9914b-6aac-46d1-9fc8-aae43139ea63 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.263754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9914b-6aac-46d1-9fc8-aae43139ea63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.264029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9914b-6aac-46d1-9fc8-aae43139ea63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.265953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-38d9914b-6aac-46d1-9fc8-aae43139ea63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:47.272732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 973/1955] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:47.280807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302acc4f-2033-4d55-a9e2-453482f4fbd4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.281103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302acc4f-2033-4d55-a9e2-453482f4fbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.281388 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302acc4f-2033-4d55-a9e2-453482f4fbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.308631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-302acc4f-2033-4d55-a9e2-453482f4fbd4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:47.309775 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-302acc4f-2033-4d55-a9e2-453482f4fbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:47.331846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 974/1956] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:47.336759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302acc4f-2033-4d55-a9e2-453482f4fbd4 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.338463 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-302acc4f-2033-4d55-a9e2-453482f4fbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:47.351777 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302acc4f-2033-4d55-a9e2-453482f4fbd4 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.352864 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9914b-6aac-46d1-9fc8-aae43139ea63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.354516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9914b-6aac-46d1-9fc8-aae43139ea63 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.357572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc7f47-a0dc-48e4-8ad9-40b322787b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.358170 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc7f47-a0dc-48e4-8ad9-40b322787b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.358450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc7f47-a0dc-48e4-8ad9-40b322787b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.358725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc7f47-a0dc-48e4-8ad9-40b322787b60 admin admin] PATH_INFO: `/v3/users/fe46045132f24eaabc75e1c58e29098a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.360027 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc7f47-a0dc-48e4-8ad9-40b322787b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe46045132f24eaabc75e1c58e29098a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.362094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc7f47-a0dc-48e4-8ad9-40b322787b60 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.371521 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 983/1957] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:47 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:47.376745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9914b-6aac-46d1-9fc8-aae43139ea63 service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.389620 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9914b-6aac-46d1-9fc8-aae43139ea63 service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.398587 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a92ef1-b85a-41e4-a1b2-d93025934fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.399215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a92ef1-b85a-41e4-a1b2-d93025934fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.399984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a92ef1-b85a-41e4-a1b2-d93025934fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.399984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a92ef1-b85a-41e4-a1b2-d93025934fc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.400504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a92ef1-b85a-41e4-a1b2-d93025934fc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:47.400821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a92ef1-b85a-41e4-a1b2-d93025934fc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.402820 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a92ef1-b85a-41e4-a1b2-d93025934fc7 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.416961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 984/1958] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:47.422686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a92ef1-b85a-41e4-a1b2-d93025934fc7 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.427135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bbc7f47-a0dc-48e4-8ad9-40b322787b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe46045132f24eaabc75e1c58e29098a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:47.436223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a92ef1-b85a-41e4-a1b2-d93025934fc7 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.445901 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022160d-1289-481d-b06f-b1846e0467fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.448012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022160d-1289-481d-b06f-b1846e0467fd admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.448619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022160d-1289-481d-b06f-b1846e0467fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.449139 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022160d-1289-481d-b06f-b1846e0467fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.451633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022160d-1289-481d-b06f-b1846e0467fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.453172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bbc7f47-a0dc-48e4-8ad9-40b322787b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe46045132f24eaabc75e1c58e29098a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:47.455739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022160d-1289-481d-b06f-b1846e0467fd admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.463884 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bbc7f47-a0dc-48e4-8ad9-40b322787b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe46045132f24eaabc75e1c58e29098a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:47.480520 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bbc7f47-a0dc-48e4-8ad9-40b322787b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe46045132f24eaabc75e1c58e29098a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:47.483087 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bbc7f47-a0dc-48e4-8ad9-40b322787b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe46045132f24eaabc75e1c58e29098a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:47.497668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 975/1959] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:47 2022] DELETE /identity/v3/users/fe46045132f24eaabc75e1c58e29098a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:47.503245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aa907-168c-4ab6-a227-2a1436894ab7 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.503591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aa907-168c-4ab6-a227-2a1436894ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.503962 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aa907-168c-4ab6-a227-2a1436894ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.532151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 985/1960] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:47 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:47.538534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022160d-1289-481d-b06f-b1846e0467fd admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.542026 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-0022160d-1289-481d-b06f-b1846e0467fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:47.546924 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-450aa907-168c-4ab6-a227-2a1436894ab7 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:47.548268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-450aa907-168c-4ab6-a227-2a1436894ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:47.662440 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022160d-1289-481d-b06f-b1846e0467fd admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.669626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fd0f1-c7ba-47cc-a6fe-7af14dd42d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.670573 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fd0f1-c7ba-47cc-a6fe-7af14dd42d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.670691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fd0f1-c7ba-47cc-a6fe-7af14dd42d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.671992 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fd0f1-c7ba-47cc-a6fe-7af14dd42d0d admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.672699 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fd0f1-c7ba-47cc-a6fe-7af14dd42d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.675649 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fd0f1-c7ba-47cc-a6fe-7af14dd42d0d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.685366 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 976/1961] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:47.699132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450aa907-168c-4ab6-a227-2a1436894ab7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.701610 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-450aa907-168c-4ab6-a227-2a1436894ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:47.729820 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 986/1962] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:47 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:47.733502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fd0f1-c7ba-47cc-a6fe-7af14dd42d0d admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.768927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fd0f1-c7ba-47cc-a6fe-7af14dd42d0d admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.785609 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025ec99-e458-4ac6-bb1c-482fa7f9a686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.786309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025ec99-e458-4ac6-bb1c-482fa7f9a686 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.788760 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025ec99-e458-4ac6-bb1c-482fa7f9a686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.789028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025ec99-e458-4ac6-bb1c-482fa7f9a686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.789704 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025ec99-e458-4ac6-bb1c-482fa7f9a686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.793793 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025ec99-e458-4ac6-bb1c-482fa7f9a686 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.799654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:47.814149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450aa907-168c-4ab6-a227-2a1436894ab7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.818718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d07a58-cba3-418b-bc50-3cb4dfc26947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.820111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 987/1963] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:47.823203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d07a58-cba3-418b-bc50-3cb4dfc26947 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.823203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d07a58-cba3-418b-bc50-3cb4dfc26947 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.823530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d07a58-cba3-418b-bc50-3cb4dfc26947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.823668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025ec99-e458-4ac6-bb1c-482fa7f9a686 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.835082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d07a58-cba3-418b-bc50-3cb4dfc26947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.837129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d07a58-cba3-418b-bc50-3cb4dfc26947 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.844386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025ec99-e458-4ac6-bb1c-482fa7f9a686 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.845376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:47.855436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 977/1964] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:47.863915 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f165f-8ea1-45f5-bc20-b81540586152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.865792 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f165f-8ea1-45f5-bc20-b81540586152 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.867036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f165f-8ea1-45f5-bc20-b81540586152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.868803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f165f-8ea1-45f5-bc20-b81540586152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.869750 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f165f-8ea1-45f5-bc20-b81540586152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.872685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f165f-8ea1-45f5-bc20-b81540586152 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.904683 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 988/1965] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:47.908983 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d07a58-cba3-418b-bc50-3cb4dfc26947 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.932422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d07a58-cba3-418b-bc50-3cb4dfc26947 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.942600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b7477-fb6f-473a-8faa-492bda84cff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.943378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7477-fb6f-473a-8faa-492bda84cff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.943674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7477-fb6f-473a-8faa-492bda84cff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.945457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7477-fb6f-473a-8faa-492bda84cff1 admin admin] PATH_INFO: `/v3/projects/51d0f2fd73dd429e853a241241f79071/users/acfc8a880e7a4e2b97babe7e6b092aa2/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.980898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b7477-fb6f-473a-8faa-492bda84cff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d0f2fd73dd429e853a241241f79071, user_id=acfc8a880e7a4e2b97babe7e6b092aa2, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.992570 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b7477-fb6f-473a-8faa-492bda84cff1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:48.027732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 978/1966] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:47 2022] PUT /identity/v3/projects/51d0f2fd73dd429e853a241241f79071/users/acfc8a880e7a4e2b97babe7e6b092aa2/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:48.032734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e329ae-21b4-4c52-9fe4-146a517a32b8 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:48.033018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e329ae-21b4-4c52-9fe4-146a517a32b8 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:48.033291 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e329ae-21b4-4c52-9fe4-146a517a32b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:48.060301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-84e329ae-21b4-4c52-9fe4-146a517a32b8 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:48.061840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-84e329ae-21b4-4c52-9fe4-146a517a32b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:48.158052 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 989/1967] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:48.187547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b7477-fb6f-473a-8faa-492bda84cff1 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:48.269238 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b7477-fb6f-473a-8faa-492bda84cff1 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:48.275052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f900b3-897b-49a2-a074-3233a5ee59aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:48.277389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f900b3-897b-49a2-a074-3233a5ee59aa service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:48.277389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f900b3-897b-49a2-a074-3233a5ee59aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:48.277389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f900b3-897b-49a2-a074-3233a5ee59aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:48.290955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f900b3-897b-49a2-a074-3233a5ee59aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:48.292571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f900b3-897b-49a2-a074-3233a5ee59aa service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:48.306646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 979/1968] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:48.499575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e329ae-21b4-4c52-9fe4-146a517a32b8 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:48.501196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-84e329ae-21b4-4c52-9fe4-146a517a32b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:48.525089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e329ae-21b4-4c52-9fe4-146a517a32b8 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:48.532729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:48.533459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:48.533743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:48.534019 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] PATH_INFO: `/v3/projects/f8af635af9f74f7b881ac5ea6c8778e2` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:48.539116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8af635af9f74f7b881ac5ea6c8778e2)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:48.541575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:48.608718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8af635af9f74f7b881ac5ea6c8778e2', 'request_id': 'req-9c2da2db-ca46-470d-b562-b0ee6069fc56'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.650467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8af635af9f74f7b881ac5ea6c8778e2', 'request_id': 'req-9c2da2db-ca46-470d-b562-b0ee6069fc56'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.662584 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8af635af9f74f7b881ac5ea6c8778e2', 'request_id': 'req-9c2da2db-ca46-470d-b562-b0ee6069fc56'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.684432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] The token cache is being invalidate because project f8af635af9f74f7b881ac5ea6c8778e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:48.684766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.685439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.687383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 990/1969] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:48 2022] DELETE /identity/v3/projects/f8af635af9f74f7b881ac5ea6c8778e2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:48.691722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f900b3-897b-49a2-a074-3233a5ee59aa service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:48.705722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f900b3-897b-49a2-a074-3233a5ee59aa service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:48.799019 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9842f-0897-4184-80b7-a9105970f504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:48.799676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9842f-0897-4184-80b7-a9105970f504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:48.800009 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9842f-0897-4184-80b7-a9105970f504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:48.800283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9842f-0897-4184-80b7-a9105970f504 admin admin] PATH_INFO: `/v3/users/65326127b4f54a7e82303ae2920d6190` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:48.802985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9842f-0897-4184-80b7-a9105970f504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65326127b4f54a7e82303ae2920d6190)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:48.806686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9842f-0897-4184-80b7-a9105970f504 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:48.876280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dfd9842f-0897-4184-80b7-a9105970f504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65326127b4f54a7e82303ae2920d6190'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.900387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dfd9842f-0897-4184-80b7-a9105970f504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65326127b4f54a7e82303ae2920d6190'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.910265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dfd9842f-0897-4184-80b7-a9105970f504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65326127b4f54a7e82303ae2920d6190'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.925259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dfd9842f-0897-4184-80b7-a9105970f504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65326127b4f54a7e82303ae2920d6190'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.926283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dfd9842f-0897-4184-80b7-a9105970f504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65326127b4f54a7e82303ae2920d6190'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.929250 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:48.940871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 980/1970] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:48 2022] DELETE /identity/v3/users/65326127b4f54a7e82303ae2920d6190 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:50.161746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:50.163442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:50.176869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2da2db-ca46-470d-b562-b0ee6069fc56 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:50.284160 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4ccfd-68d7-445e-b32c-9e185989ecca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:50.284884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4ccfd-68d7-445e-b32c-9e185989ecca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:50.285171 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4ccfd-68d7-445e-b32c-9e185989ecca admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:50.286078 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4ccfd-68d7-445e-b32c-9e185989ecca admin admin] PATH_INFO: `/v3/projects/e8ed04f8e383472fb50b6f4ec0c869bc` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:50.287419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4ccfd-68d7-445e-b32c-9e185989ecca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ed04f8e383472fb50b6f4ec0c869bc)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:50.290041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4ccfd-68d7-445e-b32c-9e185989ecca admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:50.308074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:50.348692 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d9f4ccfd-68d7-445e-b32c-9e185989ecca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ed04f8e383472fb50b6f4ec0c869bc', 'request_id': 'req-d9f4ccfd-68d7-445e-b32c-9e185989ecca'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:50.357269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d9f4ccfd-68d7-445e-b32c-9e185989ecca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ed04f8e383472fb50b6f4ec0c869bc', 'request_id': 'req-d9f4ccfd-68d7-445e-b32c-9e185989ecca'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:50.363713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d9f4ccfd-68d7-445e-b32c-9e185989ecca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ed04f8e383472fb50b6f4ec0c869bc', 'request_id': 'req-d9f4ccfd-68d7-445e-b32c-9e185989ecca'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:50.376197 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d9f4ccfd-68d7-445e-b32c-9e185989ecca admin admin] The token cache is being invalidate because project e8ed04f8e383472fb50b6f4ec0c869bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:50.376538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d9f4ccfd-68d7-445e-b32c-9e185989ecca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:50.377319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d9f4ccfd-68d7-445e-b32c-9e185989ecca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:50.378891 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 991/1971] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:50 2022] DELETE /identity/v3/projects/e8ed04f8e383472fb50b6f4ec0c869bc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:50.383214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9842f-0897-4184-80b7-a9105970f504 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:50.384826 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-dfd9842f-0897-4184-80b7-a9105970f504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:50.397885 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9842f-0897-4184-80b7-a9105970f504 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:50.472122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd324ed-7157-4c7c-9125-250b3cd39042 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:50.472506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd324ed-7157-4c7c-9125-250b3cd39042 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:50.472899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd324ed-7157-4c7c-9125-250b3cd39042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:50.497325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c03a-9f37-4547-84f3-2f639e472ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:50.498299 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c03a-9f37-4547-84f3-2f639e472ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:50.498734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c03a-9f37-4547-84f3-2f639e472ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:50.499157 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c03a-9f37-4547-84f3-2f639e472ebd admin admin] PATH_INFO: `/v3/users/c3b3a8356f4e4ec3909fe416868f674f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:50.500574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9c03a-9f37-4547-84f3-2f639e472ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b3a8356f4e4ec3909fe416868f674f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:50.503825 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9c03a-9f37-4547-84f3-2f639e472ebd admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:50.526503 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-4fd324ed-7157-4c7c-9125-250b3cd39042 None None] MFA Rules not processed for user `acfc8a880e7a4e2b97babe7e6b092aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:50.528076 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-4fd324ed-7157-4c7c-9125-250b3cd39042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:50.572172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8cf9c03a-9f37-4547-84f3-2f639e472ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b3a8356f4e4ec3909fe416868f674f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:50.590995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8cf9c03a-9f37-4547-84f3-2f639e472ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b3a8356f4e4ec3909fe416868f674f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:50.600311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8cf9c03a-9f37-4547-84f3-2f639e472ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b3a8356f4e4ec3909fe416868f674f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:50.617894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8cf9c03a-9f37-4547-84f3-2f639e472ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b3a8356f4e4ec3909fe416868f674f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:50.619791 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8cf9c03a-9f37-4547-84f3-2f639e472ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b3a8356f4e4ec3909fe416868f674f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:50.631646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 981/1972] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:50 2022] DELETE /identity/v3/users/c3b3a8356f4e4ec3909fe416868f674f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:50.682198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 992/1973] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:50.694640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c03a-9f37-4547-84f3-2f639e472ebd admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:50.696764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8cf9c03a-9f37-4547-84f3-2f639e472ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:50.875780 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c03a-9f37-4547-84f3-2f639e472ebd admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:50.880970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2db5c7-5f55-45bc-a407-f409dc64da93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:50.881799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db5c7-5f55-45bc-a407-f409dc64da93 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:50.882650 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db5c7-5f55-45bc-a407-f409dc64da93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:50.882650 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db5c7-5f55-45bc-a407-f409dc64da93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:50.926493 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:50.967855 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2db5c7-5f55-45bc-a407-f409dc64da93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:50.969358 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2db5c7-5f55-45bc-a407-f409dc64da93 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:50.980224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 982/1974] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:51.063493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd324ed-7157-4c7c-9125-250b3cd39042 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:51.070990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-4fd324ed-7157-4c7c-9125-250b3cd39042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:51.102810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd324ed-7157-4c7c-9125-250b3cd39042 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:51.206805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11219c98-fc07-4373-b371-972920bc4568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:51.208355 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11219c98-fc07-4373-b371-972920bc4568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.208814 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11219c98-fc07-4373-b371-972920bc4568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.209097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11219c98-fc07-4373-b371-972920bc4568 admin admin] PATH_INFO: `/v3/projects/690d42dbc4fb4ca1917ba42859794657` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:51.210317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11219c98-fc07-4373-b371-972920bc4568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=690d42dbc4fb4ca1917ba42859794657)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:51.213317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11219c98-fc07-4373-b371-972920bc4568 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:51.269153 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:51.301826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-11219c98-fc07-4373-b371-972920bc4568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690d42dbc4fb4ca1917ba42859794657', 'request_id': 'req-11219c98-fc07-4373-b371-972920bc4568'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.314593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-11219c98-fc07-4373-b371-972920bc4568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690d42dbc4fb4ca1917ba42859794657', 'request_id': 'req-11219c98-fc07-4373-b371-972920bc4568'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.328333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-11219c98-fc07-4373-b371-972920bc4568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690d42dbc4fb4ca1917ba42859794657', 'request_id': 'req-11219c98-fc07-4373-b371-972920bc4568'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.369760 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-11219c98-fc07-4373-b371-972920bc4568 admin admin] The token cache is being invalidate because project 690d42dbc4fb4ca1917ba42859794657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:51.370202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-11219c98-fc07-4373-b371-972920bc4568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.371036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-11219c98-fc07-4373-b371-972920bc4568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.372713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 993/1975] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:51 2022] DELETE /identity/v3/projects/690d42dbc4fb4ca1917ba42859794657 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:51.379359 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e70e89-b486-410f-b769-6babed083caf None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.379740 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e70e89-b486-410f-b769-6babed083caf None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.380113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e70e89-b486-410f-b769-6babed083caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:51.418765 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f0e70e89-b486-410f-b769-6babed083caf None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:51.426593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f0e70e89-b486-410f-b769-6babed083caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:51.547634 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 983/1976] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:51.556449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce65ca7-e15a-437f-95a7-a470cc7bcabe None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.556763 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce65ca7-e15a-437f-95a7-a470cc7bcabe None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.557046 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce65ca7-e15a-437f-95a7-a470cc7bcabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:51.579592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-fce65ca7-e15a-437f-95a7-a470cc7bcabe None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:51.580852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-fce65ca7-e15a-437f-95a7-a470cc7bcabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:51.589303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 994/1977] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:51.593758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e70e89-b486-410f-b769-6babed083caf None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:51.603846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e70e89-b486-410f-b769-6babed083caf None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:51.610723 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299d287-6d19-400f-8a69-7870a5ef413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:51.611369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299d287-6d19-400f-8a69-7870a5ef413b admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.611683 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299d287-6d19-400f-8a69-7870a5ef413b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.611952 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299d287-6d19-400f-8a69-7870a5ef413b admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:51.612609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299d287-6d19-400f-8a69-7870a5ef413b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:51.612908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299d287-6d19-400f-8a69-7870a5ef413b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:51.614750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299d287-6d19-400f-8a69-7870a5ef413b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:51.627131 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 984/1978] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:21:51.631981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce65ca7-e15a-437f-95a7-a470cc7bcabe None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:51.643329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce65ca7-e15a-437f-95a7-a470cc7bcabe None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:51.648085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13215-4d74-4ad4-bf53-a245e501edbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:51.648774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13215-4d74-4ad4-bf53-a245e501edbe admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.649218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13215-4d74-4ad4-bf53-a245e501edbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.649554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13215-4d74-4ad4-bf53-a245e501edbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:51.650329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13215-4d74-4ad4-bf53-a245e501edbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:51.652274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13215-4d74-4ad4-bf53-a245e501edbe admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:51.687499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 995/1979] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:51 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:51.688854 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299d287-6d19-400f-8a69-7870a5ef413b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:51.699239 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299d287-6d19-400f-8a69-7870a5ef413b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:51.761686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a94126-413b-42b7-856a-371fbacc9cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:51.762306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a94126-413b-42b7-856a-371fbacc9cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.762636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a94126-413b-42b7-856a-371fbacc9cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.762895 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a94126-413b-42b7-856a-371fbacc9cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:51.763923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a94126-413b-42b7-856a-371fbacc9cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:51.767271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a94126-413b-42b7-856a-371fbacc9cb1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:51.792297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 985/1980] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:51 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:51.796925 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13215-4d74-4ad4-bf53-a245e501edbe admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:51.807721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13215-4d74-4ad4-bf53-a245e501edbe admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:51.812781 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8534f14-6b5b-4c5f-b650-e4e31c94ed5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:51.813402 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534f14-6b5b-4c5f-b650-e4e31c94ed5d admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.813705 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534f14-6b5b-4c5f-b650-e4e31c94ed5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.813980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534f14-6b5b-4c5f-b650-e4e31c94ed5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:51.814676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8534f14-6b5b-4c5f-b650-e4e31c94ed5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:51.816336 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8534f14-6b5b-4c5f-b650-e4e31c94ed5d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:51.830694 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 996/1981] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:51.831905 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a94126-413b-42b7-856a-371fbacc9cb1 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:51.845461 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a94126-413b-42b7-856a-371fbacc9cb1 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:51.850670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d385c90-fb31-4d8b-9a23-49f6d4212678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:51.851894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d385c90-fb31-4d8b-9a23-49f6d4212678 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.852255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d385c90-fb31-4d8b-9a23-49f6d4212678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.852604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d385c90-fb31-4d8b-9a23-49f6d4212678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:51.853349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d385c90-fb31-4d8b-9a23-49f6d4212678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:51.855077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d385c90-fb31-4d8b-9a23-49f6d4212678 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:51.868638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 986/1982] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:51.872966 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8534f14-6b5b-4c5f-b650-e4e31c94ed5d admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:51.885737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8534f14-6b5b-4c5f-b650-e4e31c94ed5d admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:51.890759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba2e8b-c5ac-46af-ab28-3018fd8b462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:51.891432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba2e8b-c5ac-46af-ab28-3018fd8b462e admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.891734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba2e8b-c5ac-46af-ab28-3018fd8b462e admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.892029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba2e8b-c5ac-46af-ab28-3018fd8b462e admin admin] PATH_INFO: `/v3/projects/61aa7ac3246d4c58bda615cdb4280ccc/users/85dc375d6a834f80961416ab15177565/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:51.907625 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba2e8b-c5ac-46af-ab28-3018fd8b462e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61aa7ac3246d4c58bda615cdb4280ccc, user_id=85dc375d6a834f80961416ab15177565, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:51.910357 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba2e8b-c5ac-46af-ab28-3018fd8b462e admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:51.926214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 997/1983] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:51 2022] PUT /identity/v3/projects/61aa7ac3246d4c58bda615cdb4280ccc/users/85dc375d6a834f80961416ab15177565/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:51.938273 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4537c32-657e-4edb-977e-303e79119017 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.938560 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4537c32-657e-4edb-977e-303e79119017 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.938839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4537c32-657e-4edb-977e-303e79119017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:51.969492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f4537c32-657e-4edb-977e-303e79119017 None None] MFA Rules not processed for user `85dc375d6a834f80961416ab15177565`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:51.970903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f4537c32-657e-4edb-977e-303e79119017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:52.000049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:52.042435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 987/1984] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:52.047321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba2e8b-c5ac-46af-ab28-3018fd8b462e admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:52.131427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba2e8b-c5ac-46af-ab28-3018fd8b462e admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:52.136909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dcaa8-7cfe-4517-aff2-bb82d3b62c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:52.137171 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dcaa8-7cfe-4517-aff2-bb82d3b62c83 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.137630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dcaa8-7cfe-4517-aff2-bb82d3b62c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.138109 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dcaa8-7cfe-4517-aff2-bb82d3b62c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.138777 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dcaa8-7cfe-4517-aff2-bb82d3b62c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:52.141105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dcaa8-7cfe-4517-aff2-bb82d3b62c83 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:52.223381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 998/1985] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:52 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:52.227246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4537c32-657e-4edb-977e-303e79119017 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:52.241744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4537c32-657e-4edb-977e-303e79119017 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:52.319246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb993738-9805-4368-986d-68b8725a75b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:52.319914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb993738-9805-4368-986d-68b8725a75b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.320198 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb993738-9805-4368-986d-68b8725a75b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.320474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb993738-9805-4368-986d-68b8725a75b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.321125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb993738-9805-4368-986d-68b8725a75b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:52.323209 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb993738-9805-4368-986d-68b8725a75b1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:52.347313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 988/1986] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:52 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:52.351660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dcaa8-7cfe-4517-aff2-bb82d3b62c83 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:52.363105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dcaa8-7cfe-4517-aff2-bb82d3b62c83 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:52.369156 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f7983-d0f5-46f4-85e6-e09c961f1e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:52.369794 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f7983-d0f5-46f4-85e6-e09c961f1e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.370065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f7983-d0f5-46f4-85e6-e09c961f1e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.370328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f7983-d0f5-46f4-85e6-e09c961f1e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.370972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f7983-d0f5-46f4-85e6-e09c961f1e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:52.372664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f7983-d0f5-46f4-85e6-e09c961f1e0a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:52.385536 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 999/1987] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:52.390144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb993738-9805-4368-986d-68b8725a75b1 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:52.402618 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb993738-9805-4368-986d-68b8725a75b1 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:52.408334 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72e633-9e65-4227-a9a2-4267192d23d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:52.409192 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e633-9e65-4227-a9a2-4267192d23d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.409455 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e633-9e65-4227-a9a2-4267192d23d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.409802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e633-9e65-4227-a9a2-4267192d23d0 admin admin] PATH_INFO: `/v3/projects/e6df11d2e41c4dd48670e7fb4dacf805/users/3b4505f41cc64a6abcfb3fa73a112c7e/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.426370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72e633-9e65-4227-a9a2-4267192d23d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6df11d2e41c4dd48670e7fb4dacf805, user_id=3b4505f41cc64a6abcfb3fa73a112c7e, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:52.429105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72e633-9e65-4227-a9a2-4267192d23d0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:52.446882 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 989/1988] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:52 2022] PUT /identity/v3/projects/e6df11d2e41c4dd48670e7fb4dacf805/users/3b4505f41cc64a6abcfb3fa73a112c7e/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:52.450885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f7983-d0f5-46f4-85e6-e09c961f1e0a admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:52.468200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f7983-d0f5-46f4-85e6-e09c961f1e0a admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:52.527097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:52.581480 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d62261-9a23-4812-af1c-19d7e51da61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:52.582117 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d62261-9a23-4812-af1c-19d7e51da61d admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.582394 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d62261-9a23-4812-af1c-19d7e51da61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.582664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d62261-9a23-4812-af1c-19d7e51da61d admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.583325 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d62261-9a23-4812-af1c-19d7e51da61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:52.585030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d62261-9a23-4812-af1c-19d7e51da61d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:52.596141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1000/1989] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:52.600402 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72e633-9e65-4227-a9a2-4267192d23d0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:52.611462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72e633-9e65-4227-a9a2-4267192d23d0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:52.629472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff112c42-3033-47cf-8071-2d9a582fc4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:52.630074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff112c42-3033-47cf-8071-2d9a582fc4c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.630505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff112c42-3033-47cf-8071-2d9a582fc4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.630668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff112c42-3033-47cf-8071-2d9a582fc4c2 admin admin] PATH_INFO: `/v3/projects/e6df11d2e41c4dd48670e7fb4dacf805/users/3b4505f41cc64a6abcfb3fa73a112c7e/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.632731 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c7de2-7d1a-4bf1-a9cc-663d0faa9fce None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.632980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c7de2-7d1a-4bf1-a9cc-663d0faa9fce None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.633475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff112c42-3033-47cf-8071-2d9a582fc4c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6df11d2e41c4dd48670e7fb4dacf805, user_id=3b4505f41cc64a6abcfb3fa73a112c7e, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:52.633593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c7de2-7d1a-4bf1-a9cc-663d0faa9fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.638644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff112c42-3033-47cf-8071-2d9a582fc4c2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:52.664468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 990/1990] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:52 2022] PUT /identity/v3/projects/e6df11d2e41c4dd48670e7fb4dacf805/users/3b4505f41cc64a6abcfb3fa73a112c7e/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:52.664669 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-ee9c7de2-7d1a-4bf1-a9cc-663d0faa9fce None None] MFA Rules not processed for user `acfc8a880e7a4e2b97babe7e6b092aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:52.664669 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ee9c7de2-7d1a-4bf1-a9cc-663d0faa9fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:52.667807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122b780-b80f-412d-83f6-156b2baffe78 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.668102 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122b780-b80f-412d-83f6-156b2baffe78 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.668430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122b780-b80f-412d-83f6-156b2baffe78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.709742 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7122b780-b80f-412d-83f6-156b2baffe78 None None] MFA Rules not processed for user `3b4505f41cc64a6abcfb3fa73a112c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:52.710989 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7122b780-b80f-412d-83f6-156b2baffe78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:52.733624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1001/1991] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:52.791268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 991/1992] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:52.802671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c7de2-7d1a-4bf1-a9cc-663d0faa9fce None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:52.804191 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ee9c7de2-7d1a-4bf1-a9cc-663d0faa9fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:52.866926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c7de2-7d1a-4bf1-a9cc-663d0faa9fce None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:52.871266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a83867-f300-4c49-9259-cef0c6feacbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:52.871914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a83867-f300-4c49-9259-cef0c6feacbe service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.872194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a83867-f300-4c49-9259-cef0c6feacbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.872459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a83867-f300-4c49-9259-cef0c6feacbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.883414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a83867-f300-4c49-9259-cef0c6feacbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:52.885028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a83867-f300-4c49-9259-cef0c6feacbe service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:52.895620 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1002/1993] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:53.639016 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122b780-b80f-412d-83f6-156b2baffe78 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:53.640662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7122b780-b80f-412d-83f6-156b2baffe78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:53.649824 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:53.818526 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a83867-f300-4c49-9259-cef0c6feacbe service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:53.868068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122b780-b80f-412d-83f6-156b2baffe78 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:53.883649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfbbf6-a311-4f77-a4da-5a8cd19fcb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:53.884788 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfbbf6-a311-4f77-a4da-5a8cd19fcb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:53.885321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfbbf6-a311-4f77-a4da-5a8cd19fcb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:53.885603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfbbf6-a311-4f77-a4da-5a8cd19fcb9a admin admin] PATH_INFO: `/v3/users/a5095909daad41d99898af6beb62578c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:53.887896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfbbf6-a311-4f77-a4da-5a8cd19fcb9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5095909daad41d99898af6beb62578c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:53.893074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfbbf6-a311-4f77-a4da-5a8cd19fcb9a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:53.924051 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a83867-f300-4c49-9259-cef0c6feacbe service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:53.955735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2f46c-1dc4-49fd-b6ca-41a26cf4464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:53.955735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2f46c-1dc4-49fd-b6ca-41a26cf4464c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:53.955735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2f46c-1dc4-49fd-b6ca-41a26cf4464c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:53.955735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2f46c-1dc4-49fd-b6ca-41a26cf4464c admin admin] PATH_INFO: `/v3/users/85dc375d6a834f80961416ab15177565` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:53.956253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2f46c-1dc4-49fd-b6ca-41a26cf4464c admin admin] RBAC: Authorizing `identity:delete_user(user_id=85dc375d6a834f80961416ab15177565)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:53.956253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2f46c-1dc4-49fd-b6ca-41a26cf4464c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:53.987883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:53.993249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-19bfbbf6-a311-4f77-a4da-5a8cd19fcb9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5095909daad41d99898af6beb62578c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.022490 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-19bfbbf6-a311-4f77-a4da-5a8cd19fcb9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5095909daad41d99898af6beb62578c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.032589 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-19bfbbf6-a311-4f77-a4da-5a8cd19fcb9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5095909daad41d99898af6beb62578c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.042202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-19bfbbf6-a311-4f77-a4da-5a8cd19fcb9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5095909daad41d99898af6beb62578c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.043917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-19bfbbf6-a311-4f77-a4da-5a8cd19fcb9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5095909daad41d99898af6beb62578c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.049380 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f6b2f46c-1dc4-49fd-b6ca-41a26cf4464c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85dc375d6a834f80961416ab15177565'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.054096 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 992/1994] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:53 2022] DELETE /identity/v3/users/a5095909daad41d99898af6beb62578c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:54.058508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078c057-9466-4891-a3f8-c74562dd0170 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:54.058811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078c057-9466-4891-a3f8-c74562dd0170 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:54.059082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078c057-9466-4891-a3f8-c74562dd0170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:54.066685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f6b2f46c-1dc4-49fd-b6ca-41a26cf4464c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85dc375d6a834f80961416ab15177565'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.075493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f6b2f46c-1dc4-49fd-b6ca-41a26cf4464c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85dc375d6a834f80961416ab15177565'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.080819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a078c057-9466-4891-a3f8-c74562dd0170 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:54.082151 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a078c057-9466-4891-a3f8-c74562dd0170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:54.086318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f6b2f46c-1dc4-49fd-b6ca-41a26cf4464c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85dc375d6a834f80961416ab15177565'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.087037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f6b2f46c-1dc4-49fd-b6ca-41a26cf4464c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85dc375d6a834f80961416ab15177565'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.098152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1003/1995] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:53 2022] DELETE /identity/v3/users/85dc375d6a834f80961416ab15177565 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:54.100116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe38a9d-c746-4cbd-9c17-84af5b9e9bc7 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:54.100401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe38a9d-c746-4cbd-9c17-84af5b9e9bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:54.100721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe38a9d-c746-4cbd-9c17-84af5b9e9bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:54.127424 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-ebe38a9d-c746-4cbd-9c17-84af5b9e9bc7 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:54.128732 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ebe38a9d-c746-4cbd-9c17-84af5b9e9bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:54.164975 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 993/1996] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:54.199416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1004/1997] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:54.212235 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078c057-9466-4891-a3f8-c74562dd0170 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:54.213929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a078c057-9466-4891-a3f8-c74562dd0170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:54.219569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe38a9d-c746-4cbd-9c17-84af5b9e9bc7 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:54.221707 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ebe38a9d-c746-4cbd-9c17-84af5b9e9bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:54.256278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:54.298147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078c057-9466-4891-a3f8-c74562dd0170 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:54.313419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe38a9d-c746-4cbd-9c17-84af5b9e9bc7 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:54.318269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131e413-91fc-470d-9528-a50270995477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:54.318902 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131e413-91fc-470d-9528-a50270995477 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:54.319182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131e413-91fc-470d-9528-a50270995477 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:54.319452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131e413-91fc-470d-9528-a50270995477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:54.331861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131e413-91fc-470d-9528-a50270995477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:54.334075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131e413-91fc-470d-9528-a50270995477 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:54.348670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1005/1998] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:54.363558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16ba74-0132-4c48-9ce9-d2ae5da586f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:54.364280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ba74-0132-4c48-9ce9-d2ae5da586f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:54.364559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ba74-0132-4c48-9ce9-d2ae5da586f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:54.364832 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ba74-0132-4c48-9ce9-d2ae5da586f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:54.375420 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16ba74-0132-4c48-9ce9-d2ae5da586f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:54.377748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16ba74-0132-4c48-9ce9-d2ae5da586f4 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:54.388983 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 994/1999] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:56.022039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131e413-91fc-470d-9528-a50270995477 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:56.023475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a131e413-91fc-470d-9528-a50270995477 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:56.029363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16ba74-0132-4c48-9ce9-d2ae5da586f4 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:56.030785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4a16ba74-0132-4c48-9ce9-d2ae5da586f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:56.053132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16ba74-0132-4c48-9ce9-d2ae5da586f4 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:56.054518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131e413-91fc-470d-9528-a50270995477 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:56.058285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:56.059177 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:56.059651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:56.059968 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] PATH_INFO: `/v3/projects/1639b9d3f4cc47f98e48f58d05e01f41` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:56.060492 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:56.061134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:56.061258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1639b9d3f4cc47f98e48f58d05e01f41)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:56.061443 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:56.061686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] PATH_INFO: `/v3/projects/61aa7ac3246d4c58bda615cdb4280ccc` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:56.062824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] RBAC: Authorizing `identity:delete_project(project_id=61aa7ac3246d4c58bda615cdb4280ccc)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:56.063240 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:56.065081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:56.118156 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:56.136655 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61aa7ac3246d4c58bda615cdb4280ccc', 'request_id': 'req-de39b629-0cbb-40e8-a00e-5f43d219219a'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.159988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61aa7ac3246d4c58bda615cdb4280ccc', 'request_id': 'req-de39b629-0cbb-40e8-a00e-5f43d219219a'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.170038 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61aa7ac3246d4c58bda615cdb4280ccc', 'request_id': 'req-de39b629-0cbb-40e8-a00e-5f43d219219a'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.186087 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1639b9d3f4cc47f98e48f58d05e01f41', 'request_id': 'req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.193191 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] The token cache is being invalidate because project 61aa7ac3246d4c58bda615cdb4280ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:56.193491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.194290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.195868 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1006/2000] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:56 2022] DELETE /identity/v3/projects/61aa7ac3246d4c58bda615cdb4280ccc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:56.199919 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:56.200925 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1639b9d3f4cc47f98e48f58d05e01f41', 'request_id': 'req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.201646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:56.211956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1639b9d3f4cc47f98e48f58d05e01f41', 'request_id': 'req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.225204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] The token cache is being invalidate because project 1639b9d3f4cc47f98e48f58d05e01f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:56.225519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.226314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.228850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 995/2001] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:56 2022] DELETE /identity/v3/projects/1639b9d3f4cc47f98e48f58d05e01f41 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:56.236058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:56.238154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:56.314483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39b629-0cbb-40e8-a00e-5f43d219219a admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:56.358292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd54bc-5751-4ec3-9982-aefc9db0bf6f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:56.368485 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf7d6e-3f61-4959-b5fe-af7c078965cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:56.369148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7d6e-3f61-4959-b5fe-af7c078965cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:56.369429 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7d6e-3f61-4959-b5fe-af7c078965cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:56.369701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7d6e-3f61-4959-b5fe-af7c078965cc admin admin] PATH_INFO: `/v3/users/263e482224fd4ea6a0e3808cfb5edc84` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:56.371330 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf7d6e-3f61-4959-b5fe-af7c078965cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=263e482224fd4ea6a0e3808cfb5edc84)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:56.373308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf7d6e-3f61-4959-b5fe-af7c078965cc admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:56.388211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:56.413287 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f53d7a-5036-430b-ba29-1283d5773df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:56.414110 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f53d7a-5036-430b-ba29-1283d5773df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:56.414399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f53d7a-5036-430b-ba29-1283d5773df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:56.414848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f53d7a-5036-430b-ba29-1283d5773df6 admin admin] PATH_INFO: `/v3/users/3b4505f41cc64a6abcfb3fa73a112c7e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:56.419252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f53d7a-5036-430b-ba29-1283d5773df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4505f41cc64a6abcfb3fa73a112c7e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:56.421855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f53d7a-5036-430b-ba29-1283d5773df6 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:56.464892 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-70bf7d6e-3f61-4959-b5fe-af7c078965cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '263e482224fd4ea6a0e3808cfb5edc84'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.487256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-70bf7d6e-3f61-4959-b5fe-af7c078965cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '263e482224fd4ea6a0e3808cfb5edc84'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.492958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-32f53d7a-5036-430b-ba29-1283d5773df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4505f41cc64a6abcfb3fa73a112c7e'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.498064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-70bf7d6e-3f61-4959-b5fe-af7c078965cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '263e482224fd4ea6a0e3808cfb5edc84'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.509399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-32f53d7a-5036-430b-ba29-1283d5773df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4505f41cc64a6abcfb3fa73a112c7e'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.511132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-70bf7d6e-3f61-4959-b5fe-af7c078965cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '263e482224fd4ea6a0e3808cfb5edc84'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.511860 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:56.513071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-70bf7d6e-3f61-4959-b5fe-af7c078965cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '263e482224fd4ea6a0e3808cfb5edc84'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.523561 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 996/2002] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:56 2022] DELETE /identity/v3/users/263e482224fd4ea6a0e3808cfb5edc84 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:56.539305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-32f53d7a-5036-430b-ba29-1283d5773df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4505f41cc64a6abcfb3fa73a112c7e'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.552236 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-32f53d7a-5036-430b-ba29-1283d5773df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4505f41cc64a6abcfb3fa73a112c7e'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.564370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-32f53d7a-5036-430b-ba29-1283d5773df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4505f41cc64a6abcfb3fa73a112c7e'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:56.579557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1007/2003] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:56 2022] DELETE /identity/v3/users/3b4505f41cc64a6abcfb3fa73a112c7e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:57.129104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf7d6e-3f61-4959-b5fe-af7c078965cc admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:57.131721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-70bf7d6e-3f61-4959-b5fe-af7c078965cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:57.222201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf7d6e-3f61-4959-b5fe-af7c078965cc admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:57.285638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d2d06-a6d3-4278-b94e-04d3229b5d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:57.286337 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d2d06-a6d3-4278-b94e-04d3229b5d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:57.286618 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d2d06-a6d3-4278-b94e-04d3229b5d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:57.286894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d2d06-a6d3-4278-b94e-04d3229b5d9e admin admin] PATH_INFO: `/v3/projects/3b205f30ae9643ac8e681bd3f6cee0d6` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:57.288166 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d2d06-a6d3-4278-b94e-04d3229b5d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b205f30ae9643ac8e681bd3f6cee0d6)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:57.290299 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d2d06-a6d3-4278-b94e-04d3229b5d9e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:57.330931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f53d7a-5036-430b-ba29-1283d5773df6 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:57.332834 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-32f53d7a-5036-430b-ba29-1283d5773df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:57.347439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f53d7a-5036-430b-ba29-1283d5773df6 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:57.353664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd75a2-06ff-4e14-ab0f-93d49ac99527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:57.354540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd75a2-06ff-4e14-ab0f-93d49ac99527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:57.354818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd75a2-06ff-4e14-ab0f-93d49ac99527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:57.355088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd75a2-06ff-4e14-ab0f-93d49ac99527 admin admin] PATH_INFO: `/v3/projects/e6df11d2e41c4dd48670e7fb4dacf805` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:57.356438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd75a2-06ff-4e14-ab0f-93d49ac99527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6df11d2e41c4dd48670e7fb4dacf805)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:57.358635 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd75a2-06ff-4e14-ab0f-93d49ac99527 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:57.376089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:57.390540 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-224d2d06-a6d3-4278-b94e-04d3229b5d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b205f30ae9643ac8e681bd3f6cee0d6', 'request_id': 'req-224d2d06-a6d3-4278-b94e-04d3229b5d9e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:57.406257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-224d2d06-a6d3-4278-b94e-04d3229b5d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b205f30ae9643ac8e681bd3f6cee0d6', 'request_id': 'req-224d2d06-a6d3-4278-b94e-04d3229b5d9e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:57.414272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-224d2d06-a6d3-4278-b94e-04d3229b5d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b205f30ae9643ac8e681bd3f6cee0d6', 'request_id': 'req-224d2d06-a6d3-4278-b94e-04d3229b5d9e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:57.431581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-224d2d06-a6d3-4278-b94e-04d3229b5d9e admin admin] The token cache is being invalidate because project 3b205f30ae9643ac8e681bd3f6cee0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:57.431818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-85fd75a2-06ff-4e14-ab0f-93d49ac99527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6df11d2e41c4dd48670e7fb4dacf805', 'request_id': 'req-85fd75a2-06ff-4e14-ab0f-93d49ac99527'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:57.432095 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-224d2d06-a6d3-4278-b94e-04d3229b5d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:57.433240 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-224d2d06-a6d3-4278-b94e-04d3229b5d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:57.435750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 997/2004] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:57 2022] DELETE /identity/v3/projects/3b205f30ae9643ac8e681bd3f6cee0d6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:57.440941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08ab1-770a-4649-b9ed-5c141cf355eb None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:57.443296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08ab1-770a-4649-b9ed-5c141cf355eb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:57.443669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08ab1-770a-4649-b9ed-5c141cf355eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:57.453098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-85fd75a2-06ff-4e14-ab0f-93d49ac99527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6df11d2e41c4dd48670e7fb4dacf805', 'request_id': 'req-85fd75a2-06ff-4e14-ab0f-93d49ac99527'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:57.460595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-85fd75a2-06ff-4e14-ab0f-93d49ac99527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6df11d2e41c4dd48670e7fb4dacf805', 'request_id': 'req-85fd75a2-06ff-4e14-ab0f-93d49ac99527'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:57.474970 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-85fd75a2-06ff-4e14-ab0f-93d49ac99527 admin admin] The token cache is being invalidate because project e6df11d2e41c4dd48670e7fb4dacf805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:57.475311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-85fd75a2-06ff-4e14-ab0f-93d49ac99527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:57.475592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3ff08ab1-770a-4649-b9ed-5c141cf355eb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:57.475995 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-85fd75a2-06ff-4e14-ab0f-93d49ac99527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:57.477076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3ff08ab1-770a-4649-b9ed-5c141cf355eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:57.477900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1008/2005] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:57 2022] DELETE /identity/v3/projects/e6df11d2e41c4dd48670e7fb4dacf805 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:57.682167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 998/2006] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:57.687478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66475e7b-6576-4cc2-a217-e432708d09ce None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:57.687855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66475e7b-6576-4cc2-a217-e432708d09ce None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:57.688305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66475e7b-6576-4cc2-a217-e432708d09ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:57.766505 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-66475e7b-6576-4cc2-a217-e432708d09ce None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:57.768163 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-66475e7b-6576-4cc2-a217-e432708d09ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:57.798537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1009/2007] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:57.803675 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff08ab1-770a-4649-b9ed-5c141cf355eb None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:57.815822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff08ab1-770a-4649-b9ed-5c141cf355eb None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:57.835129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641684d-099f-44ab-a60f-0e06b58b5875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:57.835803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641684d-099f-44ab-a60f-0e06b58b5875 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:57.836088 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641684d-099f-44ab-a60f-0e06b58b5875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:57.836364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641684d-099f-44ab-a60f-0e06b58b5875 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:57.837036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641684d-099f-44ab-a60f-0e06b58b5875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:57.837341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641684d-099f-44ab-a60f-0e06b58b5875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:57.839014 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641684d-099f-44ab-a60f-0e06b58b5875 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:57.868462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 999/2008] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:57.873004 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66475e7b-6576-4cc2-a217-e432708d09ce None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:57.883394 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66475e7b-6576-4cc2-a217-e432708d09ce None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:57.888484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a5312-2d87-4dc8-a3b0-921f30335522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:57.889244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5312-2d87-4dc8-a3b0-921f30335522 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:57.889615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5312-2d87-4dc8-a3b0-921f30335522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:57.889978 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5312-2d87-4dc8-a3b0-921f30335522 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:57.890708 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a5312-2d87-4dc8-a3b0-921f30335522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:57.892999 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a5312-2d87-4dc8-a3b0-921f30335522 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:57.940888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1010/2009] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:57 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:57.946045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641684d-099f-44ab-a60f-0e06b58b5875 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:57.960377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641684d-099f-44ab-a60f-0e06b58b5875 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:58.067027 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44585452-2d7a-4900-b1b4-b066410c1082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:58.067712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585452-2d7a-4900-b1b4-b066410c1082 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:58.068013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585452-2d7a-4900-b1b4-b066410c1082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:58.068293 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585452-2d7a-4900-b1b4-b066410c1082 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:58.068942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44585452-2d7a-4900-b1b4-b066410c1082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:58.071334 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44585452-2d7a-4900-b1b4-b066410c1082 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:58.102687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1000/2010] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:57 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:58.106574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a5312-2d87-4dc8-a3b0-921f30335522 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:58.122166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a5312-2d87-4dc8-a3b0-921f30335522 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:58.131984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ef6e8-f2b1-4d61-9afb-ba212b0b2bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:58.133035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ef6e8-f2b1-4d61-9afb-ba212b0b2bab admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:58.133520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ef6e8-f2b1-4d61-9afb-ba212b0b2bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:58.134015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ef6e8-f2b1-4d61-9afb-ba212b0b2bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:58.135330 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ef6e8-f2b1-4d61-9afb-ba212b0b2bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:58.137545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ef6e8-f2b1-4d61-9afb-ba212b0b2bab admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:58.165437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1011/2011] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:58.170433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44585452-2d7a-4900-b1b4-b066410c1082 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:58.187760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44585452-2d7a-4900-b1b4-b066410c1082 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:58.195127 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd083b01-2841-4269-bb76-fffc80800c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:58.195831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083b01-2841-4269-bb76-fffc80800c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:58.196322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083b01-2841-4269-bb76-fffc80800c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:58.196681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083b01-2841-4269-bb76-fffc80800c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:58.197823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd083b01-2841-4269-bb76-fffc80800c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:58.200607 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd083b01-2841-4269-bb76-fffc80800c6f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:58.231251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1001/2012] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:58.235287 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ef6e8-f2b1-4d61-9afb-ba212b0b2bab admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:58.248923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ef6e8-f2b1-4d61-9afb-ba212b0b2bab admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:58.261076 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b13cd-2aa0-4987-ae71-cc30f6f30119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:58.261866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b13cd-2aa0-4987-ae71-cc30f6f30119 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:58.262218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b13cd-2aa0-4987-ae71-cc30f6f30119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:58.263096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b13cd-2aa0-4987-ae71-cc30f6f30119 admin admin] PATH_INFO: `/v3/projects/01bcaf16cc71465891c80371383fab11/users/ad284b6923e84d3c86202ea126ab1d21/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:58.281711 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b13cd-2aa0-4987-ae71-cc30f6f30119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bcaf16cc71465891c80371383fab11, user_id=ad284b6923e84d3c86202ea126ab1d21, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:58.285235 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b13cd-2aa0-4987-ae71-cc30f6f30119 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:58.302923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1012/2013] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:58 2022] PUT /identity/v3/projects/01bcaf16cc71465891c80371383fab11/users/ad284b6923e84d3c86202ea126ab1d21/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:58.308353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ea788-b560-4f66-a4a4-3d3e322f06fa None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:58.309216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ea788-b560-4f66-a4a4-3d3e322f06fa None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:58.309672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ea788-b560-4f66-a4a4-3d3e322f06fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:58.341867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-924ea788-b560-4f66-a4a4-3d3e322f06fa None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:58.344025 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-924ea788-b560-4f66-a4a4-3d3e322f06fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:58.380932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:58.445011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1002/2014] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:58.457691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b13cd-2aa0-4987-ae71-cc30f6f30119 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:58.460876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-1f0b13cd-2aa0-4987-ae71-cc30f6f30119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:58.563576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b13cd-2aa0-4987-ae71-cc30f6f30119 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:58.568904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dcee1-11e5-4601-bdce-67cd4bf4e623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:58.569692 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dcee1-11e5-4601-bdce-67cd4bf4e623 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:58.570146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dcee1-11e5-4601-bdce-67cd4bf4e623 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:58.570296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dcee1-11e5-4601-bdce-67cd4bf4e623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:58.587208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dcee1-11e5-4601-bdce-67cd4bf4e623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:58.588580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dcee1-11e5-4601-bdce-67cd4bf4e623 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:58.620000 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1013/2015] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:59.588730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981363c5-9f7c-4776-a5cb-c099250a691a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:59.589325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981363c5-9f7c-4776-a5cb-c099250a691a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:59.589325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981363c5-9f7c-4776-a5cb-c099250a691a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:59.646162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-981363c5-9f7c-4776-a5cb-c099250a691a None None] MFA Rules not processed for user `ad284b6923e84d3c86202ea126ab1d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:59.647667 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-981363c5-9f7c-4776-a5cb-c099250a691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:59.829202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1003/2016] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:21:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:59.830317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dcee1-11e5-4601-bdce-67cd4bf4e623 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:59.852172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dcee1-11e5-4601-bdce-67cd4bf4e623 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:59.874970 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5700e0-7988-41b3-ba0a-419d3ed710bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:59.875843 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5700e0-7988-41b3-ba0a-419d3ed710bc admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:59.876757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5700e0-7988-41b3-ba0a-419d3ed710bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:59.877335 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5700e0-7988-41b3-ba0a-419d3ed710bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:59.878269 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5700e0-7988-41b3-ba0a-419d3ed710bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:59.881393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5700e0-7988-41b3-ba0a-419d3ed710bc admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:59.888597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:59.927141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1014/2017] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:59 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:59.931365 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981363c5-9f7c-4776-a5cb-c099250a691a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:59.943270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981363c5-9f7c-4776-a5cb-c099250a691a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:00.003233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b009efa-9537-4706-80c0-710de6f19c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:00.003897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009efa-9537-4706-80c0-710de6f19c9f admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:00.004179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009efa-9537-4706-80c0-710de6f19c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:00.004446 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009efa-9537-4706-80c0-710de6f19c9f admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:00.005083 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b009efa-9537-4706-80c0-710de6f19c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:00.007178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b009efa-9537-4706-80c0-710de6f19c9f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:00.035124 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1004/2018] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:59 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:22:00.036613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5700e0-7988-41b3-ba0a-419d3ed710bc admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:00.049239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5700e0-7988-41b3-ba0a-419d3ed710bc admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:00.054008 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da319f-f1e4-4a22-8339-cf11fd638b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:00.054618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da319f-f1e4-4a22-8339-cf11fd638b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:00.054898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da319f-f1e4-4a22-8339-cf11fd638b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:00.055171 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da319f-f1e4-4a22-8339-cf11fd638b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:00.057030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da319f-f1e4-4a22-8339-cf11fd638b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:00.057673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da319f-f1e4-4a22-8339-cf11fd638b67 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:00.081238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1015/2019] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:00.085817 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b009efa-9537-4706-80c0-710de6f19c9f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:00.096859 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b009efa-9537-4706-80c0-710de6f19c9f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:00.108818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d9e66-7274-461b-9a51-5316c31a5a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:00.109958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d9e66-7274-461b-9a51-5316c31a5a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:00.110247 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d9e66-7274-461b-9a51-5316c31a5a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:00.110521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d9e66-7274-461b-9a51-5316c31a5a5c admin admin] PATH_INFO: `/v3/projects/6f0692f0f27d45f28810866a068748ca/users/1c67a91088db465c90d0bcda6d87f811/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:00.129478 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d9e66-7274-461b-9a51-5316c31a5a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0692f0f27d45f28810866a068748ca, user_id=1c67a91088db465c90d0bcda6d87f811, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:00.132204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d9e66-7274-461b-9a51-5316c31a5a5c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:00.155879 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1005/2020] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:00 2022] PUT /identity/v3/projects/6f0692f0f27d45f28810866a068748ca/users/1c67a91088db465c90d0bcda6d87f811/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:00.160122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da319f-f1e4-4a22-8339-cf11fd638b67 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:00.171259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da319f-f1e4-4a22-8339-cf11fd638b67 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:00.232273 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd15aa-9af8-414f-85f3-4134d0b6efba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:00.232962 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd15aa-9af8-414f-85f3-4134d0b6efba admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:00.233327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd15aa-9af8-414f-85f3-4134d0b6efba admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:00.233665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd15aa-9af8-414f-85f3-4134d0b6efba admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:00.234415 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd15aa-9af8-414f-85f3-4134d0b6efba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:00.236740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd15aa-9af8-414f-85f3-4134d0b6efba admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:00.251186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1016/2021] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:00.252767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d9e66-7274-461b-9a51-5316c31a5a5c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:00.265715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d9e66-7274-461b-9a51-5316c31a5a5c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:00.270612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88da21c-9724-484b-ac71-c6350d88c4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:00.271379 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88da21c-9724-484b-ac71-c6350d88c4bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:00.271745 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88da21c-9724-484b-ac71-c6350d88c4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:00.272092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88da21c-9724-484b-ac71-c6350d88c4bf admin admin] PATH_INFO: `/v3/projects/6f0692f0f27d45f28810866a068748ca/users/1c67a91088db465c90d0bcda6d87f811/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:00.274566 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88da21c-9724-484b-ac71-c6350d88c4bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0692f0f27d45f28810866a068748ca, user_id=1c67a91088db465c90d0bcda6d87f811, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:00.277460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88da21c-9724-484b-ac71-c6350d88c4bf admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:00.289492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1006/2022] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:00 2022] PUT /identity/v3/projects/6f0692f0f27d45f28810866a068748ca/users/1c67a91088db465c90d0bcda6d87f811/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:01.091548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5236fcd-d345-4e60-92b9-7998a48156b7 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:01.092076 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5236fcd-d345-4e60-92b9-7998a48156b7 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:01.092300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5236fcd-d345-4e60-92b9-7998a48156b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:01.138912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-d5236fcd-d345-4e60-92b9-7998a48156b7 None None] MFA Rules not processed for user `1c67a91088db465c90d0bcda6d87f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:01.140482 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d5236fcd-d345-4e60-92b9-7998a48156b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:01.237092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1017/2023] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:01.249091 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c3d80-9ad8-4f05-a38f-815b5dad863f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:01.249667 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c3d80-9ad8-4f05-a38f-815b5dad863f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:01.249667 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c3d80-9ad8-4f05-a38f-815b5dad863f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:01.271396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-df5c3d80-9ad8-4f05-a38f-815b5dad863f None None] MFA Rules not processed for user `ad284b6923e84d3c86202ea126ab1d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:01.272982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-df5c3d80-9ad8-4f05-a38f-815b5dad863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:01.279621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:01.367514 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1007/2024] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:01.378742 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5236fcd-d345-4e60-92b9-7998a48156b7 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:01.380632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d5236fcd-d345-4e60-92b9-7998a48156b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:01.441577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:01.462599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5236fcd-d345-4e60-92b9-7998a48156b7 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:01.468171 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2079a11-6cd3-450f-82bc-6b57feafaefa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:01.468911 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079a11-6cd3-450f-82bc-6b57feafaefa service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:01.469194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079a11-6cd3-450f-82bc-6b57feafaefa service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:01.469493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079a11-6cd3-450f-82bc-6b57feafaefa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:01.478922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2079a11-6cd3-450f-82bc-6b57feafaefa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:01.480569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2079a11-6cd3-450f-82bc-6b57feafaefa service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:01.489693 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1018/2025] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:08.048712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c3d80-9ad8-4f05-a38f-815b5dad863f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:08.050172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-df5c3d80-9ad8-4f05-a38f-815b5dad863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:08.157273 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c3d80-9ad8-4f05-a38f-815b5dad863f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:08.168855 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90ebce-3bae-4f16-9223-2731a912163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:08.169525 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90ebce-3bae-4f16-9223-2731a912163f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:08.169801 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90ebce-3bae-4f16-9223-2731a912163f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:08.170073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90ebce-3bae-4f16-9223-2731a912163f admin admin] PATH_INFO: `/v3/users/27016a2b993e4cd69c89f8f49b3c5a84` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:08.171532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90ebce-3bae-4f16-9223-2731a912163f admin admin] RBAC: Authorizing `identity:delete_user(user_id=27016a2b993e4cd69c89f8f49b3c5a84)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:08.173530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90ebce-3bae-4f16-9223-2731a912163f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:08.229124 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dc90ebce-3bae-4f16-9223-2731a912163f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27016a2b993e4cd69c89f8f49b3c5a84'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:08.241947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dc90ebce-3bae-4f16-9223-2731a912163f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27016a2b993e4cd69c89f8f49b3c5a84'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:08.249013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dc90ebce-3bae-4f16-9223-2731a912163f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27016a2b993e4cd69c89f8f49b3c5a84'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:08.257798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dc90ebce-3bae-4f16-9223-2731a912163f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27016a2b993e4cd69c89f8f49b3c5a84'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:08.258420 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dc90ebce-3bae-4f16-9223-2731a912163f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27016a2b993e4cd69c89f8f49b3c5a84'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:08.264472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1008/2026] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:08 2022] DELETE /identity/v3/users/27016a2b993e4cd69c89f8f49b3c5a84 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:08.444471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2079a11-6cd3-450f-82bc-6b57feafaefa service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:08.455172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2079a11-6cd3-450f-82bc-6b57feafaefa service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:08.533704 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c360414-e19d-4a1f-8bee-420553b02cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:08.534435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360414-e19d-4a1f-8bee-420553b02cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:08.534772 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360414-e19d-4a1f-8bee-420553b02cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:08.535107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360414-e19d-4a1f-8bee-420553b02cf9 admin admin] PATH_INFO: `/v3/projects/11f0a399ab21448799c78878e175336e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:08.536305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c360414-e19d-4a1f-8bee-420553b02cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f0a399ab21448799c78878e175336e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:08.538207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c360414-e19d-4a1f-8bee-420553b02cf9 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:08.587134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5c360414-e19d-4a1f-8bee-420553b02cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f0a399ab21448799c78878e175336e', 'request_id': 'req-5c360414-e19d-4a1f-8bee-420553b02cf9'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:08.596716 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5c360414-e19d-4a1f-8bee-420553b02cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f0a399ab21448799c78878e175336e', 'request_id': 'req-5c360414-e19d-4a1f-8bee-420553b02cf9'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:08.603123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5c360414-e19d-4a1f-8bee-420553b02cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f0a399ab21448799c78878e175336e', 'request_id': 'req-5c360414-e19d-4a1f-8bee-420553b02cf9'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:08.615385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5c360414-e19d-4a1f-8bee-420553b02cf9 admin admin] The token cache is being invalidate because project 11f0a399ab21448799c78878e175336e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:08.615675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5c360414-e19d-4a1f-8bee-420553b02cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:08.616370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5c360414-e19d-4a1f-8bee-420553b02cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:08.617947 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1019/2027] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:08 2022] DELETE /identity/v3/projects/11f0a399ab21448799c78878e175336e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:08.624300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6a9b4-8da0-44bf-b795-4b3e10d9cd87 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:08.624632 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6a9b4-8da0-44bf-b795-4b3e10d9cd87 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:08.624912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6a9b4-8da0-44bf-b795-4b3e10d9cd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:08.644575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-00f6a9b4-8da0-44bf-b795-4b3e10d9cd87 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:08.645758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-00f6a9b4-8da0-44bf-b795-4b3e10d9cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:08.677310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:08.709207 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1009/2028] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:08.717364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106f9cd-bfdb-4809-b08c-cf089149318e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:08.717645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106f9cd-bfdb-4809-b08c-cf089149318e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:08.717919 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106f9cd-bfdb-4809-b08c-cf089149318e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:08.739118 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-9106f9cd-bfdb-4809-b08c-cf089149318e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:08.740366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-9106f9cd-bfdb-4809-b08c-cf089149318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:08.749766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1020/2029] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:08.754452 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6a9b4-8da0-44bf-b795-4b3e10d9cd87 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:08.764196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6a9b4-8da0-44bf-b795-4b3e10d9cd87 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:08.769496 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283747d-db4f-4aaf-a73e-433bf0ebe0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:08.770158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283747d-db4f-4aaf-a73e-433bf0ebe0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:08.770529 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283747d-db4f-4aaf-a73e-433bf0ebe0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:08.770790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283747d-db4f-4aaf-a73e-433bf0ebe0a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:08.771775 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283747d-db4f-4aaf-a73e-433bf0ebe0a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:08.771918 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283747d-db4f-4aaf-a73e-433bf0ebe0a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:08.773683 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283747d-db4f-4aaf-a73e-433bf0ebe0a6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:08.786309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1010/2030] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:22:08.793280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106f9cd-bfdb-4809-b08c-cf089149318e None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:08.806164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106f9cd-bfdb-4809-b08c-cf089149318e None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:08.813163 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c316896-8a40-470f-a64d-01c1f592bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:08.813806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c316896-8a40-470f-a64d-01c1f592bb99 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:08.814100 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c316896-8a40-470f-a64d-01c1f592bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:08.814379 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c316896-8a40-470f-a64d-01c1f592bb99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:08.815043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c316896-8a40-470f-a64d-01c1f592bb99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:08.816954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c316896-8a40-470f-a64d-01c1f592bb99 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:08.845600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1021/2031] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:08 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:22:08.850102 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283747d-db4f-4aaf-a73e-433bf0ebe0a6 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:08.859879 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283747d-db4f-4aaf-a73e-433bf0ebe0a6 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:08.918411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139fdc-b231-4a65-b47e-affc231f3c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:08.919010 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139fdc-b231-4a65-b47e-affc231f3c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:08.919308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139fdc-b231-4a65-b47e-affc231f3c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:08.919574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139fdc-b231-4a65-b47e-affc231f3c50 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:08.920296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07139fdc-b231-4a65-b47e-affc231f3c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:08.922560 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07139fdc-b231-4a65-b47e-affc231f3c50 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:08.945392 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1011/2032] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:08 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:22:08.949604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c316896-8a40-470f-a64d-01c1f592bb99 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:08.960230 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c316896-8a40-470f-a64d-01c1f592bb99 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:08.965177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b033b-4e8c-4717-b29f-e30221631ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:08.965784 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b033b-4e8c-4717-b29f-e30221631ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:08.966060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b033b-4e8c-4717-b29f-e30221631ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:08.966330 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b033b-4e8c-4717-b29f-e30221631ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:08.966977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b033b-4e8c-4717-b29f-e30221631ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:08.968616 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b033b-4e8c-4717-b29f-e30221631ba2 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:08.978840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1022/2033] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:08.983210 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139fdc-b231-4a65-b47e-affc231f3c50 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:08.993956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139fdc-b231-4a65-b47e-affc231f3c50 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:08.999132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def93b4c-d83b-49bf-abac-f20a0dba8e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:08.999798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def93b4c-d83b-49bf-abac-f20a0dba8e78 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:09.000083 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def93b4c-d83b-49bf-abac-f20a0dba8e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:09.000357 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def93b4c-d83b-49bf-abac-f20a0dba8e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:09.001027 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def93b4c-d83b-49bf-abac-f20a0dba8e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:09.002714 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def93b4c-d83b-49bf-abac-f20a0dba8e78 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:09.013370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1012/2034] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:09.017722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b033b-4e8c-4717-b29f-e30221631ba2 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:09.028162 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b033b-4e8c-4717-b29f-e30221631ba2 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:09.033445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd210e-a1df-491d-a573-20c2c7abad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:09.034095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd210e-a1df-491d-a573-20c2c7abad3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:09.034372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd210e-a1df-491d-a573-20c2c7abad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:09.034646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd210e-a1df-491d-a573-20c2c7abad3e admin admin] PATH_INFO: `/v3/projects/ff45e5f225b44e938f3ea829aa6a8b7d/users/053652a1a65e488fb548063b2f2e0e70/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:09.050093 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd210e-a1df-491d-a573-20c2c7abad3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff45e5f225b44e938f3ea829aa6a8b7d, user_id=053652a1a65e488fb548063b2f2e0e70, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:09.052801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd210e-a1df-491d-a573-20c2c7abad3e admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:09.068121 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1023/2035] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:09 2022] PUT /identity/v3/projects/ff45e5f225b44e938f3ea829aa6a8b7d/users/053652a1a65e488fb548063b2f2e0e70/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:09.078959 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00879a-e972-4f84-b077-c5f268f2648d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:09.079485 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00879a-e972-4f84-b077-c5f268f2648d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:09.079578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00879a-e972-4f84-b077-c5f268f2648d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:09.109340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ae00879a-e972-4f84-b077-c5f268f2648d None None] MFA Rules not processed for user `053652a1a65e488fb548063b2f2e0e70`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:09.110536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ae00879a-e972-4f84-b077-c5f268f2648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:09.198235 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1013/2036] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:09.211462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd210e-a1df-491d-a573-20c2c7abad3e admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:09.213419 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7edd210e-a1df-491d-a573-20c2c7abad3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:09.224551 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:09.278108 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd210e-a1df-491d-a573-20c2c7abad3e admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:09.282463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c7c0d-74dd-462c-978c-6993b69ec05d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:09.283179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c7c0d-74dd-462c-978c-6993b69ec05d service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:09.283928 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c7c0d-74dd-462c-978c-6993b69ec05d service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:09.283928 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c7c0d-74dd-462c-978c-6993b69ec05d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:09.292690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c7c0d-74dd-462c-978c-6993b69ec05d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:09.294134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c7c0d-74dd-462c-978c-6993b69ec05d service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:09.303732 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1024/2037] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:09.323061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00879a-e972-4f84-b077-c5f268f2648d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:09.359364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:09.394252 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00879a-e972-4f84-b077-c5f268f2648d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:09.399385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc0a02-7d1e-4184-a893-0a4995b2d198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:09.400100 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc0a02-7d1e-4184-a893-0a4995b2d198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:09.400384 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc0a02-7d1e-4184-a893-0a4995b2d198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:09.400663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc0a02-7d1e-4184-a893-0a4995b2d198 admin admin] PATH_INFO: `/v3/users/053652a1a65e488fb548063b2f2e0e70` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:09.401817 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc0a02-7d1e-4184-a893-0a4995b2d198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=053652a1a65e488fb548063b2f2e0e70)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:09.403823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc0a02-7d1e-4184-a893-0a4995b2d198 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:09.453499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9abc0a02-7d1e-4184-a893-0a4995b2d198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '053652a1a65e488fb548063b2f2e0e70'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:09.466419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9abc0a02-7d1e-4184-a893-0a4995b2d198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '053652a1a65e488fb548063b2f2e0e70'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:09.473543 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9abc0a02-7d1e-4184-a893-0a4995b2d198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '053652a1a65e488fb548063b2f2e0e70'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:09.480637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9abc0a02-7d1e-4184-a893-0a4995b2d198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '053652a1a65e488fb548063b2f2e0e70'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:09.481487 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9abc0a02-7d1e-4184-a893-0a4995b2d198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '053652a1a65e488fb548063b2f2e0e70'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:09.489073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1014/2038] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:09 2022] DELETE /identity/v3/users/053652a1a65e488fb548063b2f2e0e70 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:09.493481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7038050-4ea9-45f2-bf00-88764b547917 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:09.493966 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7038050-4ea9-45f2-bf00-88764b547917 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:09.494058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7038050-4ea9-45f2-bf00-88764b547917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:09.513605 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-c7038050-4ea9-45f2-bf00-88764b547917 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:09.514820 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c7038050-4ea9-45f2-bf00-88764b547917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:09.575936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1025/2039] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:09.586206 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc0a02-7d1e-4184-a893-0a4995b2d198 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:09.588033 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9abc0a02-7d1e-4184-a893-0a4995b2d198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:09.647445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc0a02-7d1e-4184-a893-0a4995b2d198 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:09.651485 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d574bbb-27a9-4600-991b-cc58c323f431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:09.652218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d574bbb-27a9-4600-991b-cc58c323f431 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:09.652583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d574bbb-27a9-4600-991b-cc58c323f431 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:09.652864 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d574bbb-27a9-4600-991b-cc58c323f431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:09.664099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d574bbb-27a9-4600-991b-cc58c323f431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:09.666099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d574bbb-27a9-4600-991b-cc58c323f431 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:09.677636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1015/2040] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:09.966499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7038050-4ea9-45f2-bf00-88764b547917 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:09.968364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c7038050-4ea9-45f2-bf00-88764b547917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:09.980732 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7038050-4ea9-45f2-bf00-88764b547917 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:09.985366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf953d-df1b-49e8-92f0-e3f6f7284246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:09.986007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf953d-df1b-49e8-92f0-e3f6f7284246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:09.986195 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf953d-df1b-49e8-92f0-e3f6f7284246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:09.986488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf953d-df1b-49e8-92f0-e3f6f7284246 admin admin] PATH_INFO: `/v3/projects/ff45e5f225b44e938f3ea829aa6a8b7d` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:09.987628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf953d-df1b-49e8-92f0-e3f6f7284246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff45e5f225b44e938f3ea829aa6a8b7d)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:09.989632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf953d-df1b-49e8-92f0-e3f6f7284246 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:10.045157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-21cf953d-df1b-49e8-92f0-e3f6f7284246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff45e5f225b44e938f3ea829aa6a8b7d', 'request_id': 'req-21cf953d-df1b-49e8-92f0-e3f6f7284246'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:10.054721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-21cf953d-df1b-49e8-92f0-e3f6f7284246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff45e5f225b44e938f3ea829aa6a8b7d', 'request_id': 'req-21cf953d-df1b-49e8-92f0-e3f6f7284246'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:10.060557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-21cf953d-df1b-49e8-92f0-e3f6f7284246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff45e5f225b44e938f3ea829aa6a8b7d', 'request_id': 'req-21cf953d-df1b-49e8-92f0-e3f6f7284246'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:10.073974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-21cf953d-df1b-49e8-92f0-e3f6f7284246 admin admin] The token cache is being invalidate because project ff45e5f225b44e938f3ea829aa6a8b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:10.074265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-21cf953d-df1b-49e8-92f0-e3f6f7284246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:10.074922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-21cf953d-df1b-49e8-92f0-e3f6f7284246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:10.076459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1026/2041] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:09 2022] DELETE /identity/v3/projects/ff45e5f225b44e938f3ea829aa6a8b7d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:10.081494 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394557e-e830-45bf-a151-4738e98a2d52 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:10.081964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394557e-e830-45bf-a151-4738e98a2d52 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:10.082056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394557e-e830-45bf-a151-4738e98a2d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:10.101689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-6394557e-e830-45bf-a151-4738e98a2d52 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:10.102886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6394557e-e830-45bf-a151-4738e98a2d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:10.150510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:10.169662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1016/2042] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:10.173177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f042b-52ac-48cd-bca4-de3683bb2281 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:10.173511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f042b-52ac-48cd-bca4-de3683bb2281 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:10.173784 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f042b-52ac-48cd-bca4-de3683bb2281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:10.193642 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-374f042b-52ac-48cd-bca4-de3683bb2281 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:10.194830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-374f042b-52ac-48cd-bca4-de3683bb2281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:10.203510 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1027/2043] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:10.209583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394557e-e830-45bf-a151-4738e98a2d52 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:10.223720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394557e-e830-45bf-a151-4738e98a2d52 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:10.231052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af4074-e307-49b9-be4a-ff5eeaddc5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:10.231675 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af4074-e307-49b9-be4a-ff5eeaddc5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:10.231988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af4074-e307-49b9-be4a-ff5eeaddc5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:10.232260 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af4074-e307-49b9-be4a-ff5eeaddc5c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:10.232913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af4074-e307-49b9-be4a-ff5eeaddc5c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:10.233216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af4074-e307-49b9-be4a-ff5eeaddc5c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:10.234820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af4074-e307-49b9-be4a-ff5eeaddc5c3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:10.247350 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1017/2044] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:22:10.252148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f042b-52ac-48cd-bca4-de3683bb2281 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:10.262218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f042b-52ac-48cd-bca4-de3683bb2281 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:10.268241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e0460-bc41-465e-a605-d8b2093b1695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:10.268867 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e0460-bc41-465e-a605-d8b2093b1695 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:10.269085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e0460-bc41-465e-a605-d8b2093b1695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:10.269378 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e0460-bc41-465e-a605-d8b2093b1695 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:10.270009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e0460-bc41-465e-a605-d8b2093b1695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:10.272012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e0460-bc41-465e-a605-d8b2093b1695 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:10.306106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1028/2045] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:10 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:10.310433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af4074-e307-49b9-be4a-ff5eeaddc5c3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:10.321187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af4074-e307-49b9-be4a-ff5eeaddc5c3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:10.379245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad76f1-aacc-4ab6-a16e-1e601a3458c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:10.379892 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad76f1-aacc-4ab6-a16e-1e601a3458c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:10.380201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad76f1-aacc-4ab6-a16e-1e601a3458c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:10.380475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad76f1-aacc-4ab6-a16e-1e601a3458c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:10.381092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad76f1-aacc-4ab6-a16e-1e601a3458c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:10.383031 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad76f1-aacc-4ab6-a16e-1e601a3458c1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:10.411672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1018/2046] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:10 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:10.413105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e0460-bc41-465e-a605-d8b2093b1695 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:10.419991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:10.425199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e0460-bc41-465e-a605-d8b2093b1695 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:10.431483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b34190-515e-4a82-9e12-c33812967180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:10.432263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b34190-515e-4a82-9e12-c33812967180 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:10.432701 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b34190-515e-4a82-9e12-c33812967180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:10.433029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b34190-515e-4a82-9e12-c33812967180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:10.433891 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b34190-515e-4a82-9e12-c33812967180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:10.435517 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b34190-515e-4a82-9e12-c33812967180 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:10.446196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1029/2047] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:22:10.450303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad76f1-aacc-4ab6-a16e-1e601a3458c1 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:10.460528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad76f1-aacc-4ab6-a16e-1e601a3458c1 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:10.465648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6bb1c-215a-40b1-80b0-11e223dd1107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:10.466263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6bb1c-215a-40b1-80b0-11e223dd1107 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:10.466542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6bb1c-215a-40b1-80b0-11e223dd1107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:10.466820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6bb1c-215a-40b1-80b0-11e223dd1107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:10.467470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6bb1c-215a-40b1-80b0-11e223dd1107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:10.469123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6bb1c-215a-40b1-80b0-11e223dd1107 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:10.480302 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1019/2048] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:22:10.484756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b34190-515e-4a82-9e12-c33812967180 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:10.496471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b34190-515e-4a82-9e12-c33812967180 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:10.502183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c298c5-fa1b-42f0-bbf1-f5e48acc5b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:10.502459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c298c5-fa1b-42f0-bbf1-f5e48acc5b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:10.502739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c298c5-fa1b-42f0-bbf1-f5e48acc5b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:10.503016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c298c5-fa1b-42f0-bbf1-f5e48acc5b85 admin admin] PATH_INFO: `/v3/projects/ca031424dd8b4d90a47ab3625a442022/users/b3f21dd192664135a4db4f6e6486a886/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:10.524223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c298c5-fa1b-42f0-bbf1-f5e48acc5b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca031424dd8b4d90a47ab3625a442022, user_id=b3f21dd192664135a4db4f6e6486a886, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:10.527077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c298c5-fa1b-42f0-bbf1-f5e48acc5b85 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:10.543054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1030/2049] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:10 2022] PUT /identity/v3/projects/ca031424dd8b4d90a47ab3625a442022/users/b3f21dd192664135a4db4f6e6486a886/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:10.554677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf81db-b766-4dc6-8cb6-3b3bce41c258 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:10.554961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf81db-b766-4dc6-8cb6-3b3bce41c258 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:10.555234 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf81db-b766-4dc6-8cb6-3b3bce41c258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:10.587481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b2bf81db-b766-4dc6-8cb6-3b3bce41c258 None None] MFA Rules not processed for user `b3f21dd192664135a4db4f6e6486a886`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:10.589088 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b2bf81db-b766-4dc6-8cb6-3b3bce41c258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:10.667884 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1020/2050] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:10.669029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c298c5-fa1b-42f0-bbf1-f5e48acc5b85 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:10.749644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c298c5-fa1b-42f0-bbf1-f5e48acc5b85 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:10.755610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40f8b4-d63e-4ac8-af84-80ec33e587b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:10.758331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40f8b4-d63e-4ac8-af84-80ec33e587b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:10.758685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40f8b4-d63e-4ac8-af84-80ec33e587b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:10.759025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40f8b4-d63e-4ac8-af84-80ec33e587b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:10.759777 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40f8b4-d63e-4ac8-af84-80ec33e587b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:10.761996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40f8b4-d63e-4ac8-af84-80ec33e587b5 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:10.801951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1031/2051] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:10 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:10.803176 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf81db-b766-4dc6-8cb6-3b3bce41c258 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:10.814875 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf81db-b766-4dc6-8cb6-3b3bce41c258 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:10.859516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:10.872681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccdcb0-29d8-4818-b922-1190b95cde9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:10.873366 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccdcb0-29d8-4818-b922-1190b95cde9a admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:10.873718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccdcb0-29d8-4818-b922-1190b95cde9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:10.874003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccdcb0-29d8-4818-b922-1190b95cde9a admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:10.874661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccdcb0-29d8-4818-b922-1190b95cde9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:10.876711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccdcb0-29d8-4818-b922-1190b95cde9a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:10.898825 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1021/2052] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:10 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:22:10.903040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40f8b4-d63e-4ac8-af84-80ec33e587b5 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:10.914481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40f8b4-d63e-4ac8-af84-80ec33e587b5 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:10.919519 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc501edc-0150-4096-8bbf-45b0fd67ae54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:10.920096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501edc-0150-4096-8bbf-45b0fd67ae54 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:10.920377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501edc-0150-4096-8bbf-45b0fd67ae54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:10.920963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501edc-0150-4096-8bbf-45b0fd67ae54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:10.921609 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc501edc-0150-4096-8bbf-45b0fd67ae54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:10.923246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc501edc-0150-4096-8bbf-45b0fd67ae54 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:10.934148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1032/2053] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:10.938483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccdcb0-29d8-4818-b922-1190b95cde9a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:10.948788 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccdcb0-29d8-4818-b922-1190b95cde9a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:10.953690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb8929-bff4-4fb6-ad3f-4c09a858238e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:10.954298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8929-bff4-4fb6-ad3f-4c09a858238e admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:10.954594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8929-bff4-4fb6-ad3f-4c09a858238e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:10.954848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8929-bff4-4fb6-ad3f-4c09a858238e admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:10.955551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb8929-bff4-4fb6-ad3f-4c09a858238e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:10.957180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb8929-bff4-4fb6-ad3f-4c09a858238e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:10.966935 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1022/2054] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:22:10.971478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc501edc-0150-4096-8bbf-45b0fd67ae54 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:10.981469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc501edc-0150-4096-8bbf-45b0fd67ae54 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:10.986219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003fb25f-9c10-4ead-b80b-de6d4b685bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:10.986856 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fb25f-9c10-4ead-b80b-de6d4b685bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:10.987135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fb25f-9c10-4ead-b80b-de6d4b685bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:10.987408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fb25f-9c10-4ead-b80b-de6d4b685bbe admin admin] PATH_INFO: `/v3/projects/085fb42e372948f1beb9e4210752f32f/users/415cab2431274f48919e05e4943bc5b4/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:11.004466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003fb25f-9c10-4ead-b80b-de6d4b685bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=085fb42e372948f1beb9e4210752f32f, user_id=415cab2431274f48919e05e4943bc5b4, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:11.007151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003fb25f-9c10-4ead-b80b-de6d4b685bbe admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:11.023632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1033/2055] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:10 2022] PUT /identity/v3/projects/085fb42e372948f1beb9e4210752f32f/users/415cab2431274f48919e05e4943bc5b4/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:11.035606 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7a21e-bdaa-4763-b0f9-e835bd529082 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:11.036407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7a21e-bdaa-4763-b0f9-e835bd529082 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:11.036407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7a21e-bdaa-4763-b0f9-e835bd529082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:11.066262 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9fb7a21e-bdaa-4763-b0f9-e835bd529082 None None] MFA Rules not processed for user `415cab2431274f48919e05e4943bc5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:11.067545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9fb7a21e-bdaa-4763-b0f9-e835bd529082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:11.147852 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1023/2056] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:11.150067 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003fb25f-9c10-4ead-b80b-de6d4b685bbe admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:11.230795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003fb25f-9c10-4ead-b80b-de6d4b685bbe admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:11.236825 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742df5-057a-424f-92f9-581f259e4ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:11.237563 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742df5-057a-424f-92f9-581f259e4ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:11.237948 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742df5-057a-424f-92f9-581f259e4ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:11.238226 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742df5-057a-424f-92f9-581f259e4ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:11.238876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742df5-057a-424f-92f9-581f259e4ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:11.241255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742df5-057a-424f-92f9-581f259e4ec1 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:11.277012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1034/2057] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:11 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:11.281182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7a21e-bdaa-4763-b0f9-e835bd529082 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:11.294008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7a21e-bdaa-4763-b0f9-e835bd529082 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:11.354321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ca6bc-f452-42a0-97dc-b4bb8b7a7b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:11.354750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ca6bc-f452-42a0-97dc-b4bb8b7a7b48 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:11.355024 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ca6bc-f452-42a0-97dc-b4bb8b7a7b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:11.355320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ca6bc-f452-42a0-97dc-b4bb8b7a7b48 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:11.356045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ca6bc-f452-42a0-97dc-b4bb8b7a7b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:11.358038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ca6bc-f452-42a0-97dc-b4bb8b7a7b48 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:11.385176 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1024/2058] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:11 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:11.386552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742df5-057a-424f-92f9-581f259e4ec1 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:11.395759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:11.400152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742df5-057a-424f-92f9-581f259e4ec1 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:11.405875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44ca54-de9b-4f95-a181-248d6a8831a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:11.406486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44ca54-de9b-4f95-a181-248d6a8831a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:11.406763 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44ca54-de9b-4f95-a181-248d6a8831a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:11.407029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44ca54-de9b-4f95-a181-248d6a8831a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:11.407676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44ca54-de9b-4f95-a181-248d6a8831a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:11.409445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44ca54-de9b-4f95-a181-248d6a8831a9 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:11.420793 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1035/2059] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:11.425167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ca6bc-f452-42a0-97dc-b4bb8b7a7b48 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:11.436222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ca6bc-f452-42a0-97dc-b4bb8b7a7b48 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:11.441246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4c855-c81e-40e2-8eeb-96e50d63103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:11.441950 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4c855-c81e-40e2-8eeb-96e50d63103e admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:11.442233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4c855-c81e-40e2-8eeb-96e50d63103e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:11.442507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4c855-c81e-40e2-8eeb-96e50d63103e admin admin] PATH_INFO: `/v3/projects/6dd1401d327b40c68d51d6c6224076d6/users/d3b6f53672144d9ab99e58213d749d31/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:11.458848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4c855-c81e-40e2-8eeb-96e50d63103e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd1401d327b40c68d51d6c6224076d6, user_id=d3b6f53672144d9ab99e58213d749d31, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:11.461552 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4c855-c81e-40e2-8eeb-96e50d63103e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:11.477674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1025/2060] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:11 2022] PUT /identity/v3/projects/6dd1401d327b40c68d51d6c6224076d6/users/d3b6f53672144d9ab99e58213d749d31/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:11.481666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44ca54-de9b-4f95-a181-248d6a8831a9 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:11.492448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44ca54-de9b-4f95-a181-248d6a8831a9 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:11.554320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247561fd-880e-45eb-bab2-bfd4da99e39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:11.554989 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247561fd-880e-45eb-bab2-bfd4da99e39a admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:11.555173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247561fd-880e-45eb-bab2-bfd4da99e39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:11.555445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247561fd-880e-45eb-bab2-bfd4da99e39a admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:11.556173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247561fd-880e-45eb-bab2-bfd4da99e39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:11.558767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247561fd-880e-45eb-bab2-bfd4da99e39a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:11.574690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1036/2061] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:11.578547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4c855-c81e-40e2-8eeb-96e50d63103e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:11.591968 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4c855-c81e-40e2-8eeb-96e50d63103e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:11.598511 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a71dea-8bdd-419e-affc-d17364b9dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:11.599330 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a71dea-8bdd-419e-affc-d17364b9dd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:11.600106 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a71dea-8bdd-419e-affc-d17364b9dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:11.600486 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a71dea-8bdd-419e-affc-d17364b9dd3f admin admin] PATH_INFO: `/v3/projects/6dd1401d327b40c68d51d6c6224076d6/users/d3b6f53672144d9ab99e58213d749d31/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:11.602623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a71dea-8bdd-419e-affc-d17364b9dd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd1401d327b40c68d51d6c6224076d6, user_id=d3b6f53672144d9ab99e58213d749d31, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:11.606266 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a71dea-8bdd-419e-affc-d17364b9dd3f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:11.627624 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1026/2062] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:11 2022] PUT /identity/v3/projects/6dd1401d327b40c68d51d6c6224076d6/users/d3b6f53672144d9ab99e58213d749d31/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:11.639388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e31fe3-7fc3-434e-aa2b-f9c77041de9a None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:11.639681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e31fe3-7fc3-434e-aa2b-f9c77041de9a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:11.640036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e31fe3-7fc3-434e-aa2b-f9c77041de9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:11.671480 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-35e31fe3-7fc3-434e-aa2b-f9c77041de9a None None] MFA Rules not processed for user `d3b6f53672144d9ab99e58213d749d31`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:11.673007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-35e31fe3-7fc3-434e-aa2b-f9c77041de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:11.756763 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1037/2063] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:11.768323 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a71dea-8bdd-419e-affc-d17364b9dd3f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:11.770111 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-56a71dea-8bdd-419e-affc-d17364b9dd3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:11.781525 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:11.838442 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a71dea-8bdd-419e-affc-d17364b9dd3f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:11.842403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189cb48-7fca-4b8c-bb67-39d547932ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:11.843046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189cb48-7fca-4b8c-bb67-39d547932ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:11.843327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189cb48-7fca-4b8c-bb67-39d547932ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:11.843613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189cb48-7fca-4b8c-bb67-39d547932ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:11.900223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189cb48-7fca-4b8c-bb67-39d547932ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:11.901657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189cb48-7fca-4b8c-bb67-39d547932ca4 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:11.910840 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1027/2064] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:13.486331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e31fe3-7fc3-434e-aa2b-f9c77041de9a None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:13.487936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-35e31fe3-7fc3-434e-aa2b-f9c77041de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:13.501045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e31fe3-7fc3-434e-aa2b-f9c77041de9a None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:13.505549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f0d2b-8a24-4d65-8b3c-a93e60ecabb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:13.506155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f0d2b-8a24-4d65-8b3c-a93e60ecabb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:13.506439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f0d2b-8a24-4d65-8b3c-a93e60ecabb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:13.506699 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f0d2b-8a24-4d65-8b3c-a93e60ecabb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:13.571498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f0d2b-8a24-4d65-8b3c-a93e60ecabb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:13.573004 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f0d2b-8a24-4d65-8b3c-a93e60ecabb0 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:13.583116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1038/2065] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:14.159211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189cb48-7fca-4b8c-bb67-39d547932ca4 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:14.174678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189cb48-7fca-4b8c-bb67-39d547932ca4 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:14.178785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41039f-47b5-440b-a7b0-af5afa72a5f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:14.179506 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41039f-47b5-440b-a7b0-af5afa72a5f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:14.179838 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41039f-47b5-440b-a7b0-af5afa72a5f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:14.180149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41039f-47b5-440b-a7b0-af5afa72a5f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:14.195783 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41039f-47b5-440b-a7b0-af5afa72a5f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:14.197398 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41039f-47b5-440b-a7b0-af5afa72a5f8 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:14.207737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1028/2066] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:17.626033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ffb6-658c-4134-8c74-f56327abf7e9 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:17.626543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ffb6-658c-4134-8c74-f56327abf7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:17.626543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ffb6-658c-4134-8c74-f56327abf7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:17.648753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-3173ffb6-658c-4134-8c74-f56327abf7e9 None None] MFA Rules not processed for user `acfc8a880e7a4e2b97babe7e6b092aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:17.649990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3173ffb6-658c-4134-8c74-f56327abf7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:17.659290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:17.708078 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1039/2067] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:18.188335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41039f-47b5-440b-a7b0-af5afa72a5f8 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:18.234931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173ffb6-658c-4134-8c74-f56327abf7e9 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:18.246203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173ffb6-658c-4134-8c74-f56327abf7e9 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:18.252712 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70351738-75bb-48ed-923c-bc56138607d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:18.255058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70351738-75bb-48ed-923c-bc56138607d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:18.255637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70351738-75bb-48ed-923c-bc56138607d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:18.256101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70351738-75bb-48ed-923c-bc56138607d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:18.259613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-70351738-75bb-48ed-923c-bc56138607d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:18.316407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41039f-47b5-440b-a7b0-af5afa72a5f8 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:18.322145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989f800-88e2-488b-8d8f-8c16cbbbd5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:18.322794 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989f800-88e2-488b-8d8f-8c16cbbbd5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:18.324030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989f800-88e2-488b-8d8f-8c16cbbbd5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:18.324330 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989f800-88e2-488b-8d8f-8c16cbbbd5e3 admin admin] PATH_INFO: `/v3/users/b3f21dd192664135a4db4f6e6486a886` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:18.325737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989f800-88e2-488b-8d8f-8c16cbbbd5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f21dd192664135a4db4f6e6486a886)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:18.327733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989f800-88e2-488b-8d8f-8c16cbbbd5e3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:18.362668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70351738-75bb-48ed-923c-bc56138607d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:18.364254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70351738-75bb-48ed-923c-bc56138607d9 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:18.375799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1040/2068] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:18.410353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3989f800-88e2-488b-8d8f-8c16cbbbd5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f21dd192664135a4db4f6e6486a886'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.418572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:18.431807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3989f800-88e2-488b-8d8f-8c16cbbbd5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f21dd192664135a4db4f6e6486a886'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.455253 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3989f800-88e2-488b-8d8f-8c16cbbbd5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f21dd192664135a4db4f6e6486a886'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.485654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3989f800-88e2-488b-8d8f-8c16cbbbd5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f21dd192664135a4db4f6e6486a886'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.486353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3989f800-88e2-488b-8d8f-8c16cbbbd5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f21dd192664135a4db4f6e6486a886'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.494823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1029/2069] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:18 2022] DELETE /identity/v3/users/b3f21dd192664135a4db4f6e6486a886 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:18.499401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9125f-3a43-4bc7-8372-e48c92706f63 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:18.499688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9125f-3a43-4bc7-8372-e48c92706f63 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:18.500023 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9125f-3a43-4bc7-8372-e48c92706f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:18.525430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7bd9125f-3a43-4bc7-8372-e48c92706f63 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:18.526924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7bd9125f-3a43-4bc7-8372-e48c92706f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:18.623545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1041/2070] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:18.634369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989f800-88e2-488b-8d8f-8c16cbbbd5e3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:18.636171 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3989f800-88e2-488b-8d8f-8c16cbbbd5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:18.705337 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989f800-88e2-488b-8d8f-8c16cbbbd5e3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:18.709200 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78e65e-312e-4e8c-9496-554ec2775be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:18.709810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78e65e-312e-4e8c-9496-554ec2775be6 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:18.710091 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78e65e-312e-4e8c-9496-554ec2775be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:18.710362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78e65e-312e-4e8c-9496-554ec2775be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:18.719722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78e65e-312e-4e8c-9496-554ec2775be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:18.721169 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78e65e-312e-4e8c-9496-554ec2775be6 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:18.731449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1030/2071] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:19.022234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9125f-3a43-4bc7-8372-e48c92706f63 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:19.023833 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7bd9125f-3a43-4bc7-8372-e48c92706f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:19.036421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9125f-3a43-4bc7-8372-e48c92706f63 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:19.042250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:19.042913 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:19.043316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:19.043596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] PATH_INFO: `/v3/projects/ca031424dd8b4d90a47ab3625a442022` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:19.045021 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca031424dd8b4d90a47ab3625a442022)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:19.047967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:19.109255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:19.117110 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca031424dd8b4d90a47ab3625a442022', 'request_id': 'req-9efcf9f4-39b2-4d2f-8e49-117cda00784a'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.126405 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca031424dd8b4d90a47ab3625a442022', 'request_id': 'req-9efcf9f4-39b2-4d2f-8e49-117cda00784a'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.134332 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca031424dd8b4d90a47ab3625a442022', 'request_id': 'req-9efcf9f4-39b2-4d2f-8e49-117cda00784a'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.147230 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] The token cache is being invalidate because project ca031424dd8b4d90a47ab3625a442022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:19.147554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.148289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.150064 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1042/2072] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:19 2022] DELETE /identity/v3/projects/ca031424dd8b4d90a47ab3625a442022 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:19.154209 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78e65e-312e-4e8c-9496-554ec2775be6 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:19.165151 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78e65e-312e-4e8c-9496-554ec2775be6 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:19.243754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b5d2e-634f-4423-80ab-85527b7ea839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:19.244661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b5d2e-634f-4423-80ab-85527b7ea839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:19.245442 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b5d2e-634f-4423-80ab-85527b7ea839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:19.245892 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b5d2e-634f-4423-80ab-85527b7ea839 admin admin] PATH_INFO: `/v3/users/415cab2431274f48919e05e4943bc5b4` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:19.247570 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b5d2e-634f-4423-80ab-85527b7ea839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=415cab2431274f48919e05e4943bc5b4)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:19.250558 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b5d2e-634f-4423-80ab-85527b7ea839 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:19.306825 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-379b5d2e-634f-4423-80ab-85527b7ea839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415cab2431274f48919e05e4943bc5b4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.320017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-379b5d2e-634f-4423-80ab-85527b7ea839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415cab2431274f48919e05e4943bc5b4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.327198 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-379b5d2e-634f-4423-80ab-85527b7ea839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415cab2431274f48919e05e4943bc5b4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.328982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:19.336344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-379b5d2e-634f-4423-80ab-85527b7ea839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415cab2431274f48919e05e4943bc5b4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.337000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-379b5d2e-634f-4423-80ab-85527b7ea839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415cab2431274f48919e05e4943bc5b4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.344626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1031/2073] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:19 2022] DELETE /identity/v3/users/415cab2431274f48919e05e4943bc5b4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:19.675407 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:19.677164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:19.697457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcf9f4-39b2-4d2f-8e49-117cda00784a admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:19.766436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:19.767546 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:19.768150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:19.768654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] PATH_INFO: `/v3/projects/085fb42e372948f1beb9e4210752f32f` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:19.770667 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=085fb42e372948f1beb9e4210752f32f)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:19.774601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:19.833910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085fb42e372948f1beb9e4210752f32f', 'request_id': 'req-65c71e05-618a-4085-8751-3051ce889768'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.842795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085fb42e372948f1beb9e4210752f32f', 'request_id': 'req-65c71e05-618a-4085-8751-3051ce889768'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.848490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085fb42e372948f1beb9e4210752f32f', 'request_id': 'req-65c71e05-618a-4085-8751-3051ce889768'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.859295 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] The token cache is being invalidate because project 085fb42e372948f1beb9e4210752f32f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:19.859582 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.860279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:19.861841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1043/2074] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:19 2022] DELETE /identity/v3/projects/085fb42e372948f1beb9e4210752f32f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:19.865968 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b5d2e-634f-4423-80ab-85527b7ea839 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:19.867538 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-379b5d2e-634f-4423-80ab-85527b7ea839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:19.880951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b5d2e-634f-4423-80ab-85527b7ea839 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:19.952314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e10f4b-232c-48e6-be8c-15954429c59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:19.952858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e10f4b-232c-48e6-be8c-15954429c59c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:19.953132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e10f4b-232c-48e6-be8c-15954429c59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:19.953402 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e10f4b-232c-48e6-be8c-15954429c59c admin admin] PATH_INFO: `/v3/users/d3b6f53672144d9ab99e58213d749d31` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:19.954658 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e10f4b-232c-48e6-be8c-15954429c59c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b6f53672144d9ab99e58213d749d31)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:19.956754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e10f4b-232c-48e6-be8c-15954429c59c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.007833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d9e10f4b-232c-48e6-be8c-15954429c59c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b6f53672144d9ab99e58213d749d31'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:20.019940 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d9e10f4b-232c-48e6-be8c-15954429c59c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b6f53672144d9ab99e58213d749d31'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:20.026853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d9e10f4b-232c-48e6-be8c-15954429c59c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b6f53672144d9ab99e58213d749d31'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:20.035218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d9e10f4b-232c-48e6-be8c-15954429c59c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b6f53672144d9ab99e58213d749d31'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:20.035878 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d9e10f4b-232c-48e6-be8c-15954429c59c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b6f53672144d9ab99e58213d749d31'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:20.041775 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1032/2075] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:19 2022] DELETE /identity/v3/users/d3b6f53672144d9ab99e58213d749d31 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:20.322814 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:20.324403 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:20.340135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c71e05-618a-4085-8751-3051ce889768 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:20.400017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:20.400649 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.400929 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.401200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf admin admin] PATH_INFO: `/v3/projects/6dd1401d327b40c68d51d6c6224076d6` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.402369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd1401d327b40c68d51d6c6224076d6)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:20.404362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.412316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:20.452365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd1401d327b40c68d51d6c6224076d6', 'request_id': 'req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:20.462246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd1401d327b40c68d51d6c6224076d6', 'request_id': 'req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:20.469022 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd1401d327b40c68d51d6c6224076d6', 'request_id': 'req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:20.481192 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf admin admin] The token cache is being invalidate because project 6dd1401d327b40c68d51d6c6224076d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:20.481545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:20.482511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-72e36efe-beb5-4ebc-b217-70a15ec5aeaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:20.484593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1044/2076] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:20 2022] DELETE /identity/v3/projects/6dd1401d327b40c68d51d6c6224076d6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:20.489343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eab93-e26d-494e-b271-d7be0945e8fe None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.489830 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eab93-e26d-494e-b271-d7be0945e8fe None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.489923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eab93-e26d-494e-b271-d7be0945e8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.511713 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-964eab93-e26d-494e-b271-d7be0945e8fe None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:20.512922 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-964eab93-e26d-494e-b271-d7be0945e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:20.583159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1033/2077] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:20.591150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce98e3-a141-4d63-8b73-3d9c1d60062c None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.592036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce98e3-a141-4d63-8b73-3d9c1d60062c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.592036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce98e3-a141-4d63-8b73-3d9c1d60062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.613858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-10ce98e3-a141-4d63-8b73-3d9c1d60062c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:20.615072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-10ce98e3-a141-4d63-8b73-3d9c1d60062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:20.623131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1045/2078] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:20.627592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964eab93-e26d-494e-b271-d7be0945e8fe None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:20.637299 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964eab93-e26d-494e-b271-d7be0945e8fe None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:20.641845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4e33c-941a-41f2-a15d-0a7d91ac9edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:20.642449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4e33c-941a-41f2-a15d-0a7d91ac9edf admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.642733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4e33c-941a-41f2-a15d-0a7d91ac9edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.643008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4e33c-941a-41f2-a15d-0a7d91ac9edf admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.643744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4e33c-941a-41f2-a15d-0a7d91ac9edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:20.644051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4e33c-941a-41f2-a15d-0a7d91ac9edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:20.645699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4e33c-941a-41f2-a15d-0a7d91ac9edf admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.652399 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:20.657522 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1034/2079] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:22:20.661672 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce98e3-a141-4d63-8b73-3d9c1d60062c None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:20.671189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce98e3-a141-4d63-8b73-3d9c1d60062c None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:20.675899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163df935-29b7-4579-9b31-8bd60e1dbcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:20.676522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163df935-29b7-4579-9b31-8bd60e1dbcb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.676801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163df935-29b7-4579-9b31-8bd60e1dbcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.677075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163df935-29b7-4579-9b31-8bd60e1dbcb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.677714 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163df935-29b7-4579-9b31-8bd60e1dbcb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:20.679663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163df935-29b7-4579-9b31-8bd60e1dbcb9 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.712159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1046/2080] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:20 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:20.716638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4e33c-941a-41f2-a15d-0a7d91ac9edf admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:20.727398 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4e33c-941a-41f2-a15d-0a7d91ac9edf admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:20.791528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d1c9b-d783-4c58-83fb-3eaf34b08477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:20.792174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d1c9b-d783-4c58-83fb-3eaf34b08477 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.792449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d1c9b-d783-4c58-83fb-3eaf34b08477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.792721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d1c9b-d783-4c58-83fb-3eaf34b08477 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.793345 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d1c9b-d783-4c58-83fb-3eaf34b08477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:20.795572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d1c9b-d783-4c58-83fb-3eaf34b08477 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.818726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1035/2081] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:20 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:20.823016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163df935-29b7-4579-9b31-8bd60e1dbcb9 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:20.834904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163df935-29b7-4579-9b31-8bd60e1dbcb9 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:20.841707 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d12f7-4da7-48ff-bd29-1517a4ec78b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:20.842327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d12f7-4da7-48ff-bd29-1517a4ec78b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.842613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d12f7-4da7-48ff-bd29-1517a4ec78b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.842868 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d12f7-4da7-48ff-bd29-1517a4ec78b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.843502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d12f7-4da7-48ff-bd29-1517a4ec78b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:20.845137 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d12f7-4da7-48ff-bd29-1517a4ec78b5 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.856830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1047/2082] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:20.861015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d1c9b-d783-4c58-83fb-3eaf34b08477 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:20.871000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d1c9b-d783-4c58-83fb-3eaf34b08477 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:20.875828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e77a4-e515-45dc-88cb-465fc5193efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:20.876453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e77a4-e515-45dc-88cb-465fc5193efd admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.876731 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e77a4-e515-45dc-88cb-465fc5193efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.877002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e77a4-e515-45dc-88cb-465fc5193efd admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.877705 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e77a4-e515-45dc-88cb-465fc5193efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:20.879308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e77a4-e515-45dc-88cb-465fc5193efd admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.890434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1036/2083] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:20.894593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d12f7-4da7-48ff-bd29-1517a4ec78b5 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:20.904909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d12f7-4da7-48ff-bd29-1517a4ec78b5 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:20.910310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595512f-04d4-43e3-87dc-8f88bf3c1d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:20.910975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595512f-04d4-43e3-87dc-8f88bf3c1d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.911294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595512f-04d4-43e3-87dc-8f88bf3c1d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.911575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595512f-04d4-43e3-87dc-8f88bf3c1d1b admin admin] PATH_INFO: `/v3/projects/06c75439259e4891a5148e70e61b8b1a/users/b7809187abdb4781b3266250f7a7f79e/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.926560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595512f-04d4-43e3-87dc-8f88bf3c1d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c75439259e4891a5148e70e61b8b1a, user_id=b7809187abdb4781b3266250f7a7f79e, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:20.929286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595512f-04d4-43e3-87dc-8f88bf3c1d1b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.943730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1048/2084] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:20 2022] PUT /identity/v3/projects/06c75439259e4891a5148e70e61b8b1a/users/b7809187abdb4781b3266250f7a7f79e/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:20.954101 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3618f9-fcbd-4714-ad4e-c70d31de4141 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.954398 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3618f9-fcbd-4714-ad4e-c70d31de4141 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.954695 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3618f9-fcbd-4714-ad4e-c70d31de4141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.983736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3d3618f9-fcbd-4714-ad4e-c70d31de4141 None None] MFA Rules not processed for user `b7809187abdb4781b3266250f7a7f79e`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:20.985287 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3d3618f9-fcbd-4714-ad4e-c70d31de4141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:21.053068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1037/2085] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:21.057839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595512f-04d4-43e3-87dc-8f88bf3c1d1b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:21.135062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595512f-04d4-43e3-87dc-8f88bf3c1d1b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:21.140293 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f563740-7b88-40f0-a54c-97cdccbe1d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:21.140896 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f563740-7b88-40f0-a54c-97cdccbe1d8c admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:21.141174 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f563740-7b88-40f0-a54c-97cdccbe1d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:21.141428 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f563740-7b88-40f0-a54c-97cdccbe1d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:21.142056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f563740-7b88-40f0-a54c-97cdccbe1d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:21.144044 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f563740-7b88-40f0-a54c-97cdccbe1d8c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:21.177314 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1049/2086] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:21 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:21.178385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3618f9-fcbd-4714-ad4e-c70d31de4141 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:21.189607 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3618f9-fcbd-4714-ad4e-c70d31de4141 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:21.248813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07677d88-fa69-4573-a690-f512191088bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:21.249457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07677d88-fa69-4573-a690-f512191088bd admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:21.249741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07677d88-fa69-4573-a690-f512191088bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:21.250011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07677d88-fa69-4573-a690-f512191088bd admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:21.250642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07677d88-fa69-4573-a690-f512191088bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:21.252679 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07677d88-fa69-4573-a690-f512191088bd admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:21.264006 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:21.277688 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1038/2087] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:21 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:21.281812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f563740-7b88-40f0-a54c-97cdccbe1d8c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:21.292564 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f563740-7b88-40f0-a54c-97cdccbe1d8c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:21.297782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b793601-f259-4f9d-b495-b58e65f91660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:21.298427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b793601-f259-4f9d-b495-b58e65f91660 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:21.298753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b793601-f259-4f9d-b495-b58e65f91660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:21.299026 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b793601-f259-4f9d-b495-b58e65f91660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:21.299804 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b793601-f259-4f9d-b495-b58e65f91660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:21.301457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b793601-f259-4f9d-b495-b58e65f91660 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:21.312322 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1050/2088] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:22:21.316262 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07677d88-fa69-4573-a690-f512191088bd admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:21.325971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07677d88-fa69-4573-a690-f512191088bd admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:21.330807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770216a6-c439-49d8-bf09-9f0ef61b12e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:21.331408 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770216a6-c439-49d8-bf09-9f0ef61b12e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:21.331758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770216a6-c439-49d8-bf09-9f0ef61b12e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:21.332049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770216a6-c439-49d8-bf09-9f0ef61b12e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:21.332686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770216a6-c439-49d8-bf09-9f0ef61b12e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:21.334291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770216a6-c439-49d8-bf09-9f0ef61b12e5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:21.344569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1039/2089] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:21.349190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b793601-f259-4f9d-b495-b58e65f91660 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:21.360094 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b793601-f259-4f9d-b495-b58e65f91660 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:21.366074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3a843-24a8-41ba-9c1d-489fba81dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:21.366720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3a843-24a8-41ba-9c1d-489fba81dced admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:21.367000 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3a843-24a8-41ba-9c1d-489fba81dced admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:21.367271 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3a843-24a8-41ba-9c1d-489fba81dced admin admin] PATH_INFO: `/v3/projects/13efb7443bf74d3e97e7b47fa9e8f47d/users/d2ccab40aafb45c192be306e873b3cb5/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:21.369637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:21.385321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3a843-24a8-41ba-9c1d-489fba81dced admin admin] RBAC: Authorizing `identity:create_grant(project_id=13efb7443bf74d3e97e7b47fa9e8f47d, user_id=d2ccab40aafb45c192be306e873b3cb5, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:21.388062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3a843-24a8-41ba-9c1d-489fba81dced admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:21.403163 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1051/2090] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:21 2022] PUT /identity/v3/projects/13efb7443bf74d3e97e7b47fa9e8f47d/users/d2ccab40aafb45c192be306e873b3cb5/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:21.414535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2d8c3-5ede-477c-9cb2-eb20474a589a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:21.414819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2d8c3-5ede-477c-9cb2-eb20474a589a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:21.415092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2d8c3-5ede-477c-9cb2-eb20474a589a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:21.446647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1bc2d8c3-5ede-477c-9cb2-eb20474a589a None None] MFA Rules not processed for user `d2ccab40aafb45c192be306e873b3cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:21.447970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1bc2d8c3-5ede-477c-9cb2-eb20474a589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:21.520171 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1040/2091] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:21.524881 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3a843-24a8-41ba-9c1d-489fba81dced admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:21.589322 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3a843-24a8-41ba-9c1d-489fba81dced admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:21.594541 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed26d3-650c-42a0-a910-e2e3db9a061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:21.595146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed26d3-650c-42a0-a910-e2e3db9a061b admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:21.595425 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed26d3-650c-42a0-a910-e2e3db9a061b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:21.595721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed26d3-650c-42a0-a910-e2e3db9a061b admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:21.596403 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed26d3-650c-42a0-a910-e2e3db9a061b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:21.598351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed26d3-650c-42a0-a910-e2e3db9a061b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:21.628676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1052/2092] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:21 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:21.632954 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2d8c3-5ede-477c-9cb2-eb20474a589a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:21.660813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2d8c3-5ede-477c-9cb2-eb20474a589a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:21.751245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a7eb1-e9b9-4a5f-ab28-61e1984dfdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:21.751921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a7eb1-e9b9-4a5f-ab28-61e1984dfdf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:21.752200 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a7eb1-e9b9-4a5f-ab28-61e1984dfdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:21.752530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a7eb1-e9b9-4a5f-ab28-61e1984dfdf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:21.753207 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a7eb1-e9b9-4a5f-ab28-61e1984dfdf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:21.756268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a7eb1-e9b9-4a5f-ab28-61e1984dfdf1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:21.796355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1041/2093] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:21 2022] POST /identity/v3/users => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:21.800483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed26d3-650c-42a0-a910-e2e3db9a061b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:21.823381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed26d3-650c-42a0-a910-e2e3db9a061b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:21.834469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733ef89-3820-4b1e-ae22-5fb51ae2ff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:21.835453 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ef89-3820-4b1e-ae22-5fb51ae2ff63 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:21.836589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ef89-3820-4b1e-ae22-5fb51ae2ff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:21.837531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ef89-3820-4b1e-ae22-5fb51ae2ff63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:21.838534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733ef89-3820-4b1e-ae22-5fb51ae2ff63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:21.840649 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733ef89-3820-4b1e-ae22-5fb51ae2ff63 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:21.854386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1053/2094] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:22:21.858356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a7eb1-e9b9-4a5f-ab28-61e1984dfdf1 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:21.869552 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a7eb1-e9b9-4a5f-ab28-61e1984dfdf1 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:21.874345 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9bb2e-bb7e-436e-b6f1-ed41f16ae556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:21.875021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9bb2e-bb7e-436e-b6f1-ed41f16ae556 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:21.875295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9bb2e-bb7e-436e-b6f1-ed41f16ae556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:21.875563 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9bb2e-bb7e-436e-b6f1-ed41f16ae556 admin admin] PATH_INFO: `/v3/projects/fa846b9c9ced4bdcbc9c80517a7eca2a/users/95838678b85a4981b47ccc3c42835ecc/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:21.900943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9bb2e-bb7e-436e-b6f1-ed41f16ae556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa846b9c9ced4bdcbc9c80517a7eca2a, user_id=95838678b85a4981b47ccc3c42835ecc, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:21.904135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9bb2e-bb7e-436e-b6f1-ed41f16ae556 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:21.922074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1042/2095] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:21 2022] PUT /identity/v3/projects/fa846b9c9ced4bdcbc9c80517a7eca2a/users/95838678b85a4981b47ccc3c42835ecc/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:21.926094 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733ef89-3820-4b1e-ae22-5fb51ae2ff63 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:21.940489 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733ef89-3820-4b1e-ae22-5fb51ae2ff63 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:22.020341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d3791-d5ed-4919-be1d-ed0f802af91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:22.020964 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d3791-d5ed-4919-be1d-ed0f802af91d admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:22.021246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d3791-d5ed-4919-be1d-ed0f802af91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:22.021523 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d3791-d5ed-4919-be1d-ed0f802af91d admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:22.022161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d3791-d5ed-4919-be1d-ed0f802af91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:22.023836 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d3791-d5ed-4919-be1d-ed0f802af91d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:22.034640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1054/2096] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:22.038822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9bb2e-bb7e-436e-b6f1-ed41f16ae556 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:22.050051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9bb2e-bb7e-436e-b6f1-ed41f16ae556 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:22.055239 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37bd2f-70dc-4725-b2ed-34a4d06b76cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:22.055943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37bd2f-70dc-4725-b2ed-34a4d06b76cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:22.056226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37bd2f-70dc-4725-b2ed-34a4d06b76cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:22.056497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37bd2f-70dc-4725-b2ed-34a4d06b76cb admin admin] PATH_INFO: `/v3/projects/fa846b9c9ced4bdcbc9c80517a7eca2a/users/95838678b85a4981b47ccc3c42835ecc/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:22.058384 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37bd2f-70dc-4725-b2ed-34a4d06b76cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa846b9c9ced4bdcbc9c80517a7eca2a, user_id=95838678b85a4981b47ccc3c42835ecc, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:22.061077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37bd2f-70dc-4725-b2ed-34a4d06b76cb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:22.073030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1043/2097] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:22 2022] PUT /identity/v3/projects/fa846b9c9ced4bdcbc9c80517a7eca2a/users/95838678b85a4981b47ccc3c42835ecc/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:22.083469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e533c1b-b9aa-45ca-b747-e85d3c3a7dc6 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:22.083793 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e533c1b-b9aa-45ca-b747-e85d3c3a7dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:22.084074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e533c1b-b9aa-45ca-b747-e85d3c3a7dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:22.113644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-6e533c1b-b9aa-45ca-b747-e85d3c3a7dc6 None None] MFA Rules not processed for user `95838678b85a4981b47ccc3c42835ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:22.114906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6e533c1b-b9aa-45ca-b747-e85d3c3a7dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:22.167642 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:22.198823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1055/2098] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:22.210456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37bd2f-70dc-4725-b2ed-34a4d06b76cb admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:22.212415 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5b37bd2f-70dc-4725-b2ed-34a4d06b76cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:22.244081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:22.276932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37bd2f-70dc-4725-b2ed-34a4d06b76cb admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:22.280594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f52c2c-6d40-47a3-93fe-bdf44bfdf3ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:22.281491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f52c2c-6d40-47a3-93fe-bdf44bfdf3ce service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:22.281903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f52c2c-6d40-47a3-93fe-bdf44bfdf3ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:22.284326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f52c2c-6d40-47a3-93fe-bdf44bfdf3ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:22.344274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f52c2c-6d40-47a3-93fe-bdf44bfdf3ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:22.345897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f52c2c-6d40-47a3-93fe-bdf44bfdf3ce service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:22.356442 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1044/2099] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:23.920557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e533c1b-b9aa-45ca-b747-e85d3c3a7dc6 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:23.922880 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6e533c1b-b9aa-45ca-b747-e85d3c3a7dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:23.942102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e533c1b-b9aa-45ca-b747-e85d3c3a7dc6 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:23.946270 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd964c-bfab-4b8a-8f71-7e82e7a8a469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:23.946967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd964c-bfab-4b8a-8f71-7e82e7a8a469 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:23.947242 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd964c-bfab-4b8a-8f71-7e82e7a8a469 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:23.947490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd964c-bfab-4b8a-8f71-7e82e7a8a469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:24.032973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd964c-bfab-4b8a-8f71-7e82e7a8a469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:24.034780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd964c-bfab-4b8a-8f71-7e82e7a8a469 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:24.046589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1056/2100] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:24.687679 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f52c2c-6d40-47a3-93fe-bdf44bfdf3ce service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:24.696863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f52c2c-6d40-47a3-93fe-bdf44bfdf3ce service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:24.700561 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d68ceb-8b86-4ee8-9776-f03bb0a7e3b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:24.701160 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d68ceb-8b86-4ee8-9776-f03bb0a7e3b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:24.701437 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d68ceb-8b86-4ee8-9776-f03bb0a7e3b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:24.701703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d68ceb-8b86-4ee8-9776-f03bb0a7e3b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:24.711102 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d68ceb-8b86-4ee8-9776-f03bb0a7e3b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:24.712554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d68ceb-8b86-4ee8-9776-f03bb0a7e3b5 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:24.722406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1045/2101] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:28.679053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd964c-bfab-4b8a-8f71-7e82e7a8a469 service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:28.745166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd964c-bfab-4b8a-8f71-7e82e7a8a469 service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:28.749776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b3197-a75a-4cee-88dc-5376d96f86f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:28.750392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b3197-a75a-4cee-88dc-5376d96f86f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:28.750743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b3197-a75a-4cee-88dc-5376d96f86f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:28.751013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b3197-a75a-4cee-88dc-5376d96f86f6 admin admin] PATH_INFO: `/v3/users/b7809187abdb4781b3266250f7a7f79e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:28.752434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b3197-a75a-4cee-88dc-5376d96f86f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7809187abdb4781b3266250f7a7f79e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:28.754813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b3197-a75a-4cee-88dc-5376d96f86f6 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:28.813350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e10b3197-a75a-4cee-88dc-5376d96f86f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7809187abdb4781b3266250f7a7f79e'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.828680 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e10b3197-a75a-4cee-88dc-5376d96f86f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7809187abdb4781b3266250f7a7f79e'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.836256 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e10b3197-a75a-4cee-88dc-5376d96f86f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7809187abdb4781b3266250f7a7f79e'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.840666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:28.846488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e10b3197-a75a-4cee-88dc-5376d96f86f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7809187abdb4781b3266250f7a7f79e'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.847418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e10b3197-a75a-4cee-88dc-5376d96f86f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7809187abdb4781b3266250f7a7f79e'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.854289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1057/2102] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:28 2022] DELETE /identity/v3/users/b7809187abdb4781b3266250f7a7f79e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:28.858917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713f865-776f-4002-b53a-8dc97821cf02 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:28.859407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713f865-776f-4002-b53a-8dc97821cf02 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:28.859491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713f865-776f-4002-b53a-8dc97821cf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:28.879642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7713f865-776f-4002-b53a-8dc97821cf02 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:28.880513 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7713f865-776f-4002-b53a-8dc97821cf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:28.951227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1046/2103] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:28.963679 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b3197-a75a-4cee-88dc-5376d96f86f6 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:28.965402 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e10b3197-a75a-4cee-88dc-5376d96f86f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:29.030013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b3197-a75a-4cee-88dc-5376d96f86f6 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:29.034529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72d4bc-eeb3-4090-8624-9041f7b46fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:29.035155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72d4bc-eeb3-4090-8624-9041f7b46fdc service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:29.035432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72d4bc-eeb3-4090-8624-9041f7b46fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:29.035717 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72d4bc-eeb3-4090-8624-9041f7b46fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:29.046848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72d4bc-eeb3-4090-8624-9041f7b46fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:29.048322 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72d4bc-eeb3-4090-8624-9041f7b46fdc service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:29.058640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1058/2104] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:22:29.341405 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713f865-776f-4002-b53a-8dc97821cf02 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:29.344547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7713f865-776f-4002-b53a-8dc97821cf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:29.361148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713f865-776f-4002-b53a-8dc97821cf02 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:29.368540 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:29.369465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:29.369745 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:29.370019 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] PATH_INFO: `/v3/projects/06c75439259e4891a5148e70e61b8b1a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:29.371329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c75439259e4891a5148e70e61b8b1a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:29.373596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:29.435104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c75439259e4891a5148e70e61b8b1a', 'request_id': 'req-bc85871b-240d-4e93-9648-951e042df93e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.444765 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c75439259e4891a5148e70e61b8b1a', 'request_id': 'req-bc85871b-240d-4e93-9648-951e042df93e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.451157 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:29.453711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c75439259e4891a5148e70e61b8b1a', 'request_id': 'req-bc85871b-240d-4e93-9648-951e042df93e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.474456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] The token cache is being invalidate because project 06c75439259e4891a5148e70e61b8b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:29.474754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.475419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.480220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1047/2105] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:29 2022] DELETE /identity/v3/projects/06c75439259e4891a5148e70e61b8b1a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:29.482561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72d4bc-eeb3-4090-8624-9041f7b46fdc service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:29.497118 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72d4bc-eeb3-4090-8624-9041f7b46fdc service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:29.560613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f9455-1663-4298-a77c-830343256589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:29.561257 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f9455-1663-4298-a77c-830343256589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:29.573618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f9455-1663-4298-a77c-830343256589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:29.573618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f9455-1663-4298-a77c-830343256589 admin admin] PATH_INFO: `/v3/users/d2ccab40aafb45c192be306e873b3cb5` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:29.573618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f9455-1663-4298-a77c-830343256589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ccab40aafb45c192be306e873b3cb5)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:29.573618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f9455-1663-4298-a77c-830343256589 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:29.634064 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-075f9455-1663-4298-a77c-830343256589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ccab40aafb45c192be306e873b3cb5'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.646118 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-075f9455-1663-4298-a77c-830343256589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ccab40aafb45c192be306e873b3cb5'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.654119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-075f9455-1663-4298-a77c-830343256589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ccab40aafb45c192be306e873b3cb5'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.662932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-075f9455-1663-4298-a77c-830343256589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ccab40aafb45c192be306e873b3cb5'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.663577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-075f9455-1663-4298-a77c-830343256589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ccab40aafb45c192be306e873b3cb5'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.670170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1059/2106] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:29 2022] DELETE /identity/v3/users/d2ccab40aafb45c192be306e873b3cb5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:29.972830 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:29.974526 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:29.988674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85871b-240d-4e93-9648-951e042df93e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:30.054037 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:30.054606 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.054952 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.055214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] PATH_INFO: `/v3/projects/13efb7443bf74d3e97e7b47fa9e8f47d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.056486 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] RBAC: Authorizing `identity:delete_project(project_id=13efb7443bf74d3e97e7b47fa9e8f47d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:30.058453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:30.109098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13efb7443bf74d3e97e7b47fa9e8f47d', 'request_id': 'req-4eb0bfd6-8e46-4330-96ee-61a67fff148a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.118328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13efb7443bf74d3e97e7b47fa9e8f47d', 'request_id': 'req-4eb0bfd6-8e46-4330-96ee-61a67fff148a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.124197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13efb7443bf74d3e97e7b47fa9e8f47d', 'request_id': 'req-4eb0bfd6-8e46-4330-96ee-61a67fff148a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.136011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] The token cache is being invalidate because project 13efb7443bf74d3e97e7b47fa9e8f47d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:30.136303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.137056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.144310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1048/2107] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:29 2022] DELETE /identity/v3/projects/13efb7443bf74d3e97e7b47fa9e8f47d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:30.144483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f9455-1663-4298-a77c-830343256589 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:30.145118 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-075f9455-1663-4298-a77c-830343256589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:30.158637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f9455-1663-4298-a77c-830343256589 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:30.178390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:30.225406 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330c0b3-cc8d-438e-9716-9755ee26d6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:30.226043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c0b3-cc8d-438e-9716-9755ee26d6ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.226319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c0b3-cc8d-438e-9716-9755ee26d6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.226586 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c0b3-cc8d-438e-9716-9755ee26d6ad admin admin] PATH_INFO: `/v3/users/95838678b85a4981b47ccc3c42835ecc` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.227687 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330c0b3-cc8d-438e-9716-9755ee26d6ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=95838678b85a4981b47ccc3c42835ecc)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:30.229612 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330c0b3-cc8d-438e-9716-9755ee26d6ad admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:30.277717 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a330c0b3-cc8d-438e-9716-9755ee26d6ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95838678b85a4981b47ccc3c42835ecc'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.289112 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a330c0b3-cc8d-438e-9716-9755ee26d6ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95838678b85a4981b47ccc3c42835ecc'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.296455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a330c0b3-cc8d-438e-9716-9755ee26d6ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95838678b85a4981b47ccc3c42835ecc'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.306394 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a330c0b3-cc8d-438e-9716-9755ee26d6ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95838678b85a4981b47ccc3c42835ecc'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.307070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a330c0b3-cc8d-438e-9716-9755ee26d6ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95838678b85a4981b47ccc3c42835ecc'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.313707 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1060/2108] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:30 2022] DELETE /identity/v3/users/95838678b85a4981b47ccc3c42835ecc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:30.590280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:30.591722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:30.605112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0bfd6-8e46-4330-96ee-61a67fff148a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:30.670525 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:30.671170 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.671888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.671888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2 admin admin] PATH_INFO: `/v3/projects/fa846b9c9ced4bdcbc9c80517a7eca2a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.672936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa846b9c9ced4bdcbc9c80517a7eca2a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:30.674930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:30.707802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:30.743492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa846b9c9ced4bdcbc9c80517a7eca2a', 'request_id': 'req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.752459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa846b9c9ced4bdcbc9c80517a7eca2a', 'request_id': 'req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.758215 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa846b9c9ced4bdcbc9c80517a7eca2a', 'request_id': 'req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.770373 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2 admin admin] The token cache is being invalidate because project fa846b9c9ced4bdcbc9c80517a7eca2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:30.770929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.771480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bd0f764d-42e0-496e-a2a1-486b23b2d8f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:30.773753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1049/2109] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:30 2022] DELETE /identity/v3/projects/fa846b9c9ced4bdcbc9c80517a7eca2a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:30.778894 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb6457-3923-4551-a954-ceb24e6a8ed1 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.779200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb6457-3923-4551-a954-ceb24e6a8ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.779642 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb6457-3923-4551-a954-ceb24e6a8ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.799838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-f4eb6457-3923-4551-a954-ceb24e6a8ed1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:30.801036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f4eb6457-3923-4551-a954-ceb24e6a8ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:30.864135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1061/2110] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:30.874488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc588f8-83f1-4c0b-ac4c-00e550a0b824 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.875025 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc588f8-83f1-4c0b-ac4c-00e550a0b824 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.875383 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc588f8-83f1-4c0b-ac4c-00e550a0b824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.897410 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-8fc588f8-83f1-4c0b-ac4c-00e550a0b824 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:30.898678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8fc588f8-83f1-4c0b-ac4c-00e550a0b824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:30.907687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1050/2111] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:30.912487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb6457-3923-4551-a954-ceb24e6a8ed1 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:30.923923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb6457-3923-4551-a954-ceb24e6a8ed1 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:30.930723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9b0ff-f474-46a9-b1be-44b7af188539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:30.931354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9b0ff-f474-46a9-b1be-44b7af188539 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.931632 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9b0ff-f474-46a9-b1be-44b7af188539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.931953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9b0ff-f474-46a9-b1be-44b7af188539 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.932620 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9b0ff-f474-46a9-b1be-44b7af188539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:30.932925 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9b0ff-f474-46a9-b1be-44b7af188539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:30.934581 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9b0ff-f474-46a9-b1be-44b7af188539 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:30.948068 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1062/2112] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:22:30.954062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc588f8-83f1-4c0b-ac4c-00e550a0b824 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:30.964348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc588f8-83f1-4c0b-ac4c-00e550a0b824 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:30.970339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8b9d4-80c6-4503-9561-07ccd49c5e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:30.971010 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8b9d4-80c6-4503-9561-07ccd49c5e60 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.971184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8b9d4-80c6-4503-9561-07ccd49c5e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.971445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8b9d4-80c6-4503-9561-07ccd49c5e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.972227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8b9d4-80c6-4503-9561-07ccd49c5e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:30.974165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8b9d4-80c6-4503-9561-07ccd49c5e60 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:31.006104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1051/2113] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:30 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:31.008834 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9b0ff-f474-46a9-b1be-44b7af188539 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:31.020303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9b0ff-f474-46a9-b1be-44b7af188539 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:31.044066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:31.092259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e7296-a2f4-44ce-9697-cf689e1760a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:31.092916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e7296-a2f4-44ce-9697-cf689e1760a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:31.093197 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e7296-a2f4-44ce-9697-cf689e1760a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:31.093471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e7296-a2f4-44ce-9697-cf689e1760a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:31.094135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e7296-a2f4-44ce-9697-cf689e1760a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:31.096148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e7296-a2f4-44ce-9697-cf689e1760a8 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:31.118499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1063/2114] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:31 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:31.122888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8b9d4-80c6-4503-9561-07ccd49c5e60 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:31.134267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8b9d4-80c6-4503-9561-07ccd49c5e60 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:31.144213 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a93e6d-c172-45ba-892e-3c6baa8cffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:31.144845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93e6d-c172-45ba-892e-3c6baa8cffd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:31.145121 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93e6d-c172-45ba-892e-3c6baa8cffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:31.145390 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93e6d-c172-45ba-892e-3c6baa8cffd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:31.146047 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a93e6d-c172-45ba-892e-3c6baa8cffd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:31.147641 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a93e6d-c172-45ba-892e-3c6baa8cffd6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:31.158734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1052/2115] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:31.163160 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e7296-a2f4-44ce-9697-cf689e1760a8 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:31.176520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e7296-a2f4-44ce-9697-cf689e1760a8 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:31.184662 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fa8c9-d434-4136-a7b7-24360bc06d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:31.185603 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fa8c9-d434-4136-a7b7-24360bc06d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:31.186045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fa8c9-d434-4136-a7b7-24360bc06d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:31.186488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fa8c9-d434-4136-a7b7-24360bc06d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:31.187365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fa8c9-d434-4136-a7b7-24360bc06d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:31.189491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fa8c9-d434-4136-a7b7-24360bc06d15 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:31.200697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1064/2116] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:22:31.205270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a93e6d-c172-45ba-892e-3c6baa8cffd6 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:31.217577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a93e6d-c172-45ba-892e-3c6baa8cffd6 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:31.223086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3914aa-f5b7-4f00-b611-f3e9d2c02a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:31.223864 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3914aa-f5b7-4f00-b611-f3e9d2c02a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:31.224211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3914aa-f5b7-4f00-b611-f3e9d2c02a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:31.224550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3914aa-f5b7-4f00-b611-f3e9d2c02a19 admin admin] PATH_INFO: `/v3/projects/4f0893c62a224b7eaf69d84006aef882/users/fb5ae35c4b4942a1b999cbfa49574f3e/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:31.240604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3914aa-f5b7-4f00-b611-f3e9d2c02a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0893c62a224b7eaf69d84006aef882, user_id=fb5ae35c4b4942a1b999cbfa49574f3e, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:31.243306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3914aa-f5b7-4f00-b611-f3e9d2c02a19 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:31.262314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1053/2117] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:31 2022] PUT /identity/v3/projects/4f0893c62a224b7eaf69d84006aef882/users/fb5ae35c4b4942a1b999cbfa49574f3e/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:31.274456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae31eb-ff59-4fd4-ad9c-d221cbb38c52 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:31.275044 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae31eb-ff59-4fd4-ad9c-d221cbb38c52 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:31.275392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae31eb-ff59-4fd4-ad9c-d221cbb38c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:31.311527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-beae31eb-ff59-4fd4-ad9c-d221cbb38c52 None None] MFA Rules not processed for user `fb5ae35c4b4942a1b999cbfa49574f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:31.312780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-beae31eb-ff59-4fd4-ad9c-d221cbb38c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:31.378068 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1065/2118] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:31.389582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3914aa-f5b7-4f00-b611-f3e9d2c02a19 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:31.391300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3a3914aa-f5b7-4f00-b611-f3e9d2c02a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:31.485676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3914aa-f5b7-4f00-b611-f3e9d2c02a19 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:31.489773 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0151ab1-c56c-41ba-b1d8-c9523be48a37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f886be277ef84ec28a290380980c6f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:31.490495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0151ab1-c56c-41ba-b1d8-c9523be48a37 service glance] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:31.490847 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0151ab1-c56c-41ba-b1d8-c9523be48a37 service glance] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:31.491191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0151ab1-c56c-41ba-b1d8-c9523be48a37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:31.500240 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0151ab1-c56c-41ba-b1d8-c9523be48a37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:31.501763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0151ab1-c56c-41ba-b1d8-c9523be48a37 service glance] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:31.510571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1054/2119] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:39.803620 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f04a-3b45-4912-ac79-8e7a77a17279 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:39.804234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f04a-3b45-4912-ac79-8e7a77a17279 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:39.804539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f04a-3b45-4912-ac79-8e7a77a17279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:39.826136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-abd7f04a-3b45-4912-ac79-8e7a77a17279 None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:39.827658 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-abd7f04a-3b45-4912-ac79-8e7a77a17279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:39.898506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1066/2120] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:22:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:39.957386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0151ab1-c56c-41ba-b1d8-c9523be48a37 service glance] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:39.961241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d0151ab1-c56c-41ba-b1d8-c9523be48a37 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:40.016561 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:40.058202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0151ab1-c56c-41ba-b1d8-c9523be48a37 service glance] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:40.064275 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cb7ee-faba-4e8a-ae42-c268762aeafc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:40.065201 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cb7ee-faba-4e8a-ae42-c268762aeafc service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:40.065546 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cb7ee-faba-4e8a-ae42-c268762aeafc service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:40.065822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cb7ee-faba-4e8a-ae42-c268762aeafc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:40.075341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cb7ee-faba-4e8a-ae42-c268762aeafc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:40.077100 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cb7ee-faba-4e8a-ae42-c268762aeafc service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:40.086469 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1055/2121] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:22:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:22:40.486483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7f04a-3b45-4912-ac79-8e7a77a17279 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:40.488149 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-abd7f04a-3b45-4912-ac79-8e7a77a17279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:40.551760 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:40.578087 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7f04a-3b45-4912-ac79-8e7a77a17279 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:40.583311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0c92e-1903-42d7-8c04-46333ccea065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:40.584173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0c92e-1903-42d7-8c04-46333ccea065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:40.584454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0c92e-1903-42d7-8c04-46333ccea065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:40.584741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0c92e-1903-42d7-8c04-46333ccea065 admin admin] PATH_INFO: `/v3/users/ad284b6923e84d3c86202ea126ab1d21` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:40.586049 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0c92e-1903-42d7-8c04-46333ccea065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad284b6923e84d3c86202ea126ab1d21)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:40.588446 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0c92e-1903-42d7-8c04-46333ccea065 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:40.645754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-24a0c92e-1903-42d7-8c04-46333ccea065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad284b6923e84d3c86202ea126ab1d21'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:40.659113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-24a0c92e-1903-42d7-8c04-46333ccea065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad284b6923e84d3c86202ea126ab1d21'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:40.666704 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-24a0c92e-1903-42d7-8c04-46333ccea065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad284b6923e84d3c86202ea126ab1d21'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:40.676468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-24a0c92e-1903-42d7-8c04-46333ccea065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad284b6923e84d3c86202ea126ab1d21'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:40.677292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-24a0c92e-1903-42d7-8c04-46333ccea065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad284b6923e84d3c86202ea126ab1d21'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:40.684376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1067/2122] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:40 2022] DELETE /identity/v3/users/ad284b6923e84d3c86202ea126ab1d21 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:40.874187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cb7ee-faba-4e8a-ae42-c268762aeafc service swift] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:40.892731 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cb7ee-faba-4e8a-ae42-c268762aeafc service swift] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:40.970972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:40.976782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:40.976782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:40.976782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] PATH_INFO: `/v3/projects/01bcaf16cc71465891c80371383fab11` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:40.978314 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01bcaf16cc71465891c80371383fab11)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:40.980595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:41.039823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bcaf16cc71465891c80371383fab11', 'request_id': 'req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.051882 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bcaf16cc71465891c80371383fab11', 'request_id': 'req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.059441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bcaf16cc71465891c80371383fab11', 'request_id': 'req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.072284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] The token cache is being invalidate because project 01bcaf16cc71465891c80371383fab11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:41.072578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.073220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.074843 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1056/2123] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:40 2022] DELETE /identity/v3/projects/01bcaf16cc71465891c80371383fab11 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:41.079686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0c92e-1903-42d7-8c04-46333ccea065 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:41.085310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-24a0c92e-1903-42d7-8c04-46333ccea065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:41.102824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0c92e-1903-42d7-8c04-46333ccea065 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:41.193800 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0b48d-ff2f-4e43-a2ff-aaee830103c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:41.194581 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0b48d-ff2f-4e43-a2ff-aaee830103c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:41.194931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0b48d-ff2f-4e43-a2ff-aaee830103c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:41.195272 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0b48d-ff2f-4e43-a2ff-aaee830103c6 admin admin] PATH_INFO: `/v3/users/1c67a91088db465c90d0bcda6d87f811` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:41.196576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0b48d-ff2f-4e43-a2ff-aaee830103c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c67a91088db465c90d0bcda6d87f811)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:41.198600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0b48d-ff2f-4e43-a2ff-aaee830103c6 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:41.257005 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b8b0b48d-ff2f-4e43-a2ff-aaee830103c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c67a91088db465c90d0bcda6d87f811'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.265559 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:41.270923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b8b0b48d-ff2f-4e43-a2ff-aaee830103c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c67a91088db465c90d0bcda6d87f811'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.278922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b8b0b48d-ff2f-4e43-a2ff-aaee830103c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c67a91088db465c90d0bcda6d87f811'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.286941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b8b0b48d-ff2f-4e43-a2ff-aaee830103c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c67a91088db465c90d0bcda6d87f811'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.287855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b8b0b48d-ff2f-4e43-a2ff-aaee830103c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c67a91088db465c90d0bcda6d87f811'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.297314 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1068/2124] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:41 2022] DELETE /identity/v3/users/1c67a91088db465c90d0bcda6d87f811 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:41.497397 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:41.498919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:41.512428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd5797-8954-4bf6-8600-3d7a07a8a8c7 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:41.581337 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:41.594142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f2dff-ce98-44fa-8712-e5988c750484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:41.595648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f2dff-ce98-44fa-8712-e5988c750484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:41.596489 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f2dff-ce98-44fa-8712-e5988c750484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:41.597800 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f2dff-ce98-44fa-8712-e5988c750484 admin admin] PATH_INFO: `/v3/projects/6f0692f0f27d45f28810866a068748ca` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:41.599833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f2dff-ce98-44fa-8712-e5988c750484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0692f0f27d45f28810866a068748ca)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:41.602030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f2dff-ce98-44fa-8712-e5988c750484 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:41.677149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0b6f2dff-ce98-44fa-8712-e5988c750484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0692f0f27d45f28810866a068748ca', 'request_id': 'req-0b6f2dff-ce98-44fa-8712-e5988c750484'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.686576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0b6f2dff-ce98-44fa-8712-e5988c750484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0692f0f27d45f28810866a068748ca', 'request_id': 'req-0b6f2dff-ce98-44fa-8712-e5988c750484'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.693093 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0b6f2dff-ce98-44fa-8712-e5988c750484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0692f0f27d45f28810866a068748ca', 'request_id': 'req-0b6f2dff-ce98-44fa-8712-e5988c750484'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.706577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0b6f2dff-ce98-44fa-8712-e5988c750484 admin admin] The token cache is being invalidate because project 6f0692f0f27d45f28810866a068748ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:41.706879 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0b6f2dff-ce98-44fa-8712-e5988c750484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.707591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0b6f2dff-ce98-44fa-8712-e5988c750484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.709414 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1057/2125] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:41 2022] DELETE /identity/v3/projects/6f0692f0f27d45f28810866a068748ca => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:41.714585 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f608ba-a22b-46d8-854a-ddeb32fd500c None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:41.714899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f608ba-a22b-46d8-854a-ddeb32fd500c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:41.715178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f608ba-a22b-46d8-854a-ddeb32fd500c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:41.736387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-f8f608ba-a22b-46d8-854a-ddeb32fd500c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:41.737682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f8f608ba-a22b-46d8-854a-ddeb32fd500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:41.804805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1069/2126] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:41.813303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484de973-5bb8-4329-9403-325fc9dafcc3 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:41.813483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484de973-5bb8-4329-9403-325fc9dafcc3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:41.813748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484de973-5bb8-4329-9403-325fc9dafcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:41.834435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-484de973-5bb8-4329-9403-325fc9dafcc3 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:41.835754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-484de973-5bb8-4329-9403-325fc9dafcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:41.844416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1058/2127] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:41.849707 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f608ba-a22b-46d8-854a-ddeb32fd500c None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:41.861302 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f608ba-a22b-46d8-854a-ddeb32fd500c None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:41.866635 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a12510-eeeb-43d4-8479-ed36004495f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:41.867274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a12510-eeeb-43d4-8479-ed36004495f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:41.867540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a12510-eeeb-43d4-8479-ed36004495f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:41.867971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a12510-eeeb-43d4-8479-ed36004495f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:41.868598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a12510-eeeb-43d4-8479-ed36004495f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:41.868905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a12510-eeeb-43d4-8479-ed36004495f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:41.870608 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a12510-eeeb-43d4-8479-ed36004495f9 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:41.886786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1070/2128] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:22:41.887904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484de973-5bb8-4329-9403-325fc9dafcc3 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:41.897356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484de973-5bb8-4329-9403-325fc9dafcc3 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:41.902606 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f37ad9-a784-423c-b7ba-5162bda00624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:41.903227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f37ad9-a784-423c-b7ba-5162bda00624 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:41.903525 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f37ad9-a784-423c-b7ba-5162bda00624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:41.903848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f37ad9-a784-423c-b7ba-5162bda00624 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:41.904502 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f37ad9-a784-423c-b7ba-5162bda00624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:41.906472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f37ad9-a784-423c-b7ba-5162bda00624 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:41.941142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1059/2129] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:41 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:22:41.947082 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a12510-eeeb-43d4-8479-ed36004495f9 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:41.960278 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a12510-eeeb-43d4-8479-ed36004495f9 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:42.030351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca11dfb-a626-40ae-a6a2-f7de8880a1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:42.031002 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca11dfb-a626-40ae-a6a2-f7de8880a1ec admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.031246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca11dfb-a626-40ae-a6a2-f7de8880a1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.031520 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca11dfb-a626-40ae-a6a2-f7de8880a1ec admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.032250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca11dfb-a626-40ae-a6a2-f7de8880a1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:42.034189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca11dfb-a626-40ae-a6a2-f7de8880a1ec admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:42.057557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1071/2130] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:41 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:42.061703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f37ad9-a784-423c-b7ba-5162bda00624 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:42.073225 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f37ad9-a784-423c-b7ba-5162bda00624 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:42.078401 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064b9dd-7755-4988-8f34-821d854bdc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:42.078982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064b9dd-7755-4988-8f34-821d854bdc47 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.079263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064b9dd-7755-4988-8f34-821d854bdc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.079541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064b9dd-7755-4988-8f34-821d854bdc47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.080231 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064b9dd-7755-4988-8f34-821d854bdc47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:42.081874 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064b9dd-7755-4988-8f34-821d854bdc47 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:42.094880 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1060/2131] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:42.099345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca11dfb-a626-40ae-a6a2-f7de8880a1ec admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:42.112004 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca11dfb-a626-40ae-a6a2-f7de8880a1ec admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:42.118634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414ba95-1cca-4dbd-a722-62cf1ed0293c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:42.119240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414ba95-1cca-4dbd-a722-62cf1ed0293c admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.119531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414ba95-1cca-4dbd-a722-62cf1ed0293c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.119898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414ba95-1cca-4dbd-a722-62cf1ed0293c admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.120644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414ba95-1cca-4dbd-a722-62cf1ed0293c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:42.122508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414ba95-1cca-4dbd-a722-62cf1ed0293c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:42.138180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1072/2132] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:42.148829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064b9dd-7755-4988-8f34-821d854bdc47 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:42.168561 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064b9dd-7755-4988-8f34-821d854bdc47 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:42.173799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5d631-eac1-4229-91a6-139a7245acf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:42.174464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5d631-eac1-4229-91a6-139a7245acf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.174738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5d631-eac1-4229-91a6-139a7245acf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.175038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5d631-eac1-4229-91a6-139a7245acf6 admin admin] PATH_INFO: `/v3/projects/58c7eaf2ba1649d3b785b09a1459aa04/users/b9146a46221d4a84a3f6390275d5b734/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.191117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5d631-eac1-4229-91a6-139a7245acf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c7eaf2ba1649d3b785b09a1459aa04, user_id=b9146a46221d4a84a3f6390275d5b734, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:42.193922 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5d631-eac1-4229-91a6-139a7245acf6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:42.209294 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1061/2133] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:42 2022] PUT /identity/v3/projects/58c7eaf2ba1649d3b785b09a1459aa04/users/b9146a46221d4a84a3f6390275d5b734/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:42.221579 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ce426-16d8-4877-bf4f-e2482160961b None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.222089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ce426-16d8-4877-bf4f-e2482160961b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.222375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ce426-16d8-4877-bf4f-e2482160961b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.267944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7e2ce426-16d8-4877-bf4f-e2482160961b None None] MFA Rules not processed for user `b9146a46221d4a84a3f6390275d5b734`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:42.269289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7e2ce426-16d8-4877-bf4f-e2482160961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:42.311358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:42.351475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1073/2134] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:42.364107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5d631-eac1-4229-91a6-139a7245acf6 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:42.367144 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d9f5d631-eac1-4229-91a6-139a7245acf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:42.441741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5d631-eac1-4229-91a6-139a7245acf6 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:42.445683 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4d177-7726-4ee8-bb0e-e1c50b11d82a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:42.446310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4d177-7726-4ee8-bb0e-e1c50b11d82a service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.446659 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4d177-7726-4ee8-bb0e-e1c50b11d82a service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.446938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4d177-7726-4ee8-bb0e-e1c50b11d82a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.455935 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4d177-7726-4ee8-bb0e-e1c50b11d82a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:42.457420 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4d177-7726-4ee8-bb0e-e1c50b11d82a service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:42.469114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1062/2135] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:42.491252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ce426-16d8-4877-bf4f-e2482160961b None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:42.558272 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ce426-16d8-4877-bf4f-e2482160961b None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:42.563400 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f269df-00e0-45f1-a9cb-e8fdc046ff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:42.564035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f269df-00e0-45f1-a9cb-e8fdc046ff27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.564435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f269df-00e0-45f1-a9cb-e8fdc046ff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.564614 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f269df-00e0-45f1-a9cb-e8fdc046ff27 admin admin] PATH_INFO: `/v3/users/b9146a46221d4a84a3f6390275d5b734` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.565947 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f269df-00e0-45f1-a9cb-e8fdc046ff27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9146a46221d4a84a3f6390275d5b734)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:42.568197 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f269df-00e0-45f1-a9cb-e8fdc046ff27 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:42.655452 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a3f269df-00e0-45f1-a9cb-e8fdc046ff27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9146a46221d4a84a3f6390275d5b734'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:42.668761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a3f269df-00e0-45f1-a9cb-e8fdc046ff27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9146a46221d4a84a3f6390275d5b734'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:42.677691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a3f269df-00e0-45f1-a9cb-e8fdc046ff27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9146a46221d4a84a3f6390275d5b734'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:42.686200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a3f269df-00e0-45f1-a9cb-e8fdc046ff27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9146a46221d4a84a3f6390275d5b734'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:42.686932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a3f269df-00e0-45f1-a9cb-e8fdc046ff27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9146a46221d4a84a3f6390275d5b734'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:42.694170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1074/2136] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:42 2022] DELETE /identity/v3/users/b9146a46221d4a84a3f6390275d5b734 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:42.698855 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0daf5-4ba0-4537-ba7c-661e43ffc883 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.699795 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0daf5-4ba0-4537-ba7c-661e43ffc883 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.700077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0daf5-4ba0-4537-ba7c-661e43ffc883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.722762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f8c0daf5-4ba0-4537-ba7c-661e43ffc883 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:42.723838 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f8c0daf5-4ba0-4537-ba7c-661e43ffc883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:42.737863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:42.788443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1063/2137] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:42.798924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f269df-00e0-45f1-a9cb-e8fdc046ff27 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:42.800501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a3f269df-00e0-45f1-a9cb-e8fdc046ff27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:42.860930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f269df-00e0-45f1-a9cb-e8fdc046ff27 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:42.864706 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22f705-abb9-4337-be85-7369b1e4cec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:42.865323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f705-abb9-4337-be85-7369b1e4cec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.865618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f705-abb9-4337-be85-7369b1e4cec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.865923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f705-abb9-4337-be85-7369b1e4cec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.872636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:42.878768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22f705-abb9-4337-be85-7369b1e4cec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:42.880890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22f705-abb9-4337-be85-7369b1e4cec2 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:42.893010 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1075/2138] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:43.214507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0daf5-4ba0-4537-ba7c-661e43ffc883 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:43.216767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f8c0daf5-4ba0-4537-ba7c-661e43ffc883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:43.229409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0daf5-4ba0-4537-ba7c-661e43ffc883 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:43.235603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9107ea9-8700-4dc5-99b6-db2ab877848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:43.236295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107ea9-8700-4dc5-99b6-db2ab877848a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.236605 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107ea9-8700-4dc5-99b6-db2ab877848a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.237072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107ea9-8700-4dc5-99b6-db2ab877848a admin admin] PATH_INFO: `/v3/projects/58c7eaf2ba1649d3b785b09a1459aa04` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.238057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9107ea9-8700-4dc5-99b6-db2ab877848a admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c7eaf2ba1649d3b785b09a1459aa04)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:43.240182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9107ea9-8700-4dc5-99b6-db2ab877848a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:43.298668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a9107ea9-8700-4dc5-99b6-db2ab877848a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c7eaf2ba1649d3b785b09a1459aa04', 'request_id': 'req-a9107ea9-8700-4dc5-99b6-db2ab877848a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:43.308470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a9107ea9-8700-4dc5-99b6-db2ab877848a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c7eaf2ba1649d3b785b09a1459aa04', 'request_id': 'req-a9107ea9-8700-4dc5-99b6-db2ab877848a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:43.315147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a9107ea9-8700-4dc5-99b6-db2ab877848a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c7eaf2ba1649d3b785b09a1459aa04', 'request_id': 'req-a9107ea9-8700-4dc5-99b6-db2ab877848a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:43.334946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a9107ea9-8700-4dc5-99b6-db2ab877848a admin admin] The token cache is being invalidate because project 58c7eaf2ba1649d3b785b09a1459aa04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:43.335296 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a9107ea9-8700-4dc5-99b6-db2ab877848a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:43.336403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a9107ea9-8700-4dc5-99b6-db2ab877848a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:43.338658 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1064/2139] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:43 2022] DELETE /identity/v3/projects/58c7eaf2ba1649d3b785b09a1459aa04 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:43.343873 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1b079-2e15-4fec-b901-ad907a9724a2 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.344468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1b079-2e15-4fec-b901-ad907a9724a2 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.344574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1b079-2e15-4fec-b901-ad907a9724a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.368026 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-26f1b079-2e15-4fec-b901-ad907a9724a2 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:43.373787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-26f1b079-2e15-4fec-b901-ad907a9724a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:43.445311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1076/2140] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:43.456284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951aa23-8a2d-4847-803a-f2d8d49d340f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.459939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951aa23-8a2d-4847-803a-f2d8d49d340f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.460275 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951aa23-8a2d-4847-803a-f2d8d49d340f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.482718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c951aa23-8a2d-4847-803a-f2d8d49d340f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:43.484165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c951aa23-8a2d-4847-803a-f2d8d49d340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:43.492861 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1065/2141] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:43.498470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1b079-2e15-4fec-b901-ad907a9724a2 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:43.509462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1b079-2e15-4fec-b901-ad907a9724a2 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:43.515487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60fd73-df7d-4e94-8762-f0c7a9bcc573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:43.516354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60fd73-df7d-4e94-8762-f0c7a9bcc573 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.516821 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60fd73-df7d-4e94-8762-f0c7a9bcc573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.523837 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60fd73-df7d-4e94-8762-f0c7a9bcc573 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.524852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60fd73-df7d-4e94-8762-f0c7a9bcc573 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:43.525338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60fd73-df7d-4e94-8762-f0c7a9bcc573 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:43.527066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60fd73-df7d-4e94-8762-f0c7a9bcc573 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:43.549028 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951aa23-8a2d-4847-803a-f2d8d49d340f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:43.554375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1077/2142] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:22:43.562648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951aa23-8a2d-4847-803a-f2d8d49d340f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:43.569320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85079ff0-8a99-422a-9eaa-6ac4e188c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:43.570090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85079ff0-8a99-422a-9eaa-6ac4e188c2cc admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.570409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85079ff0-8a99-422a-9eaa-6ac4e188c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.572093 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85079ff0-8a99-422a-9eaa-6ac4e188c2cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.573196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85079ff0-8a99-422a-9eaa-6ac4e188c2cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:43.575759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85079ff0-8a99-422a-9eaa-6ac4e188c2cc admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:43.621340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1066/2143] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:43 2022] POST /identity/v3/projects => generated 359 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:43.625433 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60fd73-df7d-4e94-8762-f0c7a9bcc573 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:43.636081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60fd73-df7d-4e94-8762-f0c7a9bcc573 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:43.711305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fac591-a407-4c37-a24c-599fcdfbb17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:43.712107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fac591-a407-4c37-a24c-599fcdfbb17b admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.712541 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fac591-a407-4c37-a24c-599fcdfbb17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.712923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fac591-a407-4c37-a24c-599fcdfbb17b admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.713715 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fac591-a407-4c37-a24c-599fcdfbb17b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:43.716916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fac591-a407-4c37-a24c-599fcdfbb17b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:43.749562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1078/2144] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:43 2022] POST /identity/v3/users => generated 280 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:43.753544 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85079ff0-8a99-422a-9eaa-6ac4e188c2cc admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:43.765770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85079ff0-8a99-422a-9eaa-6ac4e188c2cc admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:43.770907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b498e75-f50e-4066-865a-a14973ea0497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:43.771519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b498e75-f50e-4066-865a-a14973ea0497 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.771846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b498e75-f50e-4066-865a-a14973ea0497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.772128 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b498e75-f50e-4066-865a-a14973ea0497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.772893 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b498e75-f50e-4066-865a-a14973ea0497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:43.774616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b498e75-f50e-4066-865a-a14973ea0497 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:43.786108 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1067/2145] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:43.790012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fac591-a407-4c37-a24c-599fcdfbb17b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:43.802097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fac591-a407-4c37-a24c-599fcdfbb17b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:43.807361 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe139b-e931-4a3f-9f11-bd4f1de77791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:43.808005 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe139b-e931-4a3f-9f11-bd4f1de77791 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.808428 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe139b-e931-4a3f-9f11-bd4f1de77791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.808806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe139b-e931-4a3f-9f11-bd4f1de77791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.809512 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe139b-e931-4a3f-9f11-bd4f1de77791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:43.811413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe139b-e931-4a3f-9f11-bd4f1de77791 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:43.824003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1079/2146] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:43.828500 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b498e75-f50e-4066-865a-a14973ea0497 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:43.839274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b498e75-f50e-4066-865a-a14973ea0497 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:43.844471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527e261-f655-4a8a-a84f-872cfb20b838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:43.845179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527e261-f655-4a8a-a84f-872cfb20b838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.845453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527e261-f655-4a8a-a84f-872cfb20b838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.845736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527e261-f655-4a8a-a84f-872cfb20b838 admin admin] PATH_INFO: `/v3/projects/ed8b08fa8eae4ce1b06a18c94e1fde49/users/21231fcdb3bb49e1ace972f94f6040ce/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.864907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527e261-f655-4a8a-a84f-872cfb20b838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8b08fa8eae4ce1b06a18c94e1fde49, user_id=21231fcdb3bb49e1ace972f94f6040ce, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:43.867646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527e261-f655-4a8a-a84f-872cfb20b838 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:43.891081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1068/2147] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:43 2022] PUT /identity/v3/projects/ed8b08fa8eae4ce1b06a18c94e1fde49/users/21231fcdb3bb49e1ace972f94f6040ce/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:43.892815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f0e0f-9810-4da7-b063-aa5221f472e0 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.893082 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f0e0f-9810-4da7-b063-aa5221f472e0 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.893358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f0e0f-9810-4da7-b063-aa5221f472e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.926555 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-f96f0e0f-9810-4da7-b063-aa5221f472e0 None None] MFA Rules not processed for user `21231fcdb3bb49e1ace972f94f6040ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:43.928582 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f96f0e0f-9810-4da7-b063-aa5221f472e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:43.993187 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:44.017971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1080/2148] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:44.054982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527e261-f655-4a8a-a84f-872cfb20b838 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:44.056748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c527e261-f655-4a8a-a84f-872cfb20b838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:44.104218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:44.123574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527e261-f655-4a8a-a84f-872cfb20b838 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:44.128724 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eaf252-5b83-4fe9-aad0-d0483120b885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:44.129305 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaf252-5b83-4fe9-aad0-d0483120b885 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:44.129637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaf252-5b83-4fe9-aad0-d0483120b885 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:44.129915 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaf252-5b83-4fe9-aad0-d0483120b885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:44.144551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eaf252-5b83-4fe9-aad0-d0483120b885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:44.144551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eaf252-5b83-4fe9-aad0-d0483120b885 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:44.154194 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1069/2149] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:44.170508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f0e0f-9810-4da7-b063-aa5221f472e0 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:44.252980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f0e0f-9810-4da7-b063-aa5221f472e0 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:44.258484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b26df-32f7-488d-b6af-9e9aefbb8df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:44.259516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b26df-32f7-488d-b6af-9e9aefbb8df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:44.260261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b26df-32f7-488d-b6af-9e9aefbb8df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:44.260543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b26df-32f7-488d-b6af-9e9aefbb8df2 admin admin] PATH_INFO: `/v3/users/21231fcdb3bb49e1ace972f94f6040ce` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:44.262707 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b26df-32f7-488d-b6af-9e9aefbb8df2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21231fcdb3bb49e1ace972f94f6040ce)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:44.266291 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b26df-32f7-488d-b6af-9e9aefbb8df2 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:44.321726 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fb9b26df-32f7-488d-b6af-9e9aefbb8df2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21231fcdb3bb49e1ace972f94f6040ce'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:44.334550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fb9b26df-32f7-488d-b6af-9e9aefbb8df2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21231fcdb3bb49e1ace972f94f6040ce'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:44.342414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fb9b26df-32f7-488d-b6af-9e9aefbb8df2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21231fcdb3bb49e1ace972f94f6040ce'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:44.352159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fb9b26df-32f7-488d-b6af-9e9aefbb8df2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21231fcdb3bb49e1ace972f94f6040ce'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:44.353424 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fb9b26df-32f7-488d-b6af-9e9aefbb8df2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21231fcdb3bb49e1ace972f94f6040ce'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:44.361079 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1081/2150] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:44 2022] DELETE /identity/v3/users/21231fcdb3bb49e1ace972f94f6040ce => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:44.365934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a62910-05f0-40c7-96be-508798414309 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:44.366453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a62910-05f0-40c7-96be-508798414309 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:44.366721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a62910-05f0-40c7-96be-508798414309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:44.386589 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d3a62910-05f0-40c7-96be-508798414309 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:44.387835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d3a62910-05f0-40c7-96be-508798414309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:44.456419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1070/2151] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:44.465838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b26df-32f7-488d-b6af-9e9aefbb8df2 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:44.467263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-fb9b26df-32f7-488d-b6af-9e9aefbb8df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:44.528485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b26df-32f7-488d-b6af-9e9aefbb8df2 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:44.532899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9875f1-ea20-4a5a-a2dc-c3349311a708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:44.533616 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9875f1-ea20-4a5a-a2dc-c3349311a708 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:44.533981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9875f1-ea20-4a5a-a2dc-c3349311a708 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:44.534354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9875f1-ea20-4a5a-a2dc-c3349311a708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:44.544145 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9875f1-ea20-4a5a-a2dc-c3349311a708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:44.545912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9875f1-ea20-4a5a-a2dc-c3349311a708 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:44.555528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1082/2152] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:45.048725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a62910-05f0-40c7-96be-508798414309 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:45.050490 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d3a62910-05f0-40c7-96be-508798414309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:45.071762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a62910-05f0-40c7-96be-508798414309 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:45.071762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:45.071762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:45.071762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:45.072374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] PATH_INFO: `/v3/projects/ed8b08fa8eae4ce1b06a18c94e1fde49` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:45.072790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8b08fa8eae4ce1b06a18c94e1fde49)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:45.074901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:45.165873 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8b08fa8eae4ce1b06a18c94e1fde49', 'request_id': 'req-97c6f78e-3423-4810-b998-0e3e98f7e58b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:45.177313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8b08fa8eae4ce1b06a18c94e1fde49', 'request_id': 'req-97c6f78e-3423-4810-b998-0e3e98f7e58b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:45.185869 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8b08fa8eae4ce1b06a18c94e1fde49', 'request_id': 'req-97c6f78e-3423-4810-b998-0e3e98f7e58b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:45.205246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] The token cache is being invalidate because project ed8b08fa8eae4ce1b06a18c94e1fde49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:45.205733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:45.207372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:45.210136 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1071/2153] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:45 2022] DELETE /identity/v3/projects/ed8b08fa8eae4ce1b06a18c94e1fde49 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:54.551626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:55.198920 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=62,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:56.910138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873149-5a37-4edf-8df0-597b2bbbdde1 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:56.911170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873149-5a37-4edf-8df0-597b2bbbdde1 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:56.911513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873149-5a37-4edf-8df0-597b2bbbdde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:56.937084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-72873149-5a37-4edf-8df0-597b2bbbdde1 None None] MFA Rules not processed for user `1aeead6fcbc54b39826b5da033dd9d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:56.938449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-72873149-5a37-4edf-8df0-597b2bbbdde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:57.051882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1083/2154] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:22:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:03.488606 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:03.490197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:03.580280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6f78e-3423-4810-b998-0e3e98f7e58b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:03.585054 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f7fc0-d770-41d8-b9ac-6605189c4e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:03.585762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f7fc0-d770-41d8-b9ac-6605189c4e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:03.586047 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f7fc0-d770-41d8-b9ac-6605189c4e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:03.586321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f7fc0-d770-41d8-b9ac-6605189c4e4c admin admin] PATH_INFO: `/v3/users/fb5ae35c4b4942a1b999cbfa49574f3e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:03.588052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f7fc0-d770-41d8-b9ac-6605189c4e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5ae35c4b4942a1b999cbfa49574f3e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:03.590056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f7fc0-d770-41d8-b9ac-6605189c4e4c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:03.661281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e67f7fc0-d770-41d8-b9ac-6605189c4e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5ae35c4b4942a1b999cbfa49574f3e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:03.676348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e67f7fc0-d770-41d8-b9ac-6605189c4e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5ae35c4b4942a1b999cbfa49574f3e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:03.685732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e67f7fc0-d770-41d8-b9ac-6605189c4e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5ae35c4b4942a1b999cbfa49574f3e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:03.697109 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e67f7fc0-d770-41d8-b9ac-6605189c4e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5ae35c4b4942a1b999cbfa49574f3e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:03.697768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e67f7fc0-d770-41d8-b9ac-6605189c4e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5ae35c4b4942a1b999cbfa49574f3e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:03.705744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1072/2155] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:23:03 2022] DELETE /identity/v3/users/fb5ae35c4b4942a1b999cbfa49574f3e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:03.709046 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edad9ac-de1c-43d3-805f-fd9b2e304050 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:03.709592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edad9ac-de1c-43d3-805f-fd9b2e304050 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:03.709592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edad9ac-de1c-43d3-805f-fd9b2e304050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:03.731642 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5edad9ac-de1c-43d3-805f-fd9b2e304050 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:03.732902 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5edad9ac-de1c-43d3-805f-fd9b2e304050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:03.800404 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1084/2156] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:03.810219 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f7fc0-d770-41d8-b9ac-6605189c4e4c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:03.811826 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e67f7fc0-d770-41d8-b9ac-6605189c4e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:03.894131 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f7fc0-d770-41d8-b9ac-6605189c4e4c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:03.899457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e6240-4be1-4233-a4f3-52e7e31b8afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:03.900126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e6240-4be1-4233-a4f3-52e7e31b8afe service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:03.900412 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e6240-4be1-4233-a4f3-52e7e31b8afe service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:03.900692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e6240-4be1-4233-a4f3-52e7e31b8afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:03.918917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e6240-4be1-4233-a4f3-52e7e31b8afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:03.920725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e6240-4be1-4233-a4f3-52e7e31b8afe service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:03.937088 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1073/2157] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:04.204681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef230ae-5b69-4d87-b4ab-aa68fcb40a00 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:04.205644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef230ae-5b69-4d87-b4ab-aa68fcb40a00 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:04.206063 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef230ae-5b69-4d87-b4ab-aa68fcb40a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:04.236514 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-1ef230ae-5b69-4d87-b4ab-aa68fcb40a00 None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:04.237966 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-1ef230ae-5b69-4d87-b4ab-aa68fcb40a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:04.315322 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1085/2158] 10.222.0.50 () {58 vars in 967 bytes} [Wed Aug 31 00:23:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:04.328719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e6240-4be1-4233-a4f3-52e7e31b8afe service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:04.330130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-155e6240-4be1-4233-a4f3-52e7e31b8afe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:04.361229 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef230ae-5b69-4d87-b4ab-aa68fcb40a00 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:04.362686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-1ef230ae-5b69-4d87-b4ab-aa68fcb40a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:04.365351 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:04.386666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef230ae-5b69-4d87-b4ab-aa68fcb40a00 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:04.395492 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f278307-b0af-4681-a6b0-744ba11b8a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:04.396179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f278307-b0af-4681-a6b0-744ba11b8a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:04.397155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f278307-b0af-4681-a6b0-744ba11b8a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:04.397526 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f278307-b0af-4681-a6b0-744ba11b8a81 admin admin] PATH_INFO: `/v3/projects/4f0893c62a224b7eaf69d84006aef882` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:04.398787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f278307-b0af-4681-a6b0-744ba11b8a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0893c62a224b7eaf69d84006aef882)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:04.401644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f278307-b0af-4681-a6b0-744ba11b8a81 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:04.417562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e6240-4be1-4233-a4f3-52e7e31b8afe service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:04.424126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae8f16-3c38-4260-b0ad-816415ebfd96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:04.425097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae8f16-3c38-4260-b0ad-816415ebfd96 service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:04.425381 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae8f16-3c38-4260-b0ad-816415ebfd96 service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:04.425661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae8f16-3c38-4260-b0ad-816415ebfd96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:04.435148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae8f16-3c38-4260-b0ad-816415ebfd96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:04.437084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae8f16-3c38-4260-b0ad-816415ebfd96 service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:04.452992 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1074/2159] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:23:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:23:04.456693 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:04.459926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6f278307-b0af-4681-a6b0-744ba11b8a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0893c62a224b7eaf69d84006aef882', 'request_id': 'req-6f278307-b0af-4681-a6b0-744ba11b8a81'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:04.470403 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6f278307-b0af-4681-a6b0-744ba11b8a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0893c62a224b7eaf69d84006aef882', 'request_id': 'req-6f278307-b0af-4681-a6b0-744ba11b8a81'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:04.478463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6f278307-b0af-4681-a6b0-744ba11b8a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0893c62a224b7eaf69d84006aef882', 'request_id': 'req-6f278307-b0af-4681-a6b0-744ba11b8a81'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:04.494145 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6f278307-b0af-4681-a6b0-744ba11b8a81 admin admin] The token cache is being invalidate because project 4f0893c62a224b7eaf69d84006aef882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:23:04.494442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6f278307-b0af-4681-a6b0-744ba11b8a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:04.495109 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6f278307-b0af-4681-a6b0-744ba11b8a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:04.497025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1086/2160] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:23:04 2022] DELETE /identity/v3/projects/4f0893c62a224b7eaf69d84006aef882 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:23:04.501913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa4d0f-5168-47b2-8689-0bdf870eacc7 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:04.502407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa4d0f-5168-47b2-8689-0bdf870eacc7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:04.502506 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa4d0f-5168-47b2-8689-0bdf870eacc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:04.523730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1caa4d0f-5168-47b2-8689-0bdf870eacc7 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:04.524576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1caa4d0f-5168-47b2-8689-0bdf870eacc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:04.605225 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1075/2161] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:04.614415 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240aff64-a3cc-4d4e-a4ca-1e07390f736d None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:04.614702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240aff64-a3cc-4d4e-a4ca-1e07390f736d None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:04.614982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240aff64-a3cc-4d4e-a4ca-1e07390f736d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:04.636431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-240aff64-a3cc-4d4e-a4ca-1e07390f736d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:04.637779 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-240aff64-a3cc-4d4e-a4ca-1e07390f736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:04.648317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1087/2162] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:04.652444 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa4d0f-5168-47b2-8689-0bdf870eacc7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:04.663151 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa4d0f-5168-47b2-8689-0bdf870eacc7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:04.668305 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd675c37-1a08-40a9-809a-b4624c43c146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:04.668921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675c37-1a08-40a9-809a-b4624c43c146 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:04.669530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675c37-1a08-40a9-809a-b4624c43c146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:04.669810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675c37-1a08-40a9-809a-b4624c43c146 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:04.670653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd675c37-1a08-40a9-809a-b4624c43c146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:23:04.670821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd675c37-1a08-40a9-809a-b4624c43c146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:04.672471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd675c37-1a08-40a9-809a-b4624c43c146 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:04.685598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1076/2163] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:23:04.690052 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240aff64-a3cc-4d4e-a4ca-1e07390f736d None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:04.700122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240aff64-a3cc-4d4e-a4ca-1e07390f736d None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:04.704928 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820bc72-4a82-4ef8-9757-2920dae5ce1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:04.705535 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820bc72-4a82-4ef8-9757-2920dae5ce1b admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:04.705810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820bc72-4a82-4ef8-9757-2920dae5ce1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:04.706086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820bc72-4a82-4ef8-9757-2920dae5ce1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:04.706725 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820bc72-4a82-4ef8-9757-2920dae5ce1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:04.708671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820bc72-4a82-4ef8-9757-2920dae5ce1b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:04.737126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1088/2164] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:23:04 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:23:04.741458 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd675c37-1a08-40a9-809a-b4624c43c146 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:04.752444 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd675c37-1a08-40a9-809a-b4624c43c146 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:04.818645 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85133f8-3c6d-4c30-84b6-363317f9c136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:04.819338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85133f8-3c6d-4c30-84b6-363317f9c136 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:04.819625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85133f8-3c6d-4c30-84b6-363317f9c136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:04.819931 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85133f8-3c6d-4c30-84b6-363317f9c136 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:04.820569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85133f8-3c6d-4c30-84b6-363317f9c136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:04.823605 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85133f8-3c6d-4c30-84b6-363317f9c136 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:04.850591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1077/2165] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:23:04 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:23:04.851896 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820bc72-4a82-4ef8-9757-2920dae5ce1b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:04.862617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820bc72-4a82-4ef8-9757-2920dae5ce1b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:04.867815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fec25-ec50-4840-9415-b3b5214df8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:04.868422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fec25-ec50-4840-9415-b3b5214df8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:04.868703 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fec25-ec50-4840-9415-b3b5214df8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:04.869053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fec25-ec50-4840-9415-b3b5214df8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:04.869985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fec25-ec50-4840-9415-b3b5214df8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:04.871625 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fec25-ec50-4840-9415-b3b5214df8a7 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:04.882531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1089/2166] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:23:04.885980 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85133f8-3c6d-4c30-84b6-363317f9c136 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:04.896285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85133f8-3c6d-4c30-84b6-363317f9c136 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:04.901009 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cda4fb-2939-4f0e-9241-8db094c58222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:04.901638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cda4fb-2939-4f0e-9241-8db094c58222 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:04.901921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cda4fb-2939-4f0e-9241-8db094c58222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:04.902199 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cda4fb-2939-4f0e-9241-8db094c58222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:04.902880 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cda4fb-2939-4f0e-9241-8db094c58222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:04.904554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cda4fb-2939-4f0e-9241-8db094c58222 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:04.915676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1078/2167] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:23:04.920276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fec25-ec50-4840-9415-b3b5214df8a7 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:04.930568 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fec25-ec50-4840-9415-b3b5214df8a7 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:04.936085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9764d-10d0-4144-994e-a4a7f009aee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:04.936803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9764d-10d0-4144-994e-a4a7f009aee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:04.937089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9764d-10d0-4144-994e-a4a7f009aee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:04.937401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9764d-10d0-4144-994e-a4a7f009aee0 admin admin] PATH_INFO: `/v3/projects/a9876ecaeda44d46a67f4d1980ef16ab/users/e4370340d7c149f39fe9192f0a509940/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:04.952429 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9764d-10d0-4144-994e-a4a7f009aee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9876ecaeda44d46a67f4d1980ef16ab, user_id=e4370340d7c149f39fe9192f0a509940, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:04.955127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9764d-10d0-4144-994e-a4a7f009aee0 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:04.969665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1090/2168] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:23:04 2022] PUT /identity/v3/projects/a9876ecaeda44d46a67f4d1980ef16ab/users/e4370340d7c149f39fe9192f0a509940/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:04.980767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc123584-720b-420e-9c72-9ca381c4c97c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:04.981290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc123584-720b-420e-9c72-9ca381c4c97c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:04.981647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc123584-720b-420e-9c72-9ca381c4c97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:05.011265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-cc123584-720b-420e-9c72-9ca381c4c97c None None] MFA Rules not processed for user `e4370340d7c149f39fe9192f0a509940`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:05.012590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cc123584-720b-420e-9c72-9ca381c4c97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:05.019933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:05.090706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1079/2169] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:23:05.103747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9764d-10d0-4144-994e-a4a7f009aee0 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:05.106649 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-bda9764d-10d0-4144-994e-a4a7f009aee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:05.193590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9764d-10d0-4144-994e-a4a7f009aee0 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:05.197724 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3233a37-df6a-43f1-8fc1-ec2ed0be65a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:05.198413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233a37-df6a-43f1-8fc1-ec2ed0be65a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:05.198757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233a37-df6a-43f1-8fc1-ec2ed0be65a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:05.199095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233a37-df6a-43f1-8fc1-ec2ed0be65a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:05.210007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3233a37-df6a-43f1-8fc1-ec2ed0be65a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:05.211563 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3233a37-df6a-43f1-8fc1-ec2ed0be65a6 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:05.222415 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1091/2170] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:06.451638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc123584-720b-420e-9c72-9ca381c4c97c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:06.453183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cc123584-720b-420e-9c72-9ca381c4c97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:06.524940 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc123584-720b-420e-9c72-9ca381c4c97c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:06.531069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae3869-be7e-44f6-9e23-ef314786fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:06.531760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae3869-be7e-44f6-9e23-ef314786fec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:06.532045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae3869-be7e-44f6-9e23-ef314786fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:06.532349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae3869-be7e-44f6-9e23-ef314786fec9 admin admin] PATH_INFO: `/v3/users/acfc8a880e7a4e2b97babe7e6b092aa2` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:06.533480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae3869-be7e-44f6-9e23-ef314786fec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acfc8a880e7a4e2b97babe7e6b092aa2)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:06.535468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae3869-be7e-44f6-9e23-ef314786fec9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:06.597435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-beae3869-be7e-44f6-9e23-ef314786fec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acfc8a880e7a4e2b97babe7e6b092aa2'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:06.609815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-beae3869-be7e-44f6-9e23-ef314786fec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acfc8a880e7a4e2b97babe7e6b092aa2'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:06.617175 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-beae3869-be7e-44f6-9e23-ef314786fec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acfc8a880e7a4e2b97babe7e6b092aa2'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:06.627060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-beae3869-be7e-44f6-9e23-ef314786fec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acfc8a880e7a4e2b97babe7e6b092aa2'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:06.627665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-beae3869-be7e-44f6-9e23-ef314786fec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acfc8a880e7a4e2b97babe7e6b092aa2'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:06.634034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1080/2171] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:23:06 2022] DELETE /identity/v3/users/acfc8a880e7a4e2b97babe7e6b092aa2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:06.918990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3233a37-df6a-43f1-8fc1-ec2ed0be65a6 service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:06.932576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3233a37-df6a-43f1-8fc1-ec2ed0be65a6 service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:07.038196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:07.039014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:07.039606 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:07.040088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2 admin admin] PATH_INFO: `/v3/projects/51d0f2fd73dd429e853a241241f79071` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:07.041516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d0f2fd73dd429e853a241241f79071)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:07.044574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:07.075352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:07.123987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d0f2fd73dd429e853a241241f79071', 'request_id': 'req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:07.133890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d0f2fd73dd429e853a241241f79071', 'request_id': 'req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:07.149233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d0f2fd73dd429e853a241241f79071', 'request_id': 'req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:07.162458 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2 admin admin] The token cache is being invalidate because project 51d0f2fd73dd429e853a241241f79071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:23:07.163038 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:07.164226 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-7fae0561-5e48-4fe5-9eb6-38efad5f39d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:07.166211 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1092/2172] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:23:06 2022] DELETE /identity/v3/projects/51d0f2fd73dd429e853a241241f79071 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:07.173064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa09606-26c7-459e-9b8f-93a0f8cf9e58 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:07.173396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa09606-26c7-459e-9b8f-93a0f8cf9e58 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:07.173680 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa09606-26c7-459e-9b8f-93a0f8cf9e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:07.193465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-bfa09606-26c7-459e-9b8f-93a0f8cf9e58 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:07.194673 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bfa09606-26c7-459e-9b8f-93a0f8cf9e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:07.214854 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:07.255256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1081/2173] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:07.263724 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507632df-8588-418e-8274-71f078332df6 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:07.263996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507632df-8588-418e-8274-71f078332df6 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:07.264274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507632df-8588-418e-8274-71f078332df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:07.284702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-507632df-8588-418e-8274-71f078332df6 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:07.285894 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-507632df-8588-418e-8274-71f078332df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:07.294757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1093/2174] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:07.298984 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa09606-26c7-459e-9b8f-93a0f8cf9e58 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:07.308866 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa09606-26c7-459e-9b8f-93a0f8cf9e58 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:07.314052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c98c0d-e13b-4665-a50e-9bde38d3a4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:07.314644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c98c0d-e13b-4665-a50e-9bde38d3a4ff admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:07.314921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c98c0d-e13b-4665-a50e-9bde38d3a4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:07.315193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c98c0d-e13b-4665-a50e-9bde38d3a4ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:07.315886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c98c0d-e13b-4665-a50e-9bde38d3a4ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:23:07.316193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c98c0d-e13b-4665-a50e-9bde38d3a4ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:07.317975 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c98c0d-e13b-4665-a50e-9bde38d3a4ff admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:07.329598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1082/2175] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:23:07.333942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507632df-8588-418e-8274-71f078332df6 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:07.343617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507632df-8588-418e-8274-71f078332df6 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:07.348906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b05c9-f192-4e42-96e6-9beb9eb42566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:07.349453 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b05c9-f192-4e42-96e6-9beb9eb42566 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:07.349728 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b05c9-f192-4e42-96e6-9beb9eb42566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:07.350021 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b05c9-f192-4e42-96e6-9beb9eb42566 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:07.350627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b05c9-f192-4e42-96e6-9beb9eb42566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:07.352571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b05c9-f192-4e42-96e6-9beb9eb42566 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:07.381180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1094/2176] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:23:07 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:23:07.385484 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c98c0d-e13b-4665-a50e-9bde38d3a4ff admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:07.395926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c98c0d-e13b-4665-a50e-9bde38d3a4ff admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:07.453031 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f055a-db02-48b1-8d34-7f81b42985ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:07.453704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f055a-db02-48b1-8d34-7f81b42985ac admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:07.453704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f055a-db02-48b1-8d34-7f81b42985ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:07.453961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f055a-db02-48b1-8d34-7f81b42985ac admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:07.454553 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f055a-db02-48b1-8d34-7f81b42985ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:07.456527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f055a-db02-48b1-8d34-7f81b42985ac admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:07.480831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1083/2177] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:23:07 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:23:07.484978 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b05c9-f192-4e42-96e6-9beb9eb42566 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:07.496039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b05c9-f192-4e42-96e6-9beb9eb42566 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:07.501471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29124753-53eb-4352-baa7-e6506d0c94c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:07.502084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29124753-53eb-4352-baa7-e6506d0c94c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:07.502353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29124753-53eb-4352-baa7-e6506d0c94c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:07.502657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29124753-53eb-4352-baa7-e6506d0c94c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:07.503388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29124753-53eb-4352-baa7-e6506d0c94c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:07.505136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29124753-53eb-4352-baa7-e6506d0c94c2 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:07.515964 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1095/2178] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:23:07.520172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f055a-db02-48b1-8d34-7f81b42985ac admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:07.530816 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f055a-db02-48b1-8d34-7f81b42985ac admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:07.535862 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0394c3-cae5-4f3d-8602-8fb1b7ee220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:07.536583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0394c3-cae5-4f3d-8602-8fb1b7ee220a admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:07.536961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0394c3-cae5-4f3d-8602-8fb1b7ee220a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:07.537340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0394c3-cae5-4f3d-8602-8fb1b7ee220a admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:07.538093 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0394c3-cae5-4f3d-8602-8fb1b7ee220a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:07.539836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0394c3-cae5-4f3d-8602-8fb1b7ee220a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:07.553155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1084/2179] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:23:07.557224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29124753-53eb-4352-baa7-e6506d0c94c2 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:07.568879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29124753-53eb-4352-baa7-e6506d0c94c2 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:07.573840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62192be0-6064-4bc0-8d27-36a04135d5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:07.574636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62192be0-6064-4bc0-8d27-36a04135d5ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:07.575204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62192be0-6064-4bc0-8d27-36a04135d5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:07.575545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62192be0-6064-4bc0-8d27-36a04135d5ff admin admin] PATH_INFO: `/v3/projects/d47f75cb17184231b6cbe08f14510643/users/b527b4362aa44642afaa73ee85ea2a8b/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:07.594098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62192be0-6064-4bc0-8d27-36a04135d5ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47f75cb17184231b6cbe08f14510643, user_id=b527b4362aa44642afaa73ee85ea2a8b, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:07.597167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62192be0-6064-4bc0-8d27-36a04135d5ff admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:07.614972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1096/2180] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:23:07 2022] PUT /identity/v3/projects/d47f75cb17184231b6cbe08f14510643/users/b527b4362aa44642afaa73ee85ea2a8b/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:07.625408 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5dff9-d971-42c0-85b8-a5d796fefa45 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:07.626420 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5dff9-d971-42c0-85b8-a5d796fefa45 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:07.626747 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5dff9-d971-42c0-85b8-a5d796fefa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:07.656430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-20d5dff9-d971-42c0-85b8-a5d796fefa45 None None] MFA Rules not processed for user `b527b4362aa44642afaa73ee85ea2a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:07.657700 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-20d5dff9-d971-42c0-85b8-a5d796fefa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:07.724753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1085/2181] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:07.736396 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62192be0-6064-4bc0-8d27-36a04135d5ff admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:07.738075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-62192be0-6064-4bc0-8d27-36a04135d5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:07.798720 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62192be0-6064-4bc0-8d27-36a04135d5ff admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:07.802679 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59651a0d-5aab-4f10-99d2-497c224385b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:07.803358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651a0d-5aab-4f10-99d2-497c224385b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:07.803638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651a0d-5aab-4f10-99d2-497c224385b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:07.803941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651a0d-5aab-4f10-99d2-497c224385b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:07.812655 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59651a0d-5aab-4f10-99d2-497c224385b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:07.814096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59651a0d-5aab-4f10-99d2-497c224385b2 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:07.822924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1097/2182] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:07.848595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5dff9-d971-42c0-85b8-a5d796fefa45 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:07.873666 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:07.914316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5dff9-d971-42c0-85b8-a5d796fefa45 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:07.919508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e66fe1-f3ad-4ef7-8168-a80744df79bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:07.920204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e66fe1-f3ad-4ef7-8168-a80744df79bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:07.920486 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e66fe1-f3ad-4ef7-8168-a80744df79bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:07.920750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e66fe1-f3ad-4ef7-8168-a80744df79bd admin admin] PATH_INFO: `/v3/users/b527b4362aa44642afaa73ee85ea2a8b` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:07.922446 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e66fe1-f3ad-4ef7-8168-a80744df79bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b527b4362aa44642afaa73ee85ea2a8b)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:07.924646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e66fe1-f3ad-4ef7-8168-a80744df79bd admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:07.970934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-27e66fe1-f3ad-4ef7-8168-a80744df79bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b527b4362aa44642afaa73ee85ea2a8b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:07.985790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-27e66fe1-f3ad-4ef7-8168-a80744df79bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b527b4362aa44642afaa73ee85ea2a8b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:07.993233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-27e66fe1-f3ad-4ef7-8168-a80744df79bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b527b4362aa44642afaa73ee85ea2a8b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:08.001657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-27e66fe1-f3ad-4ef7-8168-a80744df79bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b527b4362aa44642afaa73ee85ea2a8b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:08.002471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-27e66fe1-f3ad-4ef7-8168-a80744df79bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b527b4362aa44642afaa73ee85ea2a8b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:08.008587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1086/2183] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:23:07 2022] DELETE /identity/v3/users/b527b4362aa44642afaa73ee85ea2a8b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:08.013338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e0a54-7afd-41a5-9252-898048381b92 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:08.013833 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e0a54-7afd-41a5-9252-898048381b92 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:08.014144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e0a54-7afd-41a5-9252-898048381b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:08.034704 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-eb8e0a54-7afd-41a5-9252-898048381b92 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:08.036352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-eb8e0a54-7afd-41a5-9252-898048381b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:08.079383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:08.101289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1098/2184] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:08.111341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e66fe1-f3ad-4ef7-8168-a80744df79bd admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:08.113798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-27e66fe1-f3ad-4ef7-8168-a80744df79bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:08.180666 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e66fe1-f3ad-4ef7-8168-a80744df79bd admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:08.184329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a350d2-cde7-4d2b-8746-14cff3eeb3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:08.185020 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a350d2-cde7-4d2b-8746-14cff3eeb3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:08.185397 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a350d2-cde7-4d2b-8746-14cff3eeb3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:08.185782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a350d2-cde7-4d2b-8746-14cff3eeb3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:08.198973 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a350d2-cde7-4d2b-8746-14cff3eeb3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:08.201095 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a350d2-cde7-4d2b-8746-14cff3eeb3f3 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:08.213447 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1087/2185] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:08.531974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e0a54-7afd-41a5-9252-898048381b92 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:08.533758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-eb8e0a54-7afd-41a5-9252-898048381b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:08.550575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e0a54-7afd-41a5-9252-898048381b92 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:08.556607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc74dc-e96d-490a-a6f9-f03e9376e029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:08.557320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc74dc-e96d-490a-a6f9-f03e9376e029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:08.557655 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc74dc-e96d-490a-a6f9-f03e9376e029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:08.557919 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc74dc-e96d-490a-a6f9-f03e9376e029 admin admin] PATH_INFO: `/v3/projects/d47f75cb17184231b6cbe08f14510643` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:08.559301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc74dc-e96d-490a-a6f9-f03e9376e029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47f75cb17184231b6cbe08f14510643)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:08.562915 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc74dc-e96d-490a-a6f9-f03e9376e029 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:08.611646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-62fc74dc-e96d-490a-a6f9-f03e9376e029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47f75cb17184231b6cbe08f14510643', 'request_id': 'req-62fc74dc-e96d-490a-a6f9-f03e9376e029'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:08.619869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-62fc74dc-e96d-490a-a6f9-f03e9376e029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47f75cb17184231b6cbe08f14510643', 'request_id': 'req-62fc74dc-e96d-490a-a6f9-f03e9376e029'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:08.626024 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-62fc74dc-e96d-490a-a6f9-f03e9376e029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47f75cb17184231b6cbe08f14510643', 'request_id': 'req-62fc74dc-e96d-490a-a6f9-f03e9376e029'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:08.637599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-62fc74dc-e96d-490a-a6f9-f03e9376e029 admin admin] The token cache is being invalidate because project d47f75cb17184231b6cbe08f14510643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:23:08.637905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-62fc74dc-e96d-490a-a6f9-f03e9376e029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:08.638695 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-62fc74dc-e96d-490a-a6f9-f03e9376e029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:08.651797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1099/2186] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:23:08 2022] DELETE /identity/v3/projects/d47f75cb17184231b6cbe08f14510643 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:12.154091 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc75a73-5be7-47de-b61f-de1f604d2edf None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:12.154595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc75a73-5be7-47de-b61f-de1f604d2edf None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:12.154717 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc75a73-5be7-47de-b61f-de1f604d2edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:12.174908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3fc75a73-5be7-47de-b61f-de1f604d2edf None None] MFA Rules not processed for user `7b05f63c8a054e6dbfe70a70c50805cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:12.176145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3fc75a73-5be7-47de-b61f-de1f604d2edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:12.217550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:12.234827 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1088/2187] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:14.796231 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fc49a-664c-4abd-b742-19849652bb75 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:14.796695 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fc49a-664c-4abd-b742-19849652bb75 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:14.796786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fc49a-664c-4abd-b742-19849652bb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:14.817685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-006fc49a-664c-4abd-b742-19849652bb75 None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:14.819172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-006fc49a-664c-4abd-b742-19849652bb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:14.879673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1100/2188] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:23:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:14.897627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc75a73-5be7-47de-b61f-de1f604d2edf None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:14.899042 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3fc75a73-5be7-47de-b61f-de1f604d2edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:14.985153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc75a73-5be7-47de-b61f-de1f604d2edf None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:14.992783 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881e2c0-6cdc-48dc-99fd-9d14445026c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:14.993877 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881e2c0-6cdc-48dc-99fd-9d14445026c6 service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:14.994307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881e2c0-6cdc-48dc-99fd-9d14445026c6 service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:14.994781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881e2c0-6cdc-48dc-99fd-9d14445026c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:15.007180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881e2c0-6cdc-48dc-99fd-9d14445026c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:15.009279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881e2c0-6cdc-48dc-99fd-9d14445026c6 service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:15.020031 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1089/2189] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:23:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:23:15.496500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fc49a-664c-4abd-b742-19849652bb75 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:15.499179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-006fc49a-664c-4abd-b742-19849652bb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:15.582895 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fc49a-664c-4abd-b742-19849652bb75 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:15.608323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccddaa-0f5a-43aa-a237-bb853c851bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:15.609354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccddaa-0f5a-43aa-a237-bb853c851bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:15.609840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccddaa-0f5a-43aa-a237-bb853c851bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:15.610323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccddaa-0f5a-43aa-a237-bb853c851bc2 admin admin] PATH_INFO: `/v3/users/e4370340d7c149f39fe9192f0a509940` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:15.611842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccddaa-0f5a-43aa-a237-bb853c851bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4370340d7c149f39fe9192f0a509940)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:15.614366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccddaa-0f5a-43aa-a237-bb853c851bc2 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:15.629545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:15.699444 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-83ccddaa-0f5a-43aa-a237-bb853c851bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4370340d7c149f39fe9192f0a509940'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:15.727907 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-83ccddaa-0f5a-43aa-a237-bb853c851bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4370340d7c149f39fe9192f0a509940'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:15.739148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-83ccddaa-0f5a-43aa-a237-bb853c851bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4370340d7c149f39fe9192f0a509940'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:15.755602 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-83ccddaa-0f5a-43aa-a237-bb853c851bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4370340d7c149f39fe9192f0a509940'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:15.756376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-83ccddaa-0f5a-43aa-a237-bb853c851bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4370340d7c149f39fe9192f0a509940'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:15.765468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1101/2190] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:23:15 2022] DELETE /identity/v3/users/e4370340d7c149f39fe9192f0a509940 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:15.770682 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f4e0c-56c7-4364-825c-93e1c3b9c3aa None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:15.771217 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f4e0c-56c7-4364-825c-93e1c3b9c3aa None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:15.771680 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f4e0c-56c7-4364-825c-93e1c3b9c3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:15.799428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-699f4e0c-56c7-4364-825c-93e1c3b9c3aa None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:15.800783 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-699f4e0c-56c7-4364-825c-93e1c3b9c3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:15.877360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1090/2191] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:23:15.887381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccddaa-0f5a-43aa-a237-bb853c851bc2 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:15.888876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-83ccddaa-0f5a-43aa-a237-bb853c851bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:15.971875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccddaa-0f5a-43aa-a237-bb853c851bc2 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:15.987755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017604a9-9a8d-47ad-9905-3424950231b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:15.988629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017604a9-9a8d-47ad-9905-3424950231b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:15.988844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017604a9-9a8d-47ad-9905-3424950231b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:15.989009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017604a9-9a8d-47ad-9905-3424950231b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:16.027516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017604a9-9a8d-47ad-9905-3424950231b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:16.029407 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017604a9-9a8d-47ad-9905-3424950231b9 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:16.060795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1102/2192] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:16.452833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f4e0c-56c7-4364-825c-93e1c3b9c3aa None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:16.466914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-699f4e0c-56c7-4364-825c-93e1c3b9c3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:16.497238 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f4e0c-56c7-4364-825c-93e1c3b9c3aa None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:16.522112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65a10b-3230-4534-9047-65db5f0584ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:16.523187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65a10b-3230-4534-9047-65db5f0584ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:16.527350 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65a10b-3230-4534-9047-65db5f0584ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:16.527994 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65a10b-3230-4534-9047-65db5f0584ad admin admin] PATH_INFO: `/v3/projects/a9876ecaeda44d46a67f4d1980ef16ab` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:16.530054 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65a10b-3230-4534-9047-65db5f0584ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9876ecaeda44d46a67f4d1980ef16ab)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:16.532407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65a10b-3230-4534-9047-65db5f0584ad admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:16.620391 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2d65a10b-3230-4534-9047-65db5f0584ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9876ecaeda44d46a67f4d1980ef16ab', 'request_id': 'req-2d65a10b-3230-4534-9047-65db5f0584ad'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:16.640907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2d65a10b-3230-4534-9047-65db5f0584ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9876ecaeda44d46a67f4d1980ef16ab', 'request_id': 'req-2d65a10b-3230-4534-9047-65db5f0584ad'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:16.654639 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2d65a10b-3230-4534-9047-65db5f0584ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9876ecaeda44d46a67f4d1980ef16ab', 'request_id': 'req-2d65a10b-3230-4534-9047-65db5f0584ad'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:16.669797 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2d65a10b-3230-4534-9047-65db5f0584ad admin admin] The token cache is being invalidate because project a9876ecaeda44d46a67f4d1980ef16ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:23:16.670232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2d65a10b-3230-4534-9047-65db5f0584ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:16.671084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2d65a10b-3230-4534-9047-65db5f0584ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:16.677765 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1091/2193] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:23:16 2022] DELETE /identity/v3/projects/a9876ecaeda44d46a67f4d1980ef16ab => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:16.678582 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc79378-22c5-4b68-87cf-7f30f5d402dd None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:16.678897 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc79378-22c5-4b68-87cf-7f30f5d402dd None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:16.679267 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc79378-22c5-4b68-87cf-7f30f5d402dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:16.705981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5bc79378-22c5-4b68-87cf-7f30f5d402dd None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:16.707238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5bc79378-22c5-4b68-87cf-7f30f5d402dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:16.854851 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd541074-ede1-4632-aaf9-84a49d0d2309 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:16.855147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd541074-ede1-4632-aaf9-84a49d0d2309 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:16.855307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1103/2194] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:23:16.855469 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd541074-ede1-4632-aaf9-84a49d0d2309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:16.866195 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:16.889396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-bd541074-ede1-4632-aaf9-84a49d0d2309 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:16.891260 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bd541074-ede1-4632-aaf9-84a49d0d2309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:16.907024 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1092/2195] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:23:16.909015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc79378-22c5-4b68-87cf-7f30f5d402dd None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:16.933773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc79378-22c5-4b68-87cf-7f30f5d402dd None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:16.959390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8015a9-797d-417b-917c-acd9849d1f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:16.960323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8015a9-797d-417b-917c-acd9849d1f08 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:16.960745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8015a9-797d-417b-917c-acd9849d1f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:16.961173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8015a9-797d-417b-917c-acd9849d1f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:16.961991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8015a9-797d-417b-917c-acd9849d1f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:23:16.962432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8015a9-797d-417b-917c-acd9849d1f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:16.964214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8015a9-797d-417b-917c-acd9849d1f08 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:16.981926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1104/2196] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:23:16.984233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd541074-ede1-4632-aaf9-84a49d0d2309 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:16.996209 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd541074-ede1-4632-aaf9-84a49d0d2309 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:17.001829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98745d58-e578-4452-9435-58d5ec1129b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:17.002458 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98745d58-e578-4452-9435-58d5ec1129b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:17.002769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98745d58-e578-4452-9435-58d5ec1129b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:17.003091 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98745d58-e578-4452-9435-58d5ec1129b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:17.003787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98745d58-e578-4452-9435-58d5ec1129b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:17.005711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98745d58-e578-4452-9435-58d5ec1129b1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:17.047229 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1093/2197] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:23:16 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:23:17.048475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8015a9-797d-417b-917c-acd9849d1f08 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:17.066838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8015a9-797d-417b-917c-acd9849d1f08 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:17.105053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:17.208676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980611f-2b18-4256-9a33-285477902465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:17.209336 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980611f-2b18-4256-9a33-285477902465 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:17.209686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980611f-2b18-4256-9a33-285477902465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:17.209897 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980611f-2b18-4256-9a33-285477902465 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:17.210553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980611f-2b18-4256-9a33-285477902465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:17.212723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980611f-2b18-4256-9a33-285477902465 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:17.244639 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1105/2198] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:23:17 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:23:17.248445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98745d58-e578-4452-9435-58d5ec1129b1 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:17.264806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98745d58-e578-4452-9435-58d5ec1129b1 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:17.276218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1033d56-af2f-4165-8a8c-a21b3cc7a6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:17.276859 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1033d56-af2f-4165-8a8c-a21b3cc7a6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:17.277148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1033d56-af2f-4165-8a8c-a21b3cc7a6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:17.277476 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1033d56-af2f-4165-8a8c-a21b3cc7a6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:17.278438 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1033d56-af2f-4165-8a8c-a21b3cc7a6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:17.280263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1033d56-af2f-4165-8a8c-a21b3cc7a6b7 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:17.295929 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1094/2199] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:23:17.299050 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980611f-2b18-4256-9a33-285477902465 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:17.310572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980611f-2b18-4256-9a33-285477902465 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:17.319204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158496e9-c1d8-49ed-9409-de575625c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:17.319869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158496e9-c1d8-49ed-9409-de575625c2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:17.320151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158496e9-c1d8-49ed-9409-de575625c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:17.320427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158496e9-c1d8-49ed-9409-de575625c2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:17.321077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158496e9-c1d8-49ed-9409-de575625c2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:17.322714 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158496e9-c1d8-49ed-9409-de575625c2b4 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:17.340548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1106/2200] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:23:17.342081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1033d56-af2f-4165-8a8c-a21b3cc7a6b7 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:17.353354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1033d56-af2f-4165-8a8c-a21b3cc7a6b7 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:17.360584 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a1c13-8219-4a46-bf17-4619f9f84d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:17.361543 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a1c13-8219-4a46-bf17-4619f9f84d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:17.361927 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a1c13-8219-4a46-bf17-4619f9f84d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:17.362277 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a1c13-8219-4a46-bf17-4619f9f84d41 admin admin] PATH_INFO: `/v3/projects/c6b0cc5db23c49a8aba66d0b7891a2c6/users/f274525bbcd54376bae92e37d76b0af4/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:17.383082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a1c13-8219-4a46-bf17-4619f9f84d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b0cc5db23c49a8aba66d0b7891a2c6, user_id=f274525bbcd54376bae92e37d76b0af4, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:17.385989 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a1c13-8219-4a46-bf17-4619f9f84d41 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:17.408917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1095/2201] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:23:17 2022] PUT /identity/v3/projects/c6b0cc5db23c49a8aba66d0b7891a2c6/users/f274525bbcd54376bae92e37d76b0af4/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:17.414164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d17c0f-74de-4792-ad60-2ebf64458127 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:17.414451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d17c0f-74de-4792-ad60-2ebf64458127 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:17.414728 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d17c0f-74de-4792-ad60-2ebf64458127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:17.438603 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-97d17c0f-74de-4792-ad60-2ebf64458127 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:17.440155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-97d17c0f-74de-4792-ad60-2ebf64458127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:17.529551 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1107/2202] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:23:17.539773 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a1c13-8219-4a46-bf17-4619f9f84d41 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:17.541649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-998a1c13-8219-4a46-bf17-4619f9f84d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:17.626531 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a1c13-8219-4a46-bf17-4619f9f84d41 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:17.637780 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b07401-2c66-478d-ad6e-31978966cd4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:17.640321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07401-2c66-478d-ad6e-31978966cd4f service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:17.640672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07401-2c66-478d-ad6e-31978966cd4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:17.641119 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07401-2c66-478d-ad6e-31978966cd4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:17.652346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b07401-2c66-478d-ad6e-31978966cd4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:17.653941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b07401-2c66-478d-ad6e-31978966cd4f service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:17.669633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1096/2203] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:18.717055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec29a34-bbb6-4157-99df-1fdaaaa5d82f None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:18.717722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec29a34-bbb6-4157-99df-1fdaaaa5d82f None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:18.717722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec29a34-bbb6-4157-99df-1fdaaaa5d82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:18.757794 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-cec29a34-bbb6-4157-99df-1fdaaaa5d82f None None] MFA Rules not processed for user `f274525bbcd54376bae92e37d76b0af4`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:18.759131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-cec29a34-bbb6-4157-99df-1fdaaaa5d82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:18.864680 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1108/2204] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:18.879754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b07401-2c66-478d-ad6e-31978966cd4f service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:18.881505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e0b07401-2c66-478d-ad6e-31978966cd4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:19.007253 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b07401-2c66-478d-ad6e-31978966cd4f service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:19.013831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143475ce-f71b-4e11-bf54-312e1e215231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:19.014692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143475ce-f71b-4e11-bf54-312e1e215231 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:19.015528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143475ce-f71b-4e11-bf54-312e1e215231 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:19.015942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143475ce-f71b-4e11-bf54-312e1e215231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:19.027186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143475ce-f71b-4e11-bf54-312e1e215231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:19.028974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143475ce-f71b-4e11-bf54-312e1e215231 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:19.041953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1097/2205] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:20.604613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcf29c-3d8d-45fb-a360-fc4b49280041 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:20.605575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcf29c-3d8d-45fb-a360-fc4b49280041 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:20.605853 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcf29c-3d8d-45fb-a360-fc4b49280041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:20.649747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-9cfcf29c-3d8d-45fb-a360-fc4b49280041 None None] MFA Rules not processed for user `f274525bbcd54376bae92e37d76b0af4`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:20.651317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-9cfcf29c-3d8d-45fb-a360-fc4b49280041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:20.660145 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1109/2206] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:23:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:29.035445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=78,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:30.644382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:32.199822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbbd4e-010c-494d-bf35-dbe3c0a87040 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:32.200828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbbd4e-010c-494d-bf35-dbe3c0a87040 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:32.201181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbbd4e-010c-494d-bf35-dbe3c0a87040 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:32.203125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1098/2207] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 31 00:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:23:32.209416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652217f-d53d-4b3d-b286-3d56a983e8b3 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:32.209934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652217f-d53d-4b3d-b286-3d56a983e8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:32.210109 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652217f-d53d-4b3d-b286-3d56a983e8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:32.233792 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7652217f-d53d-4b3d-b286-3d56a983e8b3 None None] MFA Rules not processed for user `cb9ef38ec3b448828826de5f76a552d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:32.235009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7652217f-d53d-4b3d-b286-3d56a983e8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:32.307871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1110/2208] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 31 00:23:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:32.319578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbbd4e-010c-494d-bf35-dbe3c0a87040 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:32.321574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9bbbbd4e-010c-494d-bf35-dbe3c0a87040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:32.379017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbbd4e-010c-494d-bf35-dbe3c0a87040 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:32.382746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a733f6e-7aed-45cd-b132-0863394fbf7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f886be277ef84ec28a290380980c6f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:32.383387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a733f6e-7aed-45cd-b132-0863394fbf7e service glance] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:32.383660 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a733f6e-7aed-45cd-b132-0863394fbf7e service glance] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:32.383969 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a733f6e-7aed-45cd-b132-0863394fbf7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:32.394511 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a733f6e-7aed-45cd-b132-0863394fbf7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:32.395964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a733f6e-7aed-45cd-b132-0863394fbf7e service glance] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:32.409545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1099/2209] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:32.492863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898719-b325-46b3-b2d9-fa08ba2611cd None None] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:32.493228 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898719-b325-46b3-b2d9-fa08ba2611cd None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:32.493511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898719-b325-46b3-b2d9-fa08ba2611cd None None] PATH_INFO: `/` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:32.494937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1111/2210] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 31 00:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:23:32.500156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ffb6b-22f2-4dd7-bcc5-a1104fe7877e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:32.500441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ffb6b-22f2-4dd7-bcc5-a1104fe7877e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:32.500732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ffb6b-22f2-4dd7-bcc5-a1104fe7877e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:32.521070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d50ffb6b-22f2-4dd7-bcc5-a1104fe7877e None None] MFA Rules not processed for user `5bde943833bb43e78879748c49ce3332`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:32.522290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d50ffb6b-22f2-4dd7-bcc5-a1104fe7877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:32.530222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1100/2211] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 31 00:23:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:23:32.542294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb898719-b325-46b3-b2d9-fa08ba2611cd None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:32.558220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb898719-b325-46b3-b2d9-fa08ba2611cd None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:32.563124 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c648a-709f-487c-98ca-6ddcb63925c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:32.563751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c648a-709f-487c-98ca-6ddcb63925c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:32.564031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c648a-709f-487c-98ca-6ddcb63925c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:32.564295 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c648a-709f-487c-98ca-6ddcb63925c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:32.572008 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c648a-709f-487c-98ca-6ddcb63925c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:32.573480 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c648a-709f-487c-98ca-6ddcb63925c5 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:32.581857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1112/2212] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:32.675851 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7853e08-dd6d-4a9f-a6b7-d6a0e7148c44 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:32.676138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7853e08-dd6d-4a9f-a6b7-d6a0e7148c44 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:32.676419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7853e08-dd6d-4a9f-a6b7-d6a0e7148c44 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:32.677910 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1101/2213] 10.222.0.50 () {54 vars in 921 bytes} [Wed Aug 31 00:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:23:32.685740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb6fcb-0f0b-4af1-802e-4ecdbf26933b None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:32.685938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb6fcb-0f0b-4af1-802e-4ecdbf26933b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:32.686233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb6fcb-0f0b-4af1-802e-4ecdbf26933b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:32.710902 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7dcb6fcb-0f0b-4af1-802e-4ecdbf26933b None None] MFA Rules not processed for user `cb9ef38ec3b448828826de5f76a552d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:32.712750 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7dcb6fcb-0f0b-4af1-802e-4ecdbf26933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:32.729793 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1113/2214] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Aug 31 00:23:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:32.741444 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7853e08-dd6d-4a9f-a6b7-d6a0e7148c44 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:32.743808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d7853e08-dd6d-4a9f-a6b7-d6a0e7148c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:32.758787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7853e08-dd6d-4a9f-a6b7-d6a0e7148c44 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:32.762637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47167ae5-8a69-4e16-884e-aaccb2d5c083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:32.763226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47167ae5-8a69-4e16-884e-aaccb2d5c083 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:32.763505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47167ae5-8a69-4e16-884e-aaccb2d5c083 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:32.763760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47167ae5-8a69-4e16-884e-aaccb2d5c083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:32.773881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47167ae5-8a69-4e16-884e-aaccb2d5c083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:32.775297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47167ae5-8a69-4e16-884e-aaccb2d5c083 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:32.786874 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1102/2215] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:35.953569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fe675-23e5-4abf-ab7e-90185f21011e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:35.954085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fe675-23e5-4abf-ab7e-90185f21011e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:35.954085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fe675-23e5-4abf-ab7e-90185f21011e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:35.974441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-c46fe675-23e5-4abf-ab7e-90185f21011e None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:35.975570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c46fe675-23e5-4abf-ab7e-90185f21011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:36.042402 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1114/2216] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:23:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:36.055451 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47167ae5-8a69-4e16-884e-aaccb2d5c083 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:36.057532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-47167ae5-8a69-4e16-884e-aaccb2d5c083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:36.130722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47167ae5-8a69-4e16-884e-aaccb2d5c083 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:36.137012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e2b62-ff94-41b6-9705-7002ddbf4bca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:36.137621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e2b62-ff94-41b6-9705-7002ddbf4bca service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:36.137909 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e2b62-ff94-41b6-9705-7002ddbf4bca service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:36.138168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e2b62-ff94-41b6-9705-7002ddbf4bca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:36.146969 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e2b62-ff94-41b6-9705-7002ddbf4bca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:36.148624 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e2b62-ff94-41b6-9705-7002ddbf4bca service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:36.157116 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1103/2217] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:23:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:23:46.034871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=65 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:46.153867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=67 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:53.725225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a7f7-f2d3-462d-b21f-d1d7d23ff20e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:53.725773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a7f7-f2d3-462d-b21f-d1d7d23ff20e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:53.725773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3a7f7-f2d3-462d-b21f-d1d7d23ff20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:53.745224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-54f3a7f7-f2d3-462d-b21f-d1d7d23ff20e None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:53.746442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-54f3a7f7-f2d3-462d-b21f-d1d7d23ff20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:53.757191 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1115/2218] 10.222.0.50 () {58 vars in 967 bytes} [Wed Aug 31 00:23:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:53.780712 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e2b62-ff94-41b6-9705-7002ddbf4bca service swift] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:53.792629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e2b62-ff94-41b6-9705-7002ddbf4bca service swift] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:53.798311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce61041-1557-4185-b4f6-edef70f5755d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:53.798934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce61041-1557-4185-b4f6-edef70f5755d service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:53.799222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce61041-1557-4185-b4f6-edef70f5755d service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:53.799507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce61041-1557-4185-b4f6-edef70f5755d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:53.807951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce61041-1557-4185-b4f6-edef70f5755d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:53.809551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce61041-1557-4185-b4f6-edef70f5755d service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:53.818985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1104/2219] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:23:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:24:03.741844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:03.815580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=6 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:07.225855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66ce16-9e84-409f-bc6e-ad00aef5d1ce None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:07.226356 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66ce16-9e84-409f-bc6e-ad00aef5d1ce None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:07.226356 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66ce16-9e84-409f-bc6e-ad00aef5d1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:07.247751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-8e66ce16-9e84-409f-bc6e-ad00aef5d1ce None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:07.248981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-8e66ce16-9e84-409f-bc6e-ad00aef5d1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:07.257882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1116/2220] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 00:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:07.309287 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce61041-1557-4185-b4f6-edef70f5755d service swift] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:07.312077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2ce61041-1557-4185-b4f6-edef70f5755d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:07.333745 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce61041-1557-4185-b4f6-edef70f5755d service swift] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:07.340284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da25cfd-a61c-4476-8bb2-581bd3ac8e5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:07.340890 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da25cfd-a61c-4476-8bb2-581bd3ac8e5d service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:07.341170 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da25cfd-a61c-4476-8bb2-581bd3ac8e5d service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:07.341460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da25cfd-a61c-4476-8bb2-581bd3ac8e5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:07.349833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da25cfd-a61c-4476-8bb2-581bd3ac8e5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:07.351434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da25cfd-a61c-4476-8bb2-581bd3ac8e5d service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:07.361285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1105/2221] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:10.361536 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01eeda-fa27-4c7a-a6f9-b45a1bb13a50 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:10.362079 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01eeda-fa27-4c7a-a6f9-b45a1bb13a50 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:10.362079 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01eeda-fa27-4c7a-a6f9-b45a1bb13a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:10.383255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-6b01eeda-fa27-4c7a-a6f9-b45a1bb13a50 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:10.384534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6b01eeda-fa27-4c7a-a6f9-b45a1bb13a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:10.394366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1117/2222] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 00:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:10.419149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da25cfd-a61c-4476-8bb2-581bd3ac8e5d service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:10.421331 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8da25cfd-a61c-4476-8bb2-581bd3ac8e5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:10.442209 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da25cfd-a61c-4476-8bb2-581bd3ac8e5d service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:10.449461 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95168b09-0c8c-4f16-a47a-3bb00f7481f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:10.450238 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95168b09-0c8c-4f16-a47a-3bb00f7481f2 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:10.450569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95168b09-0c8c-4f16-a47a-3bb00f7481f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:10.450841 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95168b09-0c8c-4f16-a47a-3bb00f7481f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:10.460200 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95168b09-0c8c-4f16-a47a-3bb00f7481f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:10.461915 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95168b09-0c8c-4f16-a47a-3bb00f7481f2 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:10.471957 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1106/2223] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:14.592270 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01eeda-fa27-4c7a-a6f9-b45a1bb13a50 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:14.594053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6b01eeda-fa27-4c7a-a6f9-b45a1bb13a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:14.668129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01eeda-fa27-4c7a-a6f9-b45a1bb13a50 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:14.674637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb82be-202e-4f19-809d-3f93d2908257 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01dd2631a81402d8a5bba7007c7fd61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:14.675366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb82be-202e-4f19-809d-3f93d2908257 service placement] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:14.675727 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb82be-202e-4f19-809d-3f93d2908257 service placement] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:14.676066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb82be-202e-4f19-809d-3f93d2908257 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:14.677914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-05bb82be-202e-4f19-809d-3f93d2908257 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:14.690335 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb82be-202e-4f19-809d-3f93d2908257 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:14.692689 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb82be-202e-4f19-809d-3f93d2908257 service placement] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:14.704348 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1118/2224] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:14.736819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132928d9-a149-4e03-b667-069ea45e1843 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:14.737317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132928d9-a149-4e03-b667-069ea45e1843 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:14.737427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132928d9-a149-4e03-b667-069ea45e1843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:14.769790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-132928d9-a149-4e03-b667-069ea45e1843 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:14.771279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-132928d9-a149-4e03-b667-069ea45e1843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:14.779978 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1107/2225] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 00:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:14.803166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb82be-202e-4f19-809d-3f93d2908257 service placement] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:14.815838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb82be-202e-4f19-809d-3f93d2908257 service placement] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:14.822471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5824c7-4762-42a9-a027-a06073332711 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:14.823310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5824c7-4762-42a9-a027-a06073332711 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:14.823797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5824c7-4762-42a9-a027-a06073332711 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:14.824238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5824c7-4762-42a9-a027-a06073332711 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:14.835728 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5824c7-4762-42a9-a027-a06073332711 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:14.837525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5824c7-4762-42a9-a027-a06073332711 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:14.848437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1119/2226] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:18.838820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd68d5-45e0-483a-856e-be1eac49645e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:18.839380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd68d5-45e0-483a-856e-be1eac49645e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:18.839380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd68d5-45e0-483a-856e-be1eac49645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:18.860310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-16fd68d5-45e0-483a-856e-be1eac49645e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:18.861557 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-16fd68d5-45e0-483a-856e-be1eac49645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:18.870412 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1108/2227] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 00:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:18.924203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5824c7-4762-42a9-a027-a06073332711 service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:18.935812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5824c7-4762-42a9-a027-a06073332711 service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:18.942207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c0e76-e700-4fad-ac1c-f82772ee7ae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:18.942794 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c0e76-e700-4fad-ac1c-f82772ee7ae9 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:18.943073 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c0e76-e700-4fad-ac1c-f82772ee7ae9 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:18.943342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c0e76-e700-4fad-ac1c-f82772ee7ae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:18.951759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c0e76-e700-4fad-ac1c-f82772ee7ae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:18.953352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c0e76-e700-4fad-ac1c-f82772ee7ae9 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:18.963189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1120/2228] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:22.057021 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17707c5f-b626-46a7-86bc-f8dc09d35a44 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:22.057821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17707c5f-b626-46a7-86bc-f8dc09d35a44 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:22.058011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17707c5f-b626-46a7-86bc-f8dc09d35a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:22.081002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-17707c5f-b626-46a7-86bc-f8dc09d35a44 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:22.082223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-17707c5f-b626-46a7-86bc-f8dc09d35a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:22.091724 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1109/2229] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 00:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:22.113981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c0e76-e700-4fad-ac1c-f82772ee7ae9 service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:22.126422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c0e76-e700-4fad-ac1c-f82772ee7ae9 service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:22.133389 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329fdb4-4829-457d-a865-12b82ff473dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:22.134016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329fdb4-4829-457d-a865-12b82ff473dd service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:22.134286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329fdb4-4829-457d-a865-12b82ff473dd service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:22.134554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329fdb4-4829-457d-a865-12b82ff473dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:22.146788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329fdb4-4829-457d-a865-12b82ff473dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:22.148442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329fdb4-4829-457d-a865-12b82ff473dd service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:22.158663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1121/2230] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:26.264102 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e981e-54ea-4cfb-a8fb-037a8f40d7e4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:26.264815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e981e-54ea-4cfb-a8fb-037a8f40d7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:26.264815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e981e-54ea-4cfb-a8fb-037a8f40d7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:26.299034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c95e981e-54ea-4cfb-a8fb-037a8f40d7e4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:26.300279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c95e981e-54ea-4cfb-a8fb-037a8f40d7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:26.308937 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1110/2231] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 00:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:26.332148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329fdb4-4829-457d-a865-12b82ff473dd service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:26.343468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329fdb4-4829-457d-a865-12b82ff473dd service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:26.349597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14388fb-38be-4134-863f-142576c6a152 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:26.350193 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14388fb-38be-4134-863f-142576c6a152 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:26.350670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14388fb-38be-4134-863f-142576c6a152 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:26.350929 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14388fb-38be-4134-863f-142576c6a152 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:26.360116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14388fb-38be-4134-863f-142576c6a152 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:26.362130 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14388fb-38be-4134-863f-142576c6a152 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:26.373033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1122/2232] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:32.873204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d58993-a721-4f96-a7c8-bdba4d47fc83 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:32.873683 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d58993-a721-4f96-a7c8-bdba4d47fc83 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:32.873792 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d58993-a721-4f96-a7c8-bdba4d47fc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:32.893456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d7d58993-a721-4f96-a7c8-bdba4d47fc83 None None] MFA Rules not processed for user `1aeead6fcbc54b39826b5da033dd9d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:32.894666 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d7d58993-a721-4f96-a7c8-bdba4d47fc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:32.950029 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1111/2233] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:24:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:36.368302 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=62 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:42.942628 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=49 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:43.778398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18e8f9-602d-410f-8cc2-412dc8638339 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:43.778964 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18e8f9-602d-410f-8cc2-412dc8638339 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:43.779136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18e8f9-602d-410f-8cc2-412dc8638339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:43.804253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-df18e8f9-602d-410f-8cc2-412dc8638339 None None] MFA Rules not processed for user `f274525bbcd54376bae92e37d76b0af4`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:43.805591 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-df18e8f9-602d-410f-8cc2-412dc8638339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:43.813513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1123/2234] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:24:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:50.349126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69253dad-9000-48f9-87a5-3e055ddd5100 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:50.349647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69253dad-9000-48f9-87a5-3e055ddd5100 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:50.349732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69253dad-9000-48f9-87a5-3e055ddd5100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:50.373172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-69253dad-9000-48f9-87a5-3e055ddd5100 None None] MFA Rules not processed for user `7b05f63c8a054e6dbfe70a70c50805cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:50.374464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-69253dad-9000-48f9-87a5-3e055ddd5100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:50.447956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1112/2235] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:24:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:53.796613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:53.912594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328b6a7-e029-4f9c-a7a4-4680d6372075 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:53.912958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328b6a7-e029-4f9c-a7a4-4680d6372075 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:53.913310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328b6a7-e029-4f9c-a7a4-4680d6372075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:53.933677 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-6328b6a7-e029-4f9c-a7a4-4680d6372075 None None] MFA Rules not processed for user `f73759f32c794f20bbab3a9887c9d37c`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:53.934901 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6328b6a7-e029-4f9c-a7a4-4680d6372075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:53.997453 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1124/2236] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:24:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:00.436105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=25 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:03.990717 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=25 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:07.921785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963654d-4415-4f21-866a-ed61c7910f63 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:07.922341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963654d-4415-4f21-866a-ed61c7910f63 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:07.922341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963654d-4415-4f21-866a-ed61c7910f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:07.942983 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-6963654d-4415-4f21-866a-ed61c7910f63 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:07.944243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6963654d-4415-4f21-866a-ed61c7910f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:07.952667 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1113/2237] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 00:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:07.989025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328b6a7-e029-4f9c-a7a4-4680d6372075 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:08.003304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328b6a7-e029-4f9c-a7a4-4680d6372075 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:08.009695 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd338bc-8bd0-471b-9e36-c5aa29789386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:08.010311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd338bc-8bd0-471b-9e36-c5aa29789386 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:08.010593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd338bc-8bd0-471b-9e36-c5aa29789386 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:08.010861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd338bc-8bd0-471b-9e36-c5aa29789386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:08.019504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd338bc-8bd0-471b-9e36-c5aa29789386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:08.021209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd338bc-8bd0-471b-9e36-c5aa29789386 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:08.031070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1125/2238] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:12.249053 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bfb70-c522-461c-ae74-dc55b653d1d9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:12.249535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bfb70-c522-461c-ae74-dc55b653d1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:12.249535 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bfb70-c522-461c-ae74-dc55b653d1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:12.270433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-897bfb70-c522-461c-ae74-dc55b653d1d9 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:12.271651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-897bfb70-c522-461c-ae74-dc55b653d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:12.281609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1114/2239] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 00:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:12.306958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd338bc-8bd0-471b-9e36-c5aa29789386 service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:12.318709 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd338bc-8bd0-471b-9e36-c5aa29789386 service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:12.325360 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f3762-1cf4-4a6b-887a-2ea1fe729d6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:12.325941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f3762-1cf4-4a6b-887a-2ea1fe729d6e service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:12.326201 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f3762-1cf4-4a6b-887a-2ea1fe729d6e service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:12.326468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f3762-1cf4-4a6b-887a-2ea1fe729d6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:12.335465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f3762-1cf4-4a6b-887a-2ea1fe729d6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:12.337102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f3762-1cf4-4a6b-887a-2ea1fe729d6e service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:12.346598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1126/2240] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:15.359575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04704afd-a54c-44cf-be67-d136e0bd11bc None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:15.360427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04704afd-a54c-44cf-be67-d136e0bd11bc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:15.360628 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04704afd-a54c-44cf-be67-d136e0bd11bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:15.390315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-04704afd-a54c-44cf-be67-d136e0bd11bc None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:15.391566 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-04704afd-a54c-44cf-be67-d136e0bd11bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:15.400298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1115/2241] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 00:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:15.426333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f3762-1cf4-4a6b-887a-2ea1fe729d6e service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:15.438723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f3762-1cf4-4a6b-887a-2ea1fe729d6e service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:15.445263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533c8fd-9fe6-4bdf-abc6-b44722ee955e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:15.445891 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533c8fd-9fe6-4bdf-abc6-b44722ee955e service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:15.446151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533c8fd-9fe6-4bdf-abc6-b44722ee955e service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:15.446421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533c8fd-9fe6-4bdf-abc6-b44722ee955e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:15.455654 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533c8fd-9fe6-4bdf-abc6-b44722ee955e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:15.457314 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533c8fd-9fe6-4bdf-abc6-b44722ee955e service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:15.468975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1127/2242] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:20.558727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190cfee-82e6-4655-a36c-57146d56f1af None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:20.559614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190cfee-82e6-4655-a36c-57146d56f1af None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:20.559932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190cfee-82e6-4655-a36c-57146d56f1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:20.580591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7190cfee-82e6-4655-a36c-57146d56f1af None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:20.582105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7190cfee-82e6-4655-a36c-57146d56f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:20.591015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1116/2243] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 00:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:20.612409 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533c8fd-9fe6-4bdf-abc6-b44722ee955e service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:20.624012 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533c8fd-9fe6-4bdf-abc6-b44722ee955e service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:20.630971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c61225-17ca-4feb-b169-b3e5963098df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:20.631566 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c61225-17ca-4feb-b169-b3e5963098df service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:20.631898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c61225-17ca-4feb-b169-b3e5963098df service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:20.632189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c61225-17ca-4feb-b169-b3e5963098df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:20.640981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c61225-17ca-4feb-b169-b3e5963098df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:20.642588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c61225-17ca-4feb-b169-b3e5963098df service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:20.655873 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1128/2244] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:23.777003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6495381-76a7-4b9a-82a6-7a7a2663df6a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:23.777612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6495381-76a7-4b9a-82a6-7a7a2663df6a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:23.777612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6495381-76a7-4b9a-82a6-7a7a2663df6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:23.800996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e6495381-76a7-4b9a-82a6-7a7a2663df6a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:23.802243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e6495381-76a7-4b9a-82a6-7a7a2663df6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:23.810342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1117/2245] 10.222.0.66 () {58 vars in 1016 bytes} [Wed Aug 31 00:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:23.837583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c61225-17ca-4feb-b169-b3e5963098df service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:23.858144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c61225-17ca-4feb-b169-b3e5963098df service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:23.863960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba65d44-396e-4c9c-b321-3944df08c76d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:23.864586 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba65d44-396e-4c9c-b321-3944df08c76d service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:23.864867 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba65d44-396e-4c9c-b321-3944df08c76d service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:23.865177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba65d44-396e-4c9c-b321-3944df08c76d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:23.874422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba65d44-396e-4c9c-b321-3944df08c76d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:23.876167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba65d44-396e-4c9c-b321-3944df08c76d service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:23.886186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1129/2246] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:25.828631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb6dbf-c095-4a90-8fdc-5f4fd4250482 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:25.829237 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb6dbf-c095-4a90-8fdc-5f4fd4250482 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:25.829237 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb6dbf-c095-4a90-8fdc-5f4fd4250482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:25.848475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-8bfb6dbf-c095-4a90-8fdc-5f4fd4250482 None None] MFA Rules not processed for user `0ae3ab8ab42b40739a90121bcbeaba2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:25.849663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8bfb6dbf-c095-4a90-8fdc-5f4fd4250482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:25.908159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1118/2247] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:25:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:33.881678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=30 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:35.900863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=40 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:49.275534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba65d44-396e-4c9c-b321-3944df08c76d service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:49.287628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba65d44-396e-4c9c-b321-3944df08c76d service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:49.292239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe6275-67e3-4faf-b464-b5381fa510c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:49.292847 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe6275-67e3-4faf-b464-b5381fa510c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:49.293120 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe6275-67e3-4faf-b464-b5381fa510c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:49.293400 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe6275-67e3-4faf-b464-b5381fa510c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:49.295123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-95fe6275-67e3-4faf-b464-b5381fa510c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:49.309443 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe6275-67e3-4faf-b464-b5381fa510c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:49.310957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe6275-67e3-4faf-b464-b5381fa510c2 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:49.322240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1130/2248] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:50.274348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb6dbf-c095-4a90-8fdc-5f4fd4250482 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:50.284297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb6dbf-c095-4a90-8fdc-5f4fd4250482 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:50.287814 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7516c-5aac-4e7f-bc7e-dc934b3da9de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:50.288423 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7516c-5aac-4e7f-bc7e-dc934b3da9de service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:50.288693 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7516c-5aac-4e7f-bc7e-dc934b3da9de service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:50.288960 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7516c-5aac-4e7f-bc7e-dc934b3da9de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:50.290658 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-42e7516c-5aac-4e7f-bc7e-dc934b3da9de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:50.304527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7516c-5aac-4e7f-bc7e-dc934b3da9de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:50.305943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7516c-5aac-4e7f-bc7e-dc934b3da9de service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:50.316877 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1119/2249] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:53.795557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe6275-67e3-4faf-b464-b5381fa510c2 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:53.815208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe6275-67e3-4faf-b464-b5381fa510c2 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:53.820598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045725b1-2389-403b-8617-909123bd9491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:53.821252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045725b1-2389-403b-8617-909123bd9491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:53.821528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045725b1-2389-403b-8617-909123bd9491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:53.821900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045725b1-2389-403b-8617-909123bd9491 admin admin] PATH_INFO: `/v3/users/f274525bbcd54376bae92e37d76b0af4` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:53.822918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045725b1-2389-403b-8617-909123bd9491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f274525bbcd54376bae92e37d76b0af4)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:53.825060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045725b1-2389-403b-8617-909123bd9491 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:53.886006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-045725b1-2389-403b-8617-909123bd9491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f274525bbcd54376bae92e37d76b0af4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:53.904129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-045725b1-2389-403b-8617-909123bd9491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f274525bbcd54376bae92e37d76b0af4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:53.921734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-045725b1-2389-403b-8617-909123bd9491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f274525bbcd54376bae92e37d76b0af4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:53.945408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-045725b1-2389-403b-8617-909123bd9491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f274525bbcd54376bae92e37d76b0af4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:53.946178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-045725b1-2389-403b-8617-909123bd9491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f274525bbcd54376bae92e37d76b0af4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:53.954027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1131/2250] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:25:53 2022] DELETE /identity/v3/users/f274525bbcd54376bae92e37d76b0af4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:54.172759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7516c-5aac-4e7f-bc7e-dc934b3da9de service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:54.211023 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7516c-5aac-4e7f-bc7e-dc934b3da9de service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:54.276588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea72090-7fdd-444d-b147-2e8e2c5080c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:54.277261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72090-7fdd-444d-b147-2e8e2c5080c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:54.277538 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72090-7fdd-444d-b147-2e8e2c5080c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:54.277811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72090-7fdd-444d-b147-2e8e2c5080c6 admin admin] PATH_INFO: `/v3/projects/c6b0cc5db23c49a8aba66d0b7891a2c6` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:54.278924 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea72090-7fdd-444d-b147-2e8e2c5080c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b0cc5db23c49a8aba66d0b7891a2c6)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:54.281077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea72090-7fdd-444d-b147-2e8e2c5080c6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:54.354804 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4ea72090-7fdd-444d-b147-2e8e2c5080c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b0cc5db23c49a8aba66d0b7891a2c6', 'request_id': 'req-4ea72090-7fdd-444d-b147-2e8e2c5080c6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.379325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4ea72090-7fdd-444d-b147-2e8e2c5080c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b0cc5db23c49a8aba66d0b7891a2c6', 'request_id': 'req-4ea72090-7fdd-444d-b147-2e8e2c5080c6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.386633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4ea72090-7fdd-444d-b147-2e8e2c5080c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b0cc5db23c49a8aba66d0b7891a2c6', 'request_id': 'req-4ea72090-7fdd-444d-b147-2e8e2c5080c6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.398507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4ea72090-7fdd-444d-b147-2e8e2c5080c6 admin admin] The token cache is being invalidate because project c6b0cc5db23c49a8aba66d0b7891a2c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:25:54.398792 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4ea72090-7fdd-444d-b147-2e8e2c5080c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.399445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4ea72090-7fdd-444d-b147-2e8e2c5080c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:25:54.400967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1120/2251] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:25:54 2022] DELETE /identity/v3/projects/c6b0cc5db23c49a8aba66d0b7891a2c6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:54.405991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d039fa-1c4b-4743-a937-654a22fe70f3 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:54.406278 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d039fa-1c4b-4743-a937-654a22fe70f3 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:54.406610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d039fa-1c4b-4743-a937-654a22fe70f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:54.428561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-74d039fa-1c4b-4743-a937-654a22fe70f3 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:54.429766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-74d039fa-1c4b-4743-a937-654a22fe70f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:54.491513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1132/2252] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:54.499451 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945fd93-ad42-45f2-abf0-1b8b9dc6bd2a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:54.499764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945fd93-ad42-45f2-abf0-1b8b9dc6bd2a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:54.500039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945fd93-ad42-45f2-abf0-1b8b9dc6bd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:54.521537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7945fd93-ad42-45f2-abf0-1b8b9dc6bd2a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:54.522072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7945fd93-ad42-45f2-abf0-1b8b9dc6bd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:54.530239 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1121/2253] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:54.534364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d039fa-1c4b-4743-a937-654a22fe70f3 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:54.544220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d039fa-1c4b-4743-a937-654a22fe70f3 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:54.549229 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4d165-604f-4d31-b8c8-12a369acb9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:54.549837 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4d165-604f-4d31-b8c8-12a369acb9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:54.550119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4d165-604f-4d31-b8c8-12a369acb9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:54.550390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4d165-604f-4d31-b8c8-12a369acb9b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:54.551030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4d165-604f-4d31-b8c8-12a369acb9b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:25:54.551359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4d165-604f-4d31-b8c8-12a369acb9b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:54.553033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4d165-604f-4d31-b8c8-12a369acb9b6 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:54.564936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1133/2254] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:25:54.569346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945fd93-ad42-45f2-abf0-1b8b9dc6bd2a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:54.579521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945fd93-ad42-45f2-abf0-1b8b9dc6bd2a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:54.585947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e46055-9d1f-4602-84fb-711fc67322e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:54.586813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e46055-9d1f-4602-84fb-711fc67322e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:54.587094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e46055-9d1f-4602-84fb-711fc67322e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:54.587363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e46055-9d1f-4602-84fb-711fc67322e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:54.588046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e46055-9d1f-4602-84fb-711fc67322e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:54.590007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e46055-9d1f-4602-84fb-711fc67322e5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:54.625311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1122/2255] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:25:54 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:25:54.626777 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4d165-604f-4d31-b8c8-12a369acb9b6 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:54.637134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4d165-604f-4d31-b8c8-12a369acb9b6 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:54.685691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:54.700684 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738347f-7634-4478-a235-2bc0e4828270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:54.701671 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738347f-7634-4478-a235-2bc0e4828270 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:54.701954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738347f-7634-4478-a235-2bc0e4828270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:54.702230 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738347f-7634-4478-a235-2bc0e4828270 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:54.702870 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738347f-7634-4478-a235-2bc0e4828270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:54.705233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738347f-7634-4478-a235-2bc0e4828270 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:54.727102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1134/2256] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:25:54 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:25:54.732076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e46055-9d1f-4602-84fb-711fc67322e5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:54.758593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e46055-9d1f-4602-84fb-711fc67322e5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:54.763881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7335053-c7a1-4a98-a5d6-a27823a100f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:54.764674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7335053-c7a1-4a98-a5d6-a27823a100f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:54.765118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7335053-c7a1-4a98-a5d6-a27823a100f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:54.765531 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7335053-c7a1-4a98-a5d6-a27823a100f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:54.766322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7335053-c7a1-4a98-a5d6-a27823a100f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:54.768217 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7335053-c7a1-4a98-a5d6-a27823a100f9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:54.779785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1123/2257] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:25:54.784506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738347f-7634-4478-a235-2bc0e4828270 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:54.797398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738347f-7634-4478-a235-2bc0e4828270 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:54.804138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bca9b4-f951-4f71-acd4-3f1e60229126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:54.804758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bca9b4-f951-4f71-acd4-3f1e60229126 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:54.805037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bca9b4-f951-4f71-acd4-3f1e60229126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:54.805309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bca9b4-f951-4f71-acd4-3f1e60229126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:54.806027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bca9b4-f951-4f71-acd4-3f1e60229126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:54.807619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bca9b4-f951-4f71-acd4-3f1e60229126 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:54.819660 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1135/2258] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:25:54.823793 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7335053-c7a1-4a98-a5d6-a27823a100f9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:54.834825 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7335053-c7a1-4a98-a5d6-a27823a100f9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:54.839462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991b830-17c8-4cb1-a3be-ed80a099c4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:54.840164 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991b830-17c8-4cb1-a3be-ed80a099c4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:54.840444 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991b830-17c8-4cb1-a3be-ed80a099c4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:54.840720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991b830-17c8-4cb1-a3be-ed80a099c4ba admin admin] PATH_INFO: `/v3/projects/371f48682f084a5cbb031f30157011fd/users/41b5c1224733416dadb4bfb80f17c059/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:54.856702 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991b830-17c8-4cb1-a3be-ed80a099c4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=371f48682f084a5cbb031f30157011fd, user_id=41b5c1224733416dadb4bfb80f17c059, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:54.859376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991b830-17c8-4cb1-a3be-ed80a099c4ba admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:54.874455 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1124/2259] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:25:54 2022] PUT /identity/v3/projects/371f48682f084a5cbb031f30157011fd/users/41b5c1224733416dadb4bfb80f17c059/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:25:54.886342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc562f-8c1f-4cf8-b9f4-bcd792337fb2 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:54.886620 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc562f-8c1f-4cf8-b9f4-bcd792337fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:54.886991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc562f-8c1f-4cf8-b9f4-bcd792337fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:54.932018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-35fc562f-8c1f-4cf8-b9f4-bcd792337fb2 None None] MFA Rules not processed for user `41b5c1224733416dadb4bfb80f17c059`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:54.933335 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-35fc562f-8c1f-4cf8-b9f4-bcd792337fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:55.042427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1136/2260] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:25:54 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:55.055395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991b830-17c8-4cb1-a3be-ed80a099c4ba admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:55.057250 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c991b830-17c8-4cb1-a3be-ed80a099c4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:55.073882 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:55.123397 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991b830-17c8-4cb1-a3be-ed80a099c4ba admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:55.128434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9342a30-6062-4548-b65d-79a87761b711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:55.132043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9342a30-6062-4548-b65d-79a87761b711 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:55.132043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9342a30-6062-4548-b65d-79a87761b711 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:55.132043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9342a30-6062-4548-b65d-79a87761b711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:55.143472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9342a30-6062-4548-b65d-79a87761b711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:55.143472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9342a30-6062-4548-b65d-79a87761b711 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:55.154592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1125/2261] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:55 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:56.076637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e96f1c-de6b-4f44-9739-66739804223a None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:56.077270 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e96f1c-de6b-4f44-9739-66739804223a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:56.077270 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e96f1c-de6b-4f44-9739-66739804223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:56.099300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-d2e96f1c-de6b-4f44-9739-66739804223a None None] MFA Rules not processed for user `1aeead6fcbc54b39826b5da033dd9d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:56.100585 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d2e96f1c-de6b-4f44-9739-66739804223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:56.171079 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1137/2262] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:25:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:00.268472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9342a30-6062-4548-b65d-79a87761b711 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:00.336109 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9342a30-6062-4548-b65d-79a87761b711 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:00.341680 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ace1ca-5bc1-4f28-8279-1e656acb30ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:00.342378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace1ca-5bc1-4f28-8279-1e656acb30ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:00.342811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace1ca-5bc1-4f28-8279-1e656acb30ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:00.343103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace1ca-5bc1-4f28-8279-1e656acb30ff admin admin] PATH_INFO: `/v3/users/41b5c1224733416dadb4bfb80f17c059` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:00.344473 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ace1ca-5bc1-4f28-8279-1e656acb30ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b5c1224733416dadb4bfb80f17c059)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:00.346710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ace1ca-5bc1-4f28-8279-1e656acb30ff admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:00.400225 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-75ace1ca-5bc1-4f28-8279-1e656acb30ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b5c1224733416dadb4bfb80f17c059'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:00.419952 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-75ace1ca-5bc1-4f28-8279-1e656acb30ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b5c1224733416dadb4bfb80f17c059'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:00.428589 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-75ace1ca-5bc1-4f28-8279-1e656acb30ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b5c1224733416dadb4bfb80f17c059'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:00.443630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-75ace1ca-5bc1-4f28-8279-1e656acb30ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b5c1224733416dadb4bfb80f17c059'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:00.444306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-75ace1ca-5bc1-4f28-8279-1e656acb30ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b5c1224733416dadb4bfb80f17c059'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:00.451279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1126/2263] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:00 2022] DELETE /identity/v3/users/41b5c1224733416dadb4bfb80f17c059 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:00.455667 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4f595-e7d6-4a92-ad95-67bc88840023 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:00.456525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4f595-e7d6-4a92-ad95-67bc88840023 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:00.456968 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4f595-e7d6-4a92-ad95-67bc88840023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:00.481088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-06a4f595-e7d6-4a92-ad95-67bc88840023 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:00.482352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-06a4f595-e7d6-4a92-ad95-67bc88840023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:00.540513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:00.554283 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1138/2264] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:00.562887 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ace1ca-5bc1-4f28-8279-1e656acb30ff admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:00.565239 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-75ace1ca-5bc1-4f28-8279-1e656acb30ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:00.610686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:00.634297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ace1ca-5bc1-4f28-8279-1e656acb30ff admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:00.638936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3d364-165b-46bb-b141-56113ab3776c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:00.639668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3d364-165b-46bb-b141-56113ab3776c service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:00.640177 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3d364-165b-46bb-b141-56113ab3776c service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:00.640547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3d364-165b-46bb-b141-56113ab3776c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:00.652689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3d364-165b-46bb-b141-56113ab3776c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:00.654136 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3d364-165b-46bb-b141-56113ab3776c service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:00.665569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1127/2265] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:01.068791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4f595-e7d6-4a92-ad95-67bc88840023 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:01.070442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-06a4f595-e7d6-4a92-ad95-67bc88840023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:01.084502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4f595-e7d6-4a92-ad95-67bc88840023 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:01.084660 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3d364-165b-46bb-b141-56113ab3776c service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:01.086224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-afc3d364-165b-46bb-b141-56113ab3776c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:01.088274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54314f2b-aad3-44bf-be41-292b08e9c0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:01.089096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54314f2b-aad3-44bf-be41-292b08e9c0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:01.089894 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54314f2b-aad3-44bf-be41-292b08e9c0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:01.090178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54314f2b-aad3-44bf-be41-292b08e9c0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:01.092096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-54314f2b-aad3-44bf-be41-292b08e9c0e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:01.101660 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3d364-165b-46bb-b141-56113ab3776c service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:01.107142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54314f2b-aad3-44bf-be41-292b08e9c0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:01.107291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:01.107873 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:01.108156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:01.108433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] PATH_INFO: `/v3/projects/371f48682f084a5cbb031f30157011fd` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:01.108630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54314f2b-aad3-44bf-be41-292b08e9c0e2 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:01.109767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=371f48682f084a5cbb031f30157011fd)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:01.120685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1139/2266] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:01.122218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:01.181393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371f48682f084a5cbb031f30157011fd', 'request_id': 'req-6c64a83c-49ce-461f-902b-c1388eb30921'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.190901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371f48682f084a5cbb031f30157011fd', 'request_id': 'req-6c64a83c-49ce-461f-902b-c1388eb30921'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.202726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371f48682f084a5cbb031f30157011fd', 'request_id': 'req-6c64a83c-49ce-461f-902b-c1388eb30921'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.215445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] The token cache is being invalidate because project 371f48682f084a5cbb031f30157011fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:01.215765 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.216447 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:01.217972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1128/2267] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:01 2022] DELETE /identity/v3/projects/371f48682f084a5cbb031f30157011fd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:05.551890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54314f2b-aad3-44bf-be41-292b08e9c0e2 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:05.553450 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-54314f2b-aad3-44bf-be41-292b08e9c0e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:05.566847 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54314f2b-aad3-44bf-be41-292b08e9c0e2 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:05.626738 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef210a-7bcf-4824-bd3c-fc42405f909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:05.627680 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef210a-7bcf-4824-bd3c-fc42405f909d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:05.628144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef210a-7bcf-4824-bd3c-fc42405f909d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:05.628504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef210a-7bcf-4824-bd3c-fc42405f909d admin admin] PATH_INFO: `/v3/users/7b05f63c8a054e6dbfe70a70c50805cf` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:05.629996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef210a-7bcf-4824-bd3c-fc42405f909d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b05f63c8a054e6dbfe70a70c50805cf)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:05.631974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef210a-7bcf-4824-bd3c-fc42405f909d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:05.683976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b5ef210a-7bcf-4824-bd3c-fc42405f909d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b05f63c8a054e6dbfe70a70c50805cf'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.696858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b5ef210a-7bcf-4824-bd3c-fc42405f909d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b05f63c8a054e6dbfe70a70c50805cf'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.704138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b5ef210a-7bcf-4824-bd3c-fc42405f909d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b05f63c8a054e6dbfe70a70c50805cf'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.714587 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b5ef210a-7bcf-4824-bd3c-fc42405f909d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b05f63c8a054e6dbfe70a70c50805cf'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.715287 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b5ef210a-7bcf-4824-bd3c-fc42405f909d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b05f63c8a054e6dbfe70a70c50805cf'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:05.721456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1140/2268] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:05 2022] DELETE /identity/v3/users/7b05f63c8a054e6dbfe70a70c50805cf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:05.910259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:05.912306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:05.926256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64a83c-49ce-461f-902b-c1388eb30921 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:05.984972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e45e2f-bb89-409b-961f-1bd6269378b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:05.985762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e45e2f-bb89-409b-961f-1bd6269378b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:05.986045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e45e2f-bb89-409b-961f-1bd6269378b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:05.986319 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e45e2f-bb89-409b-961f-1bd6269378b5 admin admin] PATH_INFO: `/v3/projects/15e73c3a609b4314a4ae2437ad21333d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:05.987623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e45e2f-bb89-409b-961f-1bd6269378b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e73c3a609b4314a4ae2437ad21333d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:05.989629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e45e2f-bb89-409b-961f-1bd6269378b5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.040366 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-17e45e2f-bb89-409b-961f-1bd6269378b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e73c3a609b4314a4ae2437ad21333d', 'request_id': 'req-17e45e2f-bb89-409b-961f-1bd6269378b5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.051043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-17e45e2f-bb89-409b-961f-1bd6269378b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e73c3a609b4314a4ae2437ad21333d', 'request_id': 'req-17e45e2f-bb89-409b-961f-1bd6269378b5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.056655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:06.058015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-17e45e2f-bb89-409b-961f-1bd6269378b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e73c3a609b4314a4ae2437ad21333d', 'request_id': 'req-17e45e2f-bb89-409b-961f-1bd6269378b5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.070916 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-17e45e2f-bb89-409b-961f-1bd6269378b5 admin admin] The token cache is being invalidate because project 15e73c3a609b4314a4ae2437ad21333d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:06.071241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-17e45e2f-bb89-409b-961f-1bd6269378b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.071924 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-17e45e2f-bb89-409b-961f-1bd6269378b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:06.073460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1129/2269] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:05 2022] DELETE /identity/v3/projects/15e73c3a609b4314a4ae2437ad21333d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:06.078584 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f3508-e3c2-491a-b3d2-fb1ef22fee18 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.078871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f3508-e3c2-491a-b3d2-fb1ef22fee18 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.079142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f3508-e3c2-491a-b3d2-fb1ef22fee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.098551 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-037f3508-e3c2-491a-b3d2-fb1ef22fee18 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:06.099810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-037f3508-e3c2-491a-b3d2-fb1ef22fee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:06.197032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1141/2270] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:06.199674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21cbb4-7e03-433c-922c-c98ab50f7973 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.200001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21cbb4-7e03-433c-922c-c98ab50f7973 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.200379 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21cbb4-7e03-433c-922c-c98ab50f7973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.224674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-db21cbb4-7e03-433c-922c-c98ab50f7973 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:06.226292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-db21cbb4-7e03-433c-922c-c98ab50f7973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:06.238601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1130/2271] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:06.240557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f3508-e3c2-491a-b3d2-fb1ef22fee18 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.253095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f3508-e3c2-491a-b3d2-fb1ef22fee18 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.258784 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c81a0-ee6d-4d8d-a4ab-1de53d63f532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.259408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c81a0-ee6d-4d8d-a4ab-1de53d63f532 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.259688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c81a0-ee6d-4d8d-a4ab-1de53d63f532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.259999 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c81a0-ee6d-4d8d-a4ab-1de53d63f532 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.260734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c81a0-ee6d-4d8d-a4ab-1de53d63f532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:06.261039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c81a0-ee6d-4d8d-a4ab-1de53d63f532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.262717 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c81a0-ee6d-4d8d-a4ab-1de53d63f532 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.264481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:06.275728 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1142/2272] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:06.280443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21cbb4-7e03-433c-922c-c98ab50f7973 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.289774 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21cbb4-7e03-433c-922c-c98ab50f7973 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.294616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3da19-b2da-484e-9e11-31392e3a3798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.295167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3da19-b2da-484e-9e11-31392e3a3798 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.295448 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3da19-b2da-484e-9e11-31392e3a3798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.295748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3da19-b2da-484e-9e11-31392e3a3798 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.296433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3da19-b2da-484e-9e11-31392e3a3798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.298715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3da19-b2da-484e-9e11-31392e3a3798 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.327969 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1131/2273] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:06 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:06.333742 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c81a0-ee6d-4d8d-a4ab-1de53d63f532 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.347955 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c81a0-ee6d-4d8d-a4ab-1de53d63f532 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.407004 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e32cc-72e4-4d74-9ad3-d36e6c0119c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.407611 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e32cc-72e4-4d74-9ad3-d36e6c0119c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.407930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e32cc-72e4-4d74-9ad3-d36e6c0119c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.408202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e32cc-72e4-4d74-9ad3-d36e6c0119c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.408836 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e32cc-72e4-4d74-9ad3-d36e6c0119c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.410819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e32cc-72e4-4d74-9ad3-d36e6c0119c0 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.433181 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1143/2274] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:06 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:06.437512 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3da19-b2da-484e-9e11-31392e3a3798 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.448750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3da19-b2da-484e-9e11-31392e3a3798 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.456340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd606da-fa15-4497-8725-f57adf088c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.457167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd606da-fa15-4497-8725-f57adf088c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.457486 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd606da-fa15-4497-8725-f57adf088c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.457764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd606da-fa15-4497-8725-f57adf088c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.458576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd606da-fa15-4497-8725-f57adf088c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.460389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd606da-fa15-4497-8725-f57adf088c20 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.471881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1132/2275] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:06.476490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e32cc-72e4-4d74-9ad3-d36e6c0119c0 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.489982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e32cc-72e4-4d74-9ad3-d36e6c0119c0 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.495430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f44d28-5191-49bc-8b8a-55903fbebd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.496100 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44d28-5191-49bc-8b8a-55903fbebd49 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.496375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44d28-5191-49bc-8b8a-55903fbebd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.496820 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44d28-5191-49bc-8b8a-55903fbebd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.497468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f44d28-5191-49bc-8b8a-55903fbebd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.499094 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f44d28-5191-49bc-8b8a-55903fbebd49 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.510916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1144/2276] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:06.515434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd606da-fa15-4497-8725-f57adf088c20 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.525854 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd606da-fa15-4497-8725-f57adf088c20 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.531052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7d072-6e97-4310-b6dd-9e96d8602b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.531809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7d072-6e97-4310-b6dd-9e96d8602b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.532090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7d072-6e97-4310-b6dd-9e96d8602b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.532363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7d072-6e97-4310-b6dd-9e96d8602b56 admin admin] PATH_INFO: `/v3/projects/5bf995cb2ec54c16b5436cbb43cf5622/users/2fb61ca2cb5e491d900e8a036e8b2356/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.548564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7d072-6e97-4310-b6dd-9e96d8602b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf995cb2ec54c16b5436cbb43cf5622, user_id=2fb61ca2cb5e491d900e8a036e8b2356, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.551137 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7d072-6e97-4310-b6dd-9e96d8602b56 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.565752 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1133/2277] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:06 2022] PUT /identity/v3/projects/5bf995cb2ec54c16b5436cbb43cf5622/users/2fb61ca2cb5e491d900e8a036e8b2356/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:06.576647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb58fb-e203-4dcd-b925-444405c80c4b None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.577113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb58fb-e203-4dcd-b925-444405c80c4b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.577257 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb58fb-e203-4dcd-b925-444405c80c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.605454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-38fb58fb-e203-4dcd-b925-444405c80c4b None None] MFA Rules not processed for user `2fb61ca2cb5e491d900e8a036e8b2356`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:06.606673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-38fb58fb-e203-4dcd-b925-444405c80c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:06.674830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1145/2278] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:06.679761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7d072-6e97-4310-b6dd-9e96d8602b56 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.752959 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7d072-6e97-4310-b6dd-9e96d8602b56 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.758871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d482a8-f13f-4216-815e-da1427aaad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.759484 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d482a8-f13f-4216-815e-da1427aaad4a admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.759800 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d482a8-f13f-4216-815e-da1427aaad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.760093 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d482a8-f13f-4216-815e-da1427aaad4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.760750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d482a8-f13f-4216-815e-da1427aaad4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.762696 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d482a8-f13f-4216-815e-da1427aaad4a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.808249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1134/2279] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:06 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:06.809511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb58fb-e203-4dcd-b925-444405c80c4b None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.821294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb58fb-e203-4dcd-b925-444405c80c4b None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.881301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2698f9b-7eac-4797-bdee-f2484ce5dec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.881903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698f9b-7eac-4797-bdee-f2484ce5dec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.882307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698f9b-7eac-4797-bdee-f2484ce5dec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.882580 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698f9b-7eac-4797-bdee-f2484ce5dec1 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.883200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2698f9b-7eac-4797-bdee-f2484ce5dec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.885400 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2698f9b-7eac-4797-bdee-f2484ce5dec1 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.894326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:06.911970 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1146/2280] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:06 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:06.916367 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d482a8-f13f-4216-815e-da1427aaad4a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.927345 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d482a8-f13f-4216-815e-da1427aaad4a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.932379 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee74eb8-b69b-4059-9007-10730997917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.932980 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee74eb8-b69b-4059-9007-10730997917b admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.933250 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee74eb8-b69b-4059-9007-10730997917b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.933529 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee74eb8-b69b-4059-9007-10730997917b admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.934177 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee74eb8-b69b-4059-9007-10730997917b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.935804 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee74eb8-b69b-4059-9007-10730997917b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:06.946297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1135/2281] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:06.950783 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2698f9b-7eac-4797-bdee-f2484ce5dec1 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:06.961423 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2698f9b-7eac-4797-bdee-f2484ce5dec1 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:06.967131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068c1c7-a4bc-48c3-9d3c-5a150e1e001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:06.967823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068c1c7-a4bc-48c3-9d3c-5a150e1e001b admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:06.968099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068c1c7-a4bc-48c3-9d3c-5a150e1e001b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:06.968371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068c1c7-a4bc-48c3-9d3c-5a150e1e001b admin admin] PATH_INFO: `/v3/projects/94514a9170234c608569a5c18020bc02/users/f6dcf7a88d294fe994d590ad12827436/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:06.983933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068c1c7-a4bc-48c3-9d3c-5a150e1e001b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94514a9170234c608569a5c18020bc02, user_id=f6dcf7a88d294fe994d590ad12827436, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:06.986603 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068c1c7-a4bc-48c3-9d3c-5a150e1e001b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.001611 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1147/2282] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:06 2022] PUT /identity/v3/projects/94514a9170234c608569a5c18020bc02/users/f6dcf7a88d294fe994d590ad12827436/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:07.006118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee74eb8-b69b-4059-9007-10730997917b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:07.016499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee74eb8-b69b-4059-9007-10730997917b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:07.077199 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4128ea7-bd52-4174-988c-c7a1b85002ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:07.077730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4128ea7-bd52-4174-988c-c7a1b85002ba admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.078007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4128ea7-bd52-4174-988c-c7a1b85002ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.078407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4128ea7-bd52-4174-988c-c7a1b85002ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.079055 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4128ea7-bd52-4174-988c-c7a1b85002ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.080702 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4128ea7-bd52-4174-988c-c7a1b85002ba admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.082813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:07.091716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1136/2283] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:07.096147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068c1c7-a4bc-48c3-9d3c-5a150e1e001b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:07.107379 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068c1c7-a4bc-48c3-9d3c-5a150e1e001b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:07.112472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c445551-48c9-478f-a72e-609143750510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:07.113135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c445551-48c9-478f-a72e-609143750510 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.113414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c445551-48c9-478f-a72e-609143750510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.113688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c445551-48c9-478f-a72e-609143750510 admin admin] PATH_INFO: `/v3/projects/94514a9170234c608569a5c18020bc02/users/f6dcf7a88d294fe994d590ad12827436/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.115755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c445551-48c9-478f-a72e-609143750510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94514a9170234c608569a5c18020bc02, user_id=f6dcf7a88d294fe994d590ad12827436, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.118417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c445551-48c9-478f-a72e-609143750510 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.128967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1148/2284] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:07 2022] PUT /identity/v3/projects/94514a9170234c608569a5c18020bc02/users/f6dcf7a88d294fe994d590ad12827436/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:07.141022 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6139f-687b-4417-a900-e9683549da0f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.141297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6139f-687b-4417-a900-e9683549da0f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.141588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6139f-687b-4417-a900-e9683549da0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.182073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-5fe6139f-687b-4417-a900-e9683549da0f None None] MFA Rules not processed for user `f6dcf7a88d294fe994d590ad12827436`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:07.183287 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5fe6139f-687b-4417-a900-e9683549da0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:07.256359 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1137/2285] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:07.268095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c445551-48c9-478f-a72e-609143750510 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:07.270066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3c445551-48c9-478f-a72e-609143750510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:07.330115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c445551-48c9-478f-a72e-609143750510 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:07.334000 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f37a0-c970-464e-99d4-f286e0a52dd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:07.334609 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f37a0-c970-464e-99d4-f286e0a52dd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.334887 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f37a0-c970-464e-99d4-f286e0a52dd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.335142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f37a0-c970-464e-99d4-f286e0a52dd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.344392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f37a0-c970-464e-99d4-f286e0a52dd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.345830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f37a0-c970-464e-99d4-f286e0a52dd0 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.355746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1149/2286] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:07.435272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6139f-687b-4417-a900-e9683549da0f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:07.444871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6139f-687b-4417-a900-e9683549da0f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:07.448722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23802f9b-8aaf-48b8-ab66-1016b45b2c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:07.449334 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23802f9b-8aaf-48b8-ab66-1016b45b2c05 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:07.449614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23802f9b-8aaf-48b8-ab66-1016b45b2c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:07.449869 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23802f9b-8aaf-48b8-ab66-1016b45b2c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:07.515199 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23802f9b-8aaf-48b8-ab66-1016b45b2c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:07.516684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23802f9b-8aaf-48b8-ab66-1016b45b2c05 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:07.526012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1138/2287] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:09.670718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f37a0-c970-464e-99d4-f286e0a52dd0 service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:09.673727 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-9f2f37a0-c970-464e-99d4-f286e0a52dd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:09.752338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f37a0-c970-464e-99d4-f286e0a52dd0 service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:09.758790 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef3f03-e1df-490b-9a27-0c44e5bd71a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:09.759411 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef3f03-e1df-490b-9a27-0c44e5bd71a7 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:09.759690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef3f03-e1df-490b-9a27-0c44e5bd71a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:09.759999 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef3f03-e1df-490b-9a27-0c44e5bd71a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:09.761979 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-bfef3f03-e1df-490b-9a27-0c44e5bd71a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:09.833856 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:09.838923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef3f03-e1df-490b-9a27-0c44e5bd71a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:09.840839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef3f03-e1df-490b-9a27-0c44e5bd71a7 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:09.850824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1150/2288] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:13.342207 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23802f9b-8aaf-48b8-ab66-1016b45b2c05 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:13.355839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23802f9b-8aaf-48b8-ab66-1016b45b2c05 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:13.362330 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429c1b6-679b-401a-a42f-2b522fd41d2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:13.362991 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429c1b6-679b-401a-a42f-2b522fd41d2f service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:13.363375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429c1b6-679b-401a-a42f-2b522fd41d2f service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:13.363897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429c1b6-679b-401a-a42f-2b522fd41d2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:13.365762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9429c1b6-679b-401a-a42f-2b522fd41d2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:13.431627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429c1b6-679b-401a-a42f-2b522fd41d2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:13.433578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429c1b6-679b-401a-a42f-2b522fd41d2f service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:13.443654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1139/2289] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:14.663860 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef3f03-e1df-490b-9a27-0c44e5bd71a7 service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:14.731334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef3f03-e1df-490b-9a27-0c44e5bd71a7 service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:14.736204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a0e21-e704-41a1-9906-4610e7a48059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:14.736825 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0e21-e704-41a1-9906-4610e7a48059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:14.737107 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0e21-e704-41a1-9906-4610e7a48059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:14.737376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0e21-e704-41a1-9906-4610e7a48059 admin admin] PATH_INFO: `/v3/users/2fb61ca2cb5e491d900e8a036e8b2356` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:14.738514 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a0e21-e704-41a1-9906-4610e7a48059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb61ca2cb5e491d900e8a036e8b2356)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:14.740481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a0e21-e704-41a1-9906-4610e7a48059 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:14.788805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6c6a0e21-e704-41a1-9906-4610e7a48059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb61ca2cb5e491d900e8a036e8b2356'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.803811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6c6a0e21-e704-41a1-9906-4610e7a48059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb61ca2cb5e491d900e8a036e8b2356'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.811062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6c6a0e21-e704-41a1-9906-4610e7a48059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb61ca2cb5e491d900e8a036e8b2356'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.818969 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6c6a0e21-e704-41a1-9906-4610e7a48059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb61ca2cb5e491d900e8a036e8b2356'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.819655 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6c6a0e21-e704-41a1-9906-4610e7a48059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb61ca2cb5e491d900e8a036e8b2356'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:14.825793 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1151/2290] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:14 2022] DELETE /identity/v3/users/2fb61ca2cb5e491d900e8a036e8b2356 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:14.832119 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f173a61-9378-4e46-8738-169c19ed45a2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:14.832688 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f173a61-9378-4e46-8738-169c19ed45a2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:14.832688 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f173a61-9378-4e46-8738-169c19ed45a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:14.852357 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4f173a61-9378-4e46-8738-169c19ed45a2 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:14.853566 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4f173a61-9378-4e46-8738-169c19ed45a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:14.867489 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:14.915445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1140/2291] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:14.925758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a0e21-e704-41a1-9906-4610e7a48059 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:14.927214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6c6a0e21-e704-41a1-9906-4610e7a48059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:14.985298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a0e21-e704-41a1-9906-4610e7a48059 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:14.989658 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e85d-282a-4ffb-a635-a13bf685685a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:14.990640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e85d-282a-4ffb-a635-a13bf685685a service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:14.990913 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e85d-282a-4ffb-a635-a13bf685685a service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:14.991182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e85d-282a-4ffb-a635-a13bf685685a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:15.001182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353e85d-282a-4ffb-a635-a13bf685685a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:15.002718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353e85d-282a-4ffb-a635-a13bf685685a service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:15.013717 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1152/2292] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:15.293225 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f173a61-9378-4e46-8738-169c19ed45a2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:15.294688 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4f173a61-9378-4e46-8738-169c19ed45a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:15.307937 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f173a61-9378-4e46-8738-169c19ed45a2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:15.313666 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:15.314343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:15.314619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:15.314896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] PATH_INFO: `/v3/projects/5bf995cb2ec54c16b5436cbb43cf5622` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:15.316172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf995cb2ec54c16b5436cbb43cf5622)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:15.318748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:15.369475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf995cb2ec54c16b5436cbb43cf5622', 'request_id': 'req-41b5a1da-bc01-492b-9bf7-b3c7017e2007'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.377855 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf995cb2ec54c16b5436cbb43cf5622', 'request_id': 'req-41b5a1da-bc01-492b-9bf7-b3c7017e2007'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.384525 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf995cb2ec54c16b5436cbb43cf5622', 'request_id': 'req-41b5a1da-bc01-492b-9bf7-b3c7017e2007'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.400690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] The token cache is being invalidate because project 5bf995cb2ec54c16b5436cbb43cf5622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:15.400893 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.401619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.403276 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1141/2293] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:15 2022] DELETE /identity/v3/projects/5bf995cb2ec54c16b5436cbb43cf5622 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:15.407571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e85d-282a-4ffb-a635-a13bf685685a service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:15.418472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e85d-282a-4ffb-a635-a13bf685685a service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:15.432921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:15.486163 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102ace6-74ad-47be-b25a-cf0222ea2d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:15.486813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102ace6-74ad-47be-b25a-cf0222ea2d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:15.487229 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102ace6-74ad-47be-b25a-cf0222ea2d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:15.492454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102ace6-74ad-47be-b25a-cf0222ea2d5b admin admin] PATH_INFO: `/v3/users/f6dcf7a88d294fe994d590ad12827436` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:15.493761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102ace6-74ad-47be-b25a-cf0222ea2d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6dcf7a88d294fe994d590ad12827436)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:15.495799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102ace6-74ad-47be-b25a-cf0222ea2d5b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:15.544091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-1102ace6-74ad-47be-b25a-cf0222ea2d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6dcf7a88d294fe994d590ad12827436'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.558892 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-1102ace6-74ad-47be-b25a-cf0222ea2d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6dcf7a88d294fe994d590ad12827436'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.566163 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-1102ace6-74ad-47be-b25a-cf0222ea2d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6dcf7a88d294fe994d590ad12827436'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.574032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-1102ace6-74ad-47be-b25a-cf0222ea2d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6dcf7a88d294fe994d590ad12827436'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.576273 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-1102ace6-74ad-47be-b25a-cf0222ea2d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6dcf7a88d294fe994d590ad12827436'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:15.583100 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1153/2294] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:15 2022] DELETE /identity/v3/users/f6dcf7a88d294fe994d590ad12827436 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:15.967056 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:15.968615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:15.982362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5a1da-bc01-492b-9bf7-b3c7017e2007 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.047875 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384baa96-28e4-4d2b-862d-7a789c25a75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.048523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384baa96-28e4-4d2b-862d-7a789c25a75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.048797 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384baa96-28e4-4d2b-862d-7a789c25a75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.049093 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384baa96-28e4-4d2b-862d-7a789c25a75a admin admin] PATH_INFO: `/v3/projects/94514a9170234c608569a5c18020bc02` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.050382 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384baa96-28e4-4d2b-862d-7a789c25a75a admin admin] RBAC: Authorizing `identity:delete_project(project_id=94514a9170234c608569a5c18020bc02)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.052366 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384baa96-28e4-4d2b-862d-7a789c25a75a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.099183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:16.101917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-384baa96-28e4-4d2b-862d-7a789c25a75a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94514a9170234c608569a5c18020bc02', 'request_id': 'req-384baa96-28e4-4d2b-862d-7a789c25a75a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:16.110439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-384baa96-28e4-4d2b-862d-7a789c25a75a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94514a9170234c608569a5c18020bc02', 'request_id': 'req-384baa96-28e4-4d2b-862d-7a789c25a75a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:16.116375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-384baa96-28e4-4d2b-862d-7a789c25a75a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94514a9170234c608569a5c18020bc02', 'request_id': 'req-384baa96-28e4-4d2b-862d-7a789c25a75a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:16.127565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-384baa96-28e4-4d2b-862d-7a789c25a75a admin admin] The token cache is being invalidate because project 94514a9170234c608569a5c18020bc02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:16.127892 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-384baa96-28e4-4d2b-862d-7a789c25a75a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:16.128611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-384baa96-28e4-4d2b-862d-7a789c25a75a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:16.130197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1142/2295] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:15 2022] DELETE /identity/v3/projects/94514a9170234c608569a5c18020bc02 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:16.135329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843d183-d38c-479a-9177-85b9b8419cfa None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.135845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843d183-d38c-479a-9177-85b9b8419cfa None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.135955 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843d183-d38c-479a-9177-85b9b8419cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.156302 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-6843d183-d38c-479a-9177-85b9b8419cfa None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:16.157492 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6843d183-d38c-479a-9177-85b9b8419cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:16.219943 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1154/2296] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:16.227963 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e86a7-587f-4c21-96c2-663e32856bd5 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.228275 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e86a7-587f-4c21-96c2-663e32856bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.228518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e86a7-587f-4c21-96c2-663e32856bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.250549 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4b6e86a7-587f-4c21-96c2-663e32856bd5 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:16.251902 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4b6e86a7-587f-4c21-96c2-663e32856bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:16.260507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1143/2297] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:16.265200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843d183-d38c-479a-9177-85b9b8419cfa None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.275042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843d183-d38c-479a-9177-85b9b8419cfa None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.280094 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079459a-c0d6-419c-91e8-2b260940fb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.280691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079459a-c0d6-419c-91e8-2b260940fb31 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.280972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079459a-c0d6-419c-91e8-2b260940fb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.281240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079459a-c0d6-419c-91e8-2b260940fb31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.281893 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079459a-c0d6-419c-91e8-2b260940fb31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:16.282199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079459a-c0d6-419c-91e8-2b260940fb31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.283852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079459a-c0d6-419c-91e8-2b260940fb31 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.295607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1155/2298] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:16.300431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e86a7-587f-4c21-96c2-663e32856bd5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.309766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e86a7-587f-4c21-96c2-663e32856bd5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.314666 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036b7d0-fa82-430a-9bac-5470367eea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.315263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036b7d0-fa82-430a-9bac-5470367eea29 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.315549 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036b7d0-fa82-430a-9bac-5470367eea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.315858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036b7d0-fa82-430a-9bac-5470367eea29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.316492 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036b7d0-fa82-430a-9bac-5470367eea29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.318386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036b7d0-fa82-430a-9bac-5470367eea29 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.355844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1144/2299] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:16 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:16.360545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079459a-c0d6-419c-91e8-2b260940fb31 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.375768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079459a-c0d6-419c-91e8-2b260940fb31 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.405183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:16.457052 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80c7af-5fe5-492b-ac3b-2e579a4abb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.457676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c7af-5fe5-492b-ac3b-2e579a4abb5c admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.457953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c7af-5fe5-492b-ac3b-2e579a4abb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.458239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c7af-5fe5-492b-ac3b-2e579a4abb5c admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.458875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80c7af-5fe5-492b-ac3b-2e579a4abb5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.460888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80c7af-5fe5-492b-ac3b-2e579a4abb5c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.486247 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1156/2300] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:16 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:16.491506 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036b7d0-fa82-430a-9bac-5470367eea29 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.504636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036b7d0-fa82-430a-9bac-5470367eea29 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.513086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375d9da-ea89-4fdf-86a8-9ad3e8139da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.513946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375d9da-ea89-4fdf-86a8-9ad3e8139da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.514306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375d9da-ea89-4fdf-86a8-9ad3e8139da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.514654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375d9da-ea89-4fdf-86a8-9ad3e8139da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.515488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375d9da-ea89-4fdf-86a8-9ad3e8139da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.517875 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375d9da-ea89-4fdf-86a8-9ad3e8139da6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.531913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1145/2301] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:16.535992 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80c7af-5fe5-492b-ac3b-2e579a4abb5c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.546198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80c7af-5fe5-492b-ac3b-2e579a4abb5c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.551556 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91015a14-35f2-4b33-9189-85a174e3cecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.552194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91015a14-35f2-4b33-9189-85a174e3cecb admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.552475 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91015a14-35f2-4b33-9189-85a174e3cecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.552785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91015a14-35f2-4b33-9189-85a174e3cecb admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.553425 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91015a14-35f2-4b33-9189-85a174e3cecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.555037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91015a14-35f2-4b33-9189-85a174e3cecb admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.565523 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1157/2302] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:16.569667 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375d9da-ea89-4fdf-86a8-9ad3e8139da6 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.580049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375d9da-ea89-4fdf-86a8-9ad3e8139da6 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.585861 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e5180-d552-49ab-a47b-60183bffff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.586503 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e5180-d552-49ab-a47b-60183bffff25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.586786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e5180-d552-49ab-a47b-60183bffff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.587055 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e5180-d552-49ab-a47b-60183bffff25 admin admin] PATH_INFO: `/v3/projects/a4aaf33cb0424cd89af30aba1f453c3f/users/09b690dac46b429685635a07ca6e0c25/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.602643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e5180-d552-49ab-a47b-60183bffff25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4aaf33cb0424cd89af30aba1f453c3f, user_id=09b690dac46b429685635a07ca6e0c25, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.605346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e5180-d552-49ab-a47b-60183bffff25 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.622196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1146/2303] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:16 2022] PUT /identity/v3/projects/a4aaf33cb0424cd89af30aba1f453c3f/users/09b690dac46b429685635a07ca6e0c25/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:16.634263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9ed05-5c56-40c6-8751-7c1c92d7b4a4 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.634546 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9ed05-5c56-40c6-8751-7c1c92d7b4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.634822 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9ed05-5c56-40c6-8751-7c1c92d7b4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.662376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-22a9ed05-5c56-40c6-8751-7c1c92d7b4a4 None None] MFA Rules not processed for user `09b690dac46b429685635a07ca6e0c25`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:16.663584 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-22a9ed05-5c56-40c6-8751-7c1c92d7b4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:16.737558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1158/2304] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:16.743901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e5180-d552-49ab-a47b-60183bffff25 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.809592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e5180-d552-49ab-a47b-60183bffff25 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.814519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657aaa6c-66b6-4a5c-879b-cfa79dfe6f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.815147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aaa6c-66b6-4a5c-879b-cfa79dfe6f77 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.815435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aaa6c-66b6-4a5c-879b-cfa79dfe6f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.815719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aaa6c-66b6-4a5c-879b-cfa79dfe6f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.816446 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657aaa6c-66b6-4a5c-879b-cfa79dfe6f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.818361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657aaa6c-66b6-4a5c-879b-cfa79dfe6f77 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.849863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1147/2305] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:16 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:16.852353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9ed05-5c56-40c6-8751-7c1c92d7b4a4 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.863198 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9ed05-5c56-40c6-8751-7c1c92d7b4a4 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.924646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857a7df-a255-4de9-ab71-19d836f92e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.925178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857a7df-a255-4de9-ab71-19d836f92e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.925463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857a7df-a255-4de9-ab71-19d836f92e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.925739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857a7df-a255-4de9-ab71-19d836f92e62 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.926373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857a7df-a255-4de9-ab71-19d836f92e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.928408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857a7df-a255-4de9-ab71-19d836f92e62 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.951550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1159/2306] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:16 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:16.955644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657aaa6c-66b6-4a5c-879b-cfa79dfe6f77 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:16.966212 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657aaa6c-66b6-4a5c-879b-cfa79dfe6f77 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:16.972268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efea27-243f-456b-a192-bc6b1782cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:16.972910 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efea27-243f-456b-a192-bc6b1782cd24 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:16.973173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efea27-243f-456b-a192-bc6b1782cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:16.973444 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efea27-243f-456b-a192-bc6b1782cd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:16.974471 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efea27-243f-456b-a192-bc6b1782cd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:16.976124 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efea27-243f-456b-a192-bc6b1782cd24 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:16.987829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1148/2307] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:16.992921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857a7df-a255-4de9-ab71-19d836f92e62 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:17.003524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857a7df-a255-4de9-ab71-19d836f92e62 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:17.008200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f318f-d9f8-4f5b-b8f2-fee7de60e38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:17.008864 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f318f-d9f8-4f5b-b8f2-fee7de60e38a admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.009141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f318f-d9f8-4f5b-b8f2-fee7de60e38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.009412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f318f-d9f8-4f5b-b8f2-fee7de60e38a admin admin] PATH_INFO: `/v3/projects/b68833c4f1c24472be232e7fe8fe503c/users/8addaf08e916495fbf113ef916ab0f41/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.027433 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f318f-d9f8-4f5b-b8f2-fee7de60e38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b68833c4f1c24472be232e7fe8fe503c, user_id=8addaf08e916495fbf113ef916ab0f41, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:17.030318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f318f-d9f8-4f5b-b8f2-fee7de60e38a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:17.033326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:17.047210 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1160/2308] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:16 2022] PUT /identity/v3/projects/b68833c4f1c24472be232e7fe8fe503c/users/8addaf08e916495fbf113ef916ab0f41/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:17.051351 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efea27-243f-456b-a192-bc6b1782cd24 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:17.062077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efea27-243f-456b-a192-bc6b1782cd24 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:17.104653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:17.122263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37109cdc-64f4-4ce6-afde-aa2e3162ec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:17.122870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37109cdc-64f4-4ce6-afde-aa2e3162ec4c admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.123133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37109cdc-64f4-4ce6-afde-aa2e3162ec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.123404 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37109cdc-64f4-4ce6-afde-aa2e3162ec4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.124084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37109cdc-64f4-4ce6-afde-aa2e3162ec4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:17.125687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37109cdc-64f4-4ce6-afde-aa2e3162ec4c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:17.135305 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1149/2309] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:17.139932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f318f-d9f8-4f5b-b8f2-fee7de60e38a admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:17.150996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f318f-d9f8-4f5b-b8f2-fee7de60e38a admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:17.156094 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be3bb9-ef02-4c24-9824-6fed5f7fd53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:17.156750 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be3bb9-ef02-4c24-9824-6fed5f7fd53b admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.157029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be3bb9-ef02-4c24-9824-6fed5f7fd53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.157321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be3bb9-ef02-4c24-9824-6fed5f7fd53b admin admin] PATH_INFO: `/v3/projects/b68833c4f1c24472be232e7fe8fe503c/users/8addaf08e916495fbf113ef916ab0f41/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.159240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be3bb9-ef02-4c24-9824-6fed5f7fd53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b68833c4f1c24472be232e7fe8fe503c, user_id=8addaf08e916495fbf113ef916ab0f41, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:17.161932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be3bb9-ef02-4c24-9824-6fed5f7fd53b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:17.172656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1161/2310] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:17 2022] PUT /identity/v3/projects/b68833c4f1c24472be232e7fe8fe503c/users/8addaf08e916495fbf113ef916ab0f41/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:17.183116 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a477-5027-4ee3-981f-a7645eb9a823 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.183341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a477-5027-4ee3-981f-a7645eb9a823 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.183619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a477-5027-4ee3-981f-a7645eb9a823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.212944 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-bb50a477-5027-4ee3-981f-a7645eb9a823 None None] MFA Rules not processed for user `8addaf08e916495fbf113ef916ab0f41`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:17.214187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bb50a477-5027-4ee3-981f-a7645eb9a823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:17.286447 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1150/2311] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:17.297737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be3bb9-ef02-4c24-9824-6fed5f7fd53b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:17.299526 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-24be3bb9-ef02-4c24-9824-6fed5f7fd53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:17.360285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be3bb9-ef02-4c24-9824-6fed5f7fd53b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:17.364873 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73c320-d503-409d-9b8f-4e7a8d7510d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:17.365491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73c320-d503-409d-9b8f-4e7a8d7510d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:17.365772 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73c320-d503-409d-9b8f-4e7a8d7510d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:17.366059 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73c320-d503-409d-9b8f-4e7a8d7510d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:17.426243 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73c320-d503-409d-9b8f-4e7a8d7510d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:17.427685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73c320-d503-409d-9b8f-4e7a8d7510d0 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:17.437444 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1162/2312] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:20.046030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50a477-5027-4ee3-981f-a7645eb9a823 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:20.057285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50a477-5027-4ee3-981f-a7645eb9a823 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:20.061946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9e8f8-91b3-4388-a6b5-b0d026a837ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:20.062730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9e8f8-91b3-4388-a6b5-b0d026a837ef service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:20.063012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9e8f8-91b3-4388-a6b5-b0d026a837ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:20.063430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9e8f8-91b3-4388-a6b5-b0d026a837ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:20.073625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9e8f8-91b3-4388-a6b5-b0d026a837ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:20.075085 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9e8f8-91b3-4388-a6b5-b0d026a837ef service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:20.084906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1151/2313] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:22.810703 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73c320-d503-409d-9b8f-4e7a8d7510d0 service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:22.812617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5d73c320-d503-409d-9b8f-4e7a8d7510d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:22.916448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73c320-d503-409d-9b8f-4e7a8d7510d0 service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:22.923340 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c9bbb-8b43-4975-a8d0-df2840f1cc0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:22.923995 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c9bbb-8b43-4975-a8d0-df2840f1cc0d service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:22.924279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c9bbb-8b43-4975-a8d0-df2840f1cc0d service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:22.924549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c9bbb-8b43-4975-a8d0-df2840f1cc0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:22.926369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-718c9bbb-8b43-4975-a8d0-df2840f1cc0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:22.960402 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:22.991527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c9bbb-8b43-4975-a8d0-df2840f1cc0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:22.993227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c9bbb-8b43-4975-a8d0-df2840f1cc0d service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:23.002380 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1163/2314] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:28.951265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34571a8d-eeb6-475d-b146-44d94c9e4e65 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.952240 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34571a8d-eeb6-475d-b146-44d94c9e4e65 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.952512 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34571a8d-eeb6-475d-b146-44d94c9e4e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.987626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-34571a8d-eeb6-475d-b146-44d94c9e4e65 None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:28.989139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-34571a8d-eeb6-475d-b146-44d94c9e4e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:29.051609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1152/2315] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:26:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:29.109959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c9bbb-8b43-4975-a8d0-df2840f1cc0d service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:29.111535 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-718c9bbb-8b43-4975-a8d0-df2840f1cc0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:29.184172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c9bbb-8b43-4975-a8d0-df2840f1cc0d service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:29.190023 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3709278-cb95-4e63-a225-62a423008d28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:29.190642 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3709278-cb95-4e63-a225-62a423008d28 service swift] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:29.190918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3709278-cb95-4e63-a225-62a423008d28 service swift] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:29.191189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3709278-cb95-4e63-a225-62a423008d28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:29.199386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3709278-cb95-4e63-a225-62a423008d28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:29.201024 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3709278-cb95-4e63-a225-62a423008d28 service swift] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:29.209102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1164/2316] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:26:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:26:32.989138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34571a8d-eeb6-475d-b146-44d94c9e4e65 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:33.059130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:33.063665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34571a8d-eeb6-475d-b146-44d94c9e4e65 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:33.070481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffefcb-f85a-477d-adc0-8351de12bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:33.072686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffefcb-f85a-477d-adc0-8351de12bae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:33.074124 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffefcb-f85a-477d-adc0-8351de12bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:33.074574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffefcb-f85a-477d-adc0-8351de12bae3 admin admin] PATH_INFO: `/v3/users/09b690dac46b429685635a07ca6e0c25` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:33.077479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffefcb-f85a-477d-adc0-8351de12bae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b690dac46b429685635a07ca6e0c25)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:33.080080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffefcb-f85a-477d-adc0-8351de12bae3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:33.141216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0bffefcb-f85a-477d-adc0-8351de12bae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b690dac46b429685635a07ca6e0c25'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:33.158280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0bffefcb-f85a-477d-adc0-8351de12bae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b690dac46b429685635a07ca6e0c25'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:33.175511 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0bffefcb-f85a-477d-adc0-8351de12bae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b690dac46b429685635a07ca6e0c25'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:33.184707 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0bffefcb-f85a-477d-adc0-8351de12bae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b690dac46b429685635a07ca6e0c25'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:33.185329 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0bffefcb-f85a-477d-adc0-8351de12bae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b690dac46b429685635a07ca6e0c25'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:33.193582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1153/2317] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:32 2022] DELETE /identity/v3/users/09b690dac46b429685635a07ca6e0c25 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:33.197781 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc952-ad33-42ec-8be4-33de95599af8 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:33.198300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc952-ad33-42ec-8be4-33de95599af8 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:33.198408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc952-ad33-42ec-8be4-33de95599af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:33.220838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-d4cfc952-ad33-42ec-8be4-33de95599af8 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:33.222435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d4cfc952-ad33-42ec-8be4-33de95599af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:33.294997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1165/2318] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:33.307298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffefcb-f85a-477d-adc0-8351de12bae3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:33.309022 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0bffefcb-f85a-477d-adc0-8351de12bae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:33.383161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffefcb-f85a-477d-adc0-8351de12bae3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:33.387038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bea75d-c67d-4695-9de3-5b1172732e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:33.387800 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea75d-c67d-4695-9de3-5b1172732e2c service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:33.388185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea75d-c67d-4695-9de3-5b1172732e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:33.388578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea75d-c67d-4695-9de3-5b1172732e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:33.400555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bea75d-c67d-4695-9de3-5b1172732e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:33.402018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bea75d-c67d-4695-9de3-5b1172732e2c service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:33.414463 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1154/2319] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:33.835529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfc952-ad33-42ec-8be4-33de95599af8 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:33.837544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d4cfc952-ad33-42ec-8be4-33de95599af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:33.856373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfc952-ad33-42ec-8be4-33de95599af8 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:33.871448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:33.872135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:33.872412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:33.872682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] PATH_INFO: `/v3/projects/a4aaf33cb0424cd89af30aba1f453c3f` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:33.874376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4aaf33cb0424cd89af30aba1f453c3f)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:33.876614 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:33.958493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4aaf33cb0424cd89af30aba1f453c3f', 'request_id': 'req-25281dde-96d0-404b-b0db-d03d48d69178'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:33.971583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4aaf33cb0424cd89af30aba1f453c3f', 'request_id': 'req-25281dde-96d0-404b-b0db-d03d48d69178'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:33.975758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:33.992046 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4aaf33cb0424cd89af30aba1f453c3f', 'request_id': 'req-25281dde-96d0-404b-b0db-d03d48d69178'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.013697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] The token cache is being invalidate because project a4aaf33cb0424cd89af30aba1f453c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:34.014073 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.014807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.017092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1166/2320] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:33 2022] DELETE /identity/v3/projects/a4aaf33cb0424cd89af30aba1f453c3f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:34.021154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bea75d-c67d-4695-9de3-5b1172732e2c service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:34.037030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bea75d-c67d-4695-9de3-5b1172732e2c service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:34.159912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4d2ef-ee49-4fe1-be90-d1a246d78b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:34.161292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4d2ef-ee49-4fe1-be90-d1a246d78b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:34.161627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4d2ef-ee49-4fe1-be90-d1a246d78b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:34.161901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4d2ef-ee49-4fe1-be90-d1a246d78b61 admin admin] PATH_INFO: `/v3/users/8addaf08e916495fbf113ef916ab0f41` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:34.171844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4d2ef-ee49-4fe1-be90-d1a246d78b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8addaf08e916495fbf113ef916ab0f41)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:34.174385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4d2ef-ee49-4fe1-be90-d1a246d78b61 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:34.199872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:34.233012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-78f4d2ef-ee49-4fe1-be90-d1a246d78b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8addaf08e916495fbf113ef916ab0f41'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.249621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-78f4d2ef-ee49-4fe1-be90-d1a246d78b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8addaf08e916495fbf113ef916ab0f41'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.256763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-78f4d2ef-ee49-4fe1-be90-d1a246d78b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8addaf08e916495fbf113ef916ab0f41'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.267690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-78f4d2ef-ee49-4fe1-be90-d1a246d78b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8addaf08e916495fbf113ef916ab0f41'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.268494 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-78f4d2ef-ee49-4fe1-be90-d1a246d78b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8addaf08e916495fbf113ef916ab0f41'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:34.275679 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1155/2321] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:34 2022] DELETE /identity/v3/users/8addaf08e916495fbf113ef916ab0f41 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:34.912834 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:34.916220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:34.948940 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25281dde-96d0-404b-b0db-d03d48d69178 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:35.020510 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2581f1-d496-4611-953e-df3dc2f03232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:35.021221 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2581f1-d496-4611-953e-df3dc2f03232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.021495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2581f1-d496-4611-953e-df3dc2f03232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.021769 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2581f1-d496-4611-953e-df3dc2f03232 admin admin] PATH_INFO: `/v3/projects/b68833c4f1c24472be232e7fe8fe503c` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.023035 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2581f1-d496-4611-953e-df3dc2f03232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b68833c4f1c24472be232e7fe8fe503c)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:35.025090 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2581f1-d496-4611-953e-df3dc2f03232 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:35.098285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9b2581f1-d496-4611-953e-df3dc2f03232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b68833c4f1c24472be232e7fe8fe503c', 'request_id': 'req-9b2581f1-d496-4611-953e-df3dc2f03232'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.117464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9b2581f1-d496-4611-953e-df3dc2f03232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b68833c4f1c24472be232e7fe8fe503c', 'request_id': 'req-9b2581f1-d496-4611-953e-df3dc2f03232'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.124472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9b2581f1-d496-4611-953e-df3dc2f03232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b68833c4f1c24472be232e7fe8fe503c', 'request_id': 'req-9b2581f1-d496-4611-953e-df3dc2f03232'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.148124 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9b2581f1-d496-4611-953e-df3dc2f03232 admin admin] The token cache is being invalidate because project b68833c4f1c24472be232e7fe8fe503c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:35.148693 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9b2581f1-d496-4611-953e-df3dc2f03232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.150305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9b2581f1-d496-4611-953e-df3dc2f03232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:35.157799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914c51-f64a-4b8c-be93-0d486196d53e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.158250 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914c51-f64a-4b8c-be93-0d486196d53e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.158544 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914c51-f64a-4b8c-be93-0d486196d53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.161911 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1167/2322] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:34 2022] DELETE /identity/v3/projects/b68833c4f1c24472be232e7fe8fe503c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:35.194764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-5a914c51-f64a-4b8c-be93-0d486196d53e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:35.196275 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5a914c51-f64a-4b8c-be93-0d486196d53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:35.282460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1156/2323] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:35.283962 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ea4c3-07db-4eab-aab4-57c0e66a102f None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.284703 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ea4c3-07db-4eab-aab4-57c0e66a102f None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.285053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ea4c3-07db-4eab-aab4-57c0e66a102f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.309009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-d28ea4c3-07db-4eab-aab4-57c0e66a102f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:35.310271 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d28ea4c3-07db-4eab-aab4-57c0e66a102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:35.322802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1168/2324] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:35.324203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a914c51-f64a-4b8c-be93-0d486196d53e None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:35.335269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a914c51-f64a-4b8c-be93-0d486196d53e None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:35.345282 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fe112-a228-4d89-af74-4c9b89c68cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:35.345282 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe112-a228-4d89-af74-4c9b89c68cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.345282 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe112-a228-4d89-af74-4c9b89c68cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.345282 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe112-a228-4d89-af74-4c9b89c68cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.345778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fe112-a228-4d89-af74-4c9b89c68cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:35.345778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fe112-a228-4d89-af74-4c9b89c68cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:35.345778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fe112-a228-4d89-af74-4c9b89c68cf5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:35.368826 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1157/2325] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:35.369608 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ea4c3-07db-4eab-aab4-57c0e66a102f None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:35.382860 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ea4c3-07db-4eab-aab4-57c0e66a102f None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:35.393546 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aa2fc-75e2-442a-925f-9d1e4b431a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:35.394188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aa2fc-75e2-442a-925f-9d1e4b431a96 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.394464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aa2fc-75e2-442a-925f-9d1e4b431a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.394730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aa2fc-75e2-442a-925f-9d1e4b431a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.395457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aa2fc-75e2-442a-925f-9d1e4b431a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:35.397461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aa2fc-75e2-442a-925f-9d1e4b431a96 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:35.434876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1169/2326] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:35 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:35.438879 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fe112-a228-4d89-af74-4c9b89c68cf5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:35.450644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fe112-a228-4d89-af74-4c9b89c68cf5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:35.531656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562161b2-4721-4d29-9fa1-66a0ab9ce3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:35.532316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562161b2-4721-4d29-9fa1-66a0ab9ce3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.532649 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562161b2-4721-4d29-9fa1-66a0ab9ce3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.532932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562161b2-4721-4d29-9fa1-66a0ab9ce3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.533642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562161b2-4721-4d29-9fa1-66a0ab9ce3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:35.535633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562161b2-4721-4d29-9fa1-66a0ab9ce3b0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:35.567728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1158/2327] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:35 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:35.570863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aa2fc-75e2-442a-925f-9d1e4b431a96 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:35.588974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aa2fc-75e2-442a-925f-9d1e4b431a96 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:35.596892 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b3eaa-4c75-4dea-a820-2beacf1e1633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:35.598024 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b3eaa-4c75-4dea-a820-2beacf1e1633 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.598319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b3eaa-4c75-4dea-a820-2beacf1e1633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.598592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b3eaa-4c75-4dea-a820-2beacf1e1633 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.599845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b3eaa-4c75-4dea-a820-2beacf1e1633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:35.602143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b3eaa-4c75-4dea-a820-2beacf1e1633 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:35.617119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1170/2328] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:35.619345 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562161b2-4721-4d29-9fa1-66a0ab9ce3b0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:35.631808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562161b2-4721-4d29-9fa1-66a0ab9ce3b0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:35.640997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86be928-dcd5-45e8-b717-d0c57f86bdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:35.641400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86be928-dcd5-45e8-b717-d0c57f86bdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.641832 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86be928-dcd5-45e8-b717-d0c57f86bdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.642123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86be928-dcd5-45e8-b717-d0c57f86bdd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.642860 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86be928-dcd5-45e8-b717-d0c57f86bdd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:35.645133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86be928-dcd5-45e8-b717-d0c57f86bdd6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:35.662715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1159/2329] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:35.664288 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b3eaa-4c75-4dea-a820-2beacf1e1633 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:35.675185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b3eaa-4c75-4dea-a820-2beacf1e1633 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:35.683228 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3716320-e3e2-4cf5-9544-7f9cd30898e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:35.683881 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3716320-e3e2-4cf5-9544-7f9cd30898e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.684213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3716320-e3e2-4cf5-9544-7f9cd30898e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.684490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3716320-e3e2-4cf5-9544-7f9cd30898e0 admin admin] PATH_INFO: `/v3/projects/a4250bfdf7604f35a4df7dd0c796c48f/users/dca09be87f53430f9e305d1d02039537/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.703598 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3716320-e3e2-4cf5-9544-7f9cd30898e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4250bfdf7604f35a4df7dd0c796c48f, user_id=dca09be87f53430f9e305d1d02039537, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:35.706387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3716320-e3e2-4cf5-9544-7f9cd30898e0 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:35.735279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1171/2330] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:35 2022] PUT /identity/v3/projects/a4250bfdf7604f35a4df7dd0c796c48f/users/dca09be87f53430f9e305d1d02039537/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:35.737645 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c78e74-689b-4607-9231-5d2abec347f5 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.737970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c78e74-689b-4607-9231-5d2abec347f5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.738422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c78e74-689b-4607-9231-5d2abec347f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:35.749875 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:35.777034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a5c78e74-689b-4607-9231-5d2abec347f5 None None] MFA Rules not processed for user `dca09be87f53430f9e305d1d02039537`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:35.779682 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a5c78e74-689b-4607-9231-5d2abec347f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:35.900941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1160/2331] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:35.905326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3716320-e3e2-4cf5-9544-7f9cd30898e0 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:35.922149 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:35.993498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3716320-e3e2-4cf5-9544-7f9cd30898e0 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:35.998332 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00d32b-7721-4c61-a8e0-d4624902288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:35.998956 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00d32b-7721-4c61-a8e0-d4624902288d admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:35.999224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00d32b-7721-4c61-a8e0-d4624902288d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:35.999623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00d32b-7721-4c61-a8e0-d4624902288d admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.000310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00d32b-7721-4c61-a8e0-d4624902288d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.002588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00d32b-7721-4c61-a8e0-d4624902288d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.042555 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1172/2332] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:35 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:36.047900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c78e74-689b-4607-9231-5d2abec347f5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.060004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c78e74-689b-4607-9231-5d2abec347f5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.125292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233a811-6bfd-4cc1-82db-2c1d2bae2a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.125911 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233a811-6bfd-4cc1-82db-2c1d2bae2a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.126322 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233a811-6bfd-4cc1-82db-2c1d2bae2a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.126603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233a811-6bfd-4cc1-82db-2c1d2bae2a01 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.127261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233a811-6bfd-4cc1-82db-2c1d2bae2a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.129245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233a811-6bfd-4cc1-82db-2c1d2bae2a01 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.155227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1161/2333] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:36 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:36.159374 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00d32b-7721-4c61-a8e0-d4624902288d admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.172924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00d32b-7721-4c61-a8e0-d4624902288d admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.178184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f852a-6604-4fcc-ae81-9c3a098c3f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.178932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f852a-6604-4fcc-ae81-9c3a098c3f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.179282 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f852a-6604-4fcc-ae81-9c3a098c3f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.179624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f852a-6604-4fcc-ae81-9c3a098c3f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.180552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f852a-6604-4fcc-ae81-9c3a098c3f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.182321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f852a-6604-4fcc-ae81-9c3a098c3f7a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.195135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1173/2334] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:36.200352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233a811-6bfd-4cc1-82db-2c1d2bae2a01 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.211646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233a811-6bfd-4cc1-82db-2c1d2bae2a01 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.216587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04dc65-9dc6-48d8-91b4-783ee28d64e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.217272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04dc65-9dc6-48d8-91b4-783ee28d64e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.217738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04dc65-9dc6-48d8-91b4-783ee28d64e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.218015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04dc65-9dc6-48d8-91b4-783ee28d64e3 admin admin] PATH_INFO: `/v3/projects/57add73e985b4fee9d01e84edc801f0c/users/87097a31e2424bfd95ba6265649f1204/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.235355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04dc65-9dc6-48d8-91b4-783ee28d64e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57add73e985b4fee9d01e84edc801f0c, user_id=87097a31e2424bfd95ba6265649f1204, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.238875 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04dc65-9dc6-48d8-91b4-783ee28d64e3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.255780 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1162/2335] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:36 2022] PUT /identity/v3/projects/57add73e985b4fee9d01e84edc801f0c/users/87097a31e2424bfd95ba6265649f1204/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:36.258805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f852a-6604-4fcc-ae81-9c3a098c3f7a admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.270206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f852a-6604-4fcc-ae81-9c3a098c3f7a admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.344018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66289d-a9a4-41fb-ba81-105388db980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.344973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66289d-a9a4-41fb-ba81-105388db980d admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.345365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66289d-a9a4-41fb-ba81-105388db980d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.345851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66289d-a9a4-41fb-ba81-105388db980d admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.346651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66289d-a9a4-41fb-ba81-105388db980d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.348738 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66289d-a9a4-41fb-ba81-105388db980d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.376473 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1174/2336] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:36.380456 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04dc65-9dc6-48d8-91b4-783ee28d64e3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.393485 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04dc65-9dc6-48d8-91b4-783ee28d64e3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.398452 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1844ea-0bd6-4e12-8692-c75409d3359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.399798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1844ea-0bd6-4e12-8692-c75409d3359f admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.399798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1844ea-0bd6-4e12-8692-c75409d3359f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.399798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1844ea-0bd6-4e12-8692-c75409d3359f admin admin] PATH_INFO: `/v3/projects/57add73e985b4fee9d01e84edc801f0c/users/87097a31e2424bfd95ba6265649f1204/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.401689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1844ea-0bd6-4e12-8692-c75409d3359f admin admin] RBAC: Authorizing `identity:create_grant(project_id=57add73e985b4fee9d01e84edc801f0c, user_id=87097a31e2424bfd95ba6265649f1204, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.404395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1844ea-0bd6-4e12-8692-c75409d3359f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.425561 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1163/2337] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:36 2022] PUT /identity/v3/projects/57add73e985b4fee9d01e84edc801f0c/users/87097a31e2424bfd95ba6265649f1204/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:36.427304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d3fe3-14cb-412a-91ef-c1403c23f616 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.427617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d3fe3-14cb-412a-91ef-c1403c23f616 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.427987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d3fe3-14cb-412a-91ef-c1403c23f616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.459356 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-816d3fe3-14cb-412a-91ef-c1403c23f616 None None] MFA Rules not processed for user `87097a31e2424bfd95ba6265649f1204`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:36.460600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-816d3fe3-14cb-412a-91ef-c1403c23f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:36.539757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1175/2338] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:36.551122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1844ea-0bd6-4e12-8692-c75409d3359f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.553262 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cc1844ea-0bd6-4e12-8692-c75409d3359f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:36.624409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:36.633484 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1844ea-0bd6-4e12-8692-c75409d3359f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.637742 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4313aa5-339e-42a6-92ff-b111336fd640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.638436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4313aa5-339e-42a6-92ff-b111336fd640 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.638803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4313aa5-339e-42a6-92ff-b111336fd640 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.639145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4313aa5-339e-42a6-92ff-b111336fd640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.651027 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4313aa5-339e-42a6-92ff-b111336fd640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.652547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4313aa5-339e-42a6-92ff-b111336fd640 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.663145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1164/2339] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:36.775926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d3fe3-14cb-412a-91ef-c1403c23f616 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:36.786238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d3fe3-14cb-412a-91ef-c1403c23f616 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:36.789960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a29da-2418-4724-a2b3-ffe8002f9235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:36.790571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a29da-2418-4724-a2b3-ffe8002f9235 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:36.790851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a29da-2418-4724-a2b3-ffe8002f9235 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:36.791123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a29da-2418-4724-a2b3-ffe8002f9235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:36.797805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:36.860119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a29da-2418-4724-a2b3-ffe8002f9235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:36.861744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a29da-2418-4724-a2b3-ffe8002f9235 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:36.872251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1176/2340] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:39.400885 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4313aa5-339e-42a6-92ff-b111336fd640 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:39.402289 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f4313aa5-339e-42a6-92ff-b111336fd640 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:39.432464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a29da-2418-4724-a2b3-ffe8002f9235 service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:39.435196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-9a8a29da-2418-4724-a2b3-ffe8002f9235 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:39.516135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4313aa5-339e-42a6-92ff-b111336fd640 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:39.522934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cca9f5-adc1-4854-8766-179203eaf779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:39.523569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca9f5-adc1-4854-8766-179203eaf779 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:39.524018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca9f5-adc1-4854-8766-179203eaf779 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:39.524520 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca9f5-adc1-4854-8766-179203eaf779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:39.526399 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d4cca9f5-adc1-4854-8766-179203eaf779 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:39.543251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a29da-2418-4724-a2b3-ffe8002f9235 service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:39.550804 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cca9f5-adc1-4854-8766-179203eaf779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:39.552576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cca9f5-adc1-4854-8766-179203eaf779 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:39.556425 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693b76d-cdb8-4c27-abd6-b1c2ae449391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:39.557535 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693b76d-cdb8-4c27-abd6-b1c2ae449391 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:39.558017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693b76d-cdb8-4c27-abd6-b1c2ae449391 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:39.558395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693b76d-cdb8-4c27-abd6-b1c2ae449391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:39.562577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5693b76d-cdb8-4c27-abd6-b1c2ae449391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:39.566759 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1165/2341] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:39.577342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693b76d-cdb8-4c27-abd6-b1c2ae449391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:39.579155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693b76d-cdb8-4c27-abd6-b1c2ae449391 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:39.590006 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1177/2342] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:39.816761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cca9f5-adc1-4854-8766-179203eaf779 service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:39.932784 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cca9f5-adc1-4854-8766-179203eaf779 service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:39.941547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba686c1-3565-4607-ac6b-daed87ebf40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:39.942391 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba686c1-3565-4607-ac6b-daed87ebf40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:39.942945 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba686c1-3565-4607-ac6b-daed87ebf40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:39.943232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba686c1-3565-4607-ac6b-daed87ebf40a admin admin] PATH_INFO: `/v3/users/dca09be87f53430f9e305d1d02039537` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:39.944565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba686c1-3565-4607-ac6b-daed87ebf40a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca09be87f53430f9e305d1d02039537)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:39.946570 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba686c1-3565-4607-ac6b-daed87ebf40a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:40.005642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8ba686c1-3565-4607-ac6b-daed87ebf40a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca09be87f53430f9e305d1d02039537'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.020796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8ba686c1-3565-4607-ac6b-daed87ebf40a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca09be87f53430f9e305d1d02039537'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.030163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8ba686c1-3565-4607-ac6b-daed87ebf40a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca09be87f53430f9e305d1d02039537'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.032829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:40.039857 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8ba686c1-3565-4607-ac6b-daed87ebf40a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca09be87f53430f9e305d1d02039537'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.040507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8ba686c1-3565-4607-ac6b-daed87ebf40a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca09be87f53430f9e305d1d02039537'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.047961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1166/2343] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:39 2022] DELETE /identity/v3/users/dca09be87f53430f9e305d1d02039537 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:40.052538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64b19-883a-4ba6-b3b6-f501cdd50de7 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:40.052824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64b19-883a-4ba6-b3b6-f501cdd50de7 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:40.053096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64b19-883a-4ba6-b3b6-f501cdd50de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:40.072840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-ffb64b19-883a-4ba6-b3b6-f501cdd50de7 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:40.074066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ffb64b19-883a-4ba6-b3b6-f501cdd50de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:40.168253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1178/2344] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:40.179591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba686c1-3565-4607-ac6b-daed87ebf40a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:40.181095 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8ba686c1-3565-4607-ac6b-daed87ebf40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:40.259914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba686c1-3565-4607-ac6b-daed87ebf40a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:40.264524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2287ff0-b15a-44b8-beed-8c0ea2264bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:40.264771 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2287ff0-b15a-44b8-beed-8c0ea2264bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:40.265013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2287ff0-b15a-44b8-beed-8c0ea2264bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:40.265324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2287ff0-b15a-44b8-beed-8c0ea2264bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:40.276279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2287ff0-b15a-44b8-beed-8c0ea2264bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:40.277730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2287ff0-b15a-44b8-beed-8c0ea2264bc0 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:40.293040 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1167/2345] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:40.577421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb64b19-883a-4ba6-b3b6-f501cdd50de7 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:40.579992 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ffb64b19-883a-4ba6-b3b6-f501cdd50de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:40.591689 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb64b19-883a-4ba6-b3b6-f501cdd50de7 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:40.605824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:40.606826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:40.607318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:40.607952 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] PATH_INFO: `/v3/projects/a4250bfdf7604f35a4df7dd0c796c48f` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:40.609473 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4250bfdf7604f35a4df7dd0c796c48f)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:40.611653 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:40.661304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:40.665652 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4250bfdf7604f35a4df7dd0c796c48f', 'request_id': 'req-84094cb6-e035-487e-95ba-6129482f4df7'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.677333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4250bfdf7604f35a4df7dd0c796c48f', 'request_id': 'req-84094cb6-e035-487e-95ba-6129482f4df7'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.683918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4250bfdf7604f35a4df7dd0c796c48f', 'request_id': 'req-84094cb6-e035-487e-95ba-6129482f4df7'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.700134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] The token cache is being invalidate because project a4250bfdf7604f35a4df7dd0c796c48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:40.700427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.701096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.703446 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1179/2346] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:40 2022] DELETE /identity/v3/projects/a4250bfdf7604f35a4df7dd0c796c48f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:40.709172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2287ff0-b15a-44b8-beed-8c0ea2264bc0 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:40.722118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2287ff0-b15a-44b8-beed-8c0ea2264bc0 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:40.781373 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6ef8e-1730-4faf-b936-50aca0d156e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:40.781946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6ef8e-1730-4faf-b936-50aca0d156e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:40.782211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6ef8e-1730-4faf-b936-50aca0d156e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:40.782507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6ef8e-1730-4faf-b936-50aca0d156e1 admin admin] PATH_INFO: `/v3/users/87097a31e2424bfd95ba6265649f1204` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:40.783749 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6ef8e-1730-4faf-b936-50aca0d156e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87097a31e2424bfd95ba6265649f1204)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:40.785707 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6ef8e-1730-4faf-b936-50aca0d156e1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:40.835281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0bb6ef8e-1730-4faf-b936-50aca0d156e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87097a31e2424bfd95ba6265649f1204'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.848183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0bb6ef8e-1730-4faf-b936-50aca0d156e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87097a31e2424bfd95ba6265649f1204'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.855879 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0bb6ef8e-1730-4faf-b936-50aca0d156e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87097a31e2424bfd95ba6265649f1204'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.865024 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0bb6ef8e-1730-4faf-b936-50aca0d156e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87097a31e2424bfd95ba6265649f1204'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.865679 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0bb6ef8e-1730-4faf-b936-50aca0d156e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87097a31e2424bfd95ba6265649f1204'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:40.871822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1168/2347] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:40 2022] DELETE /identity/v3/users/87097a31e2424bfd95ba6265649f1204 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:41.170168 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:41.171916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:41.188681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84094cb6-e035-487e-95ba-6129482f4df7 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:41.271352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385e25f-898b-437d-b719-f983acdf4c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:41.272033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385e25f-898b-437d-b719-f983acdf4c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:41.272311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385e25f-898b-437d-b719-f983acdf4c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:41.272990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385e25f-898b-437d-b719-f983acdf4c42 admin admin] PATH_INFO: `/v3/projects/57add73e985b4fee9d01e84edc801f0c` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:41.273794 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385e25f-898b-437d-b719-f983acdf4c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57add73e985b4fee9d01e84edc801f0c)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:41.275740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385e25f-898b-437d-b719-f983acdf4c42 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:41.322858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c385e25f-898b-437d-b719-f983acdf4c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57add73e985b4fee9d01e84edc801f0c', 'request_id': 'req-c385e25f-898b-437d-b719-f983acdf4c42'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:41.330621 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c385e25f-898b-437d-b719-f983acdf4c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57add73e985b4fee9d01e84edc801f0c', 'request_id': 'req-c385e25f-898b-437d-b719-f983acdf4c42'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:41.336212 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c385e25f-898b-437d-b719-f983acdf4c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57add73e985b4fee9d01e84edc801f0c', 'request_id': 'req-c385e25f-898b-437d-b719-f983acdf4c42'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:41.347956 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c385e25f-898b-437d-b719-f983acdf4c42 admin admin] The token cache is being invalidate because project 57add73e985b4fee9d01e84edc801f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:41.348295 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c385e25f-898b-437d-b719-f983acdf4c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:41.348942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c385e25f-898b-437d-b719-f983acdf4c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:41.350445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1180/2348] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:41 2022] DELETE /identity/v3/projects/57add73e985b4fee9d01e84edc801f0c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:41.355582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3771fd0-a525-4d85-ba54-f17aac7ef162 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:41.355992 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3771fd0-a525-4d85-ba54-f17aac7ef162 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:41.356335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3771fd0-a525-4d85-ba54-f17aac7ef162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:41.375898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b3771fd0-a525-4d85-ba54-f17aac7ef162 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:41.377120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b3771fd0-a525-4d85-ba54-f17aac7ef162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:41.386993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:41.439450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1169/2349] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:41.448448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce29eb-490d-489e-a480-c7c945530e4b None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:41.448797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce29eb-490d-489e-a480-c7c945530e4b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:41.449073 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce29eb-490d-489e-a480-c7c945530e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:41.469743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-96ce29eb-490d-489e-a480-c7c945530e4b None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:41.471320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-96ce29eb-490d-489e-a480-c7c945530e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:41.480537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1181/2350] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:41.485050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3771fd0-a525-4d85-ba54-f17aac7ef162 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:41.495965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3771fd0-a525-4d85-ba54-f17aac7ef162 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:41.500637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c524757-2dbf-4830-b994-0c944023cca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:41.501379 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c524757-2dbf-4830-b994-0c944023cca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:41.501662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c524757-2dbf-4830-b994-0c944023cca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:41.501934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c524757-2dbf-4830-b994-0c944023cca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:41.502592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c524757-2dbf-4830-b994-0c944023cca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:41.502897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c524757-2dbf-4830-b994-0c944023cca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:41.504589 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c524757-2dbf-4830-b994-0c944023cca1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:41.517411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1170/2351] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:41.521971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce29eb-490d-489e-a480-c7c945530e4b None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:41.531729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce29eb-490d-489e-a480-c7c945530e4b None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:41.536901 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5e7c8-72b8-4950-892e-66efd8760ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:41.537424 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5e7c8-72b8-4950-892e-66efd8760ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:41.537700 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5e7c8-72b8-4950-892e-66efd8760ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:41.537969 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5e7c8-72b8-4950-892e-66efd8760ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:41.538590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5e7c8-72b8-4950-892e-66efd8760ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:41.540532 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5e7c8-72b8-4950-892e-66efd8760ff6 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:41.575729 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1182/2352] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:41 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:41.577444 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c524757-2dbf-4830-b994-0c944023cca1 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:41.592434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c524757-2dbf-4830-b994-0c944023cca1 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:41.661540 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fc4e8-d727-4e1c-b3d3-4e19f4cd4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:41.662294 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fc4e8-d727-4e1c-b3d3-4e19f4cd4f25 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:41.662580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fc4e8-d727-4e1c-b3d3-4e19f4cd4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:41.662852 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fc4e8-d727-4e1c-b3d3-4e19f4cd4f25 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:41.663504 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fc4e8-d727-4e1c-b3d3-4e19f4cd4f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:41.665457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fc4e8-d727-4e1c-b3d3-4e19f4cd4f25 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:41.695385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1171/2353] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:41 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:41.696744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5e7c8-72b8-4950-892e-66efd8760ff6 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:41.706926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5e7c8-72b8-4950-892e-66efd8760ff6 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:41.711673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d32a6-57aa-4e99-ab7b-26803eba526c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:41.712320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d32a6-57aa-4e99-ab7b-26803eba526c admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:41.712594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d32a6-57aa-4e99-ab7b-26803eba526c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:41.712862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d32a6-57aa-4e99-ab7b-26803eba526c admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:41.713552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d32a6-57aa-4e99-ab7b-26803eba526c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:41.715129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d32a6-57aa-4e99-ab7b-26803eba526c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:41.728950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1183/2354] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:41.730321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fc4e8-d727-4e1c-b3d3-4e19f4cd4f25 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:41.740807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fc4e8-d727-4e1c-b3d3-4e19f4cd4f25 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:41.745495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588a5a6-e738-4e65-b7e2-b0dabe7a6e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:41.746096 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588a5a6-e738-4e65-b7e2-b0dabe7a6e18 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:41.746390 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588a5a6-e738-4e65-b7e2-b0dabe7a6e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:41.746642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588a5a6-e738-4e65-b7e2-b0dabe7a6e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:41.747284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588a5a6-e738-4e65-b7e2-b0dabe7a6e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:41.748900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588a5a6-e738-4e65-b7e2-b0dabe7a6e18 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:41.760000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1172/2355] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:41.764427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d32a6-57aa-4e99-ab7b-26803eba526c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:41.774642 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d32a6-57aa-4e99-ab7b-26803eba526c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:41.779270 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e2749-c698-4600-bae4-1b72cb881d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:41.779946 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e2749-c698-4600-bae4-1b72cb881d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:41.780288 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e2749-c698-4600-bae4-1b72cb881d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:41.780537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e2749-c698-4600-bae4-1b72cb881d6c admin admin] PATH_INFO: `/v3/projects/3d8f97fb1f60493f9fa275f5a5559481/users/c2cdcd8e30c846f99117c413d806e0f7/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:41.794766 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e2749-c698-4600-bae4-1b72cb881d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8f97fb1f60493f9fa275f5a5559481, user_id=c2cdcd8e30c846f99117c413d806e0f7, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:41.797355 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e2749-c698-4600-bae4-1b72cb881d6c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:41.808756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:41.814454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1184/2356] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:41 2022] PUT /identity/v3/projects/3d8f97fb1f60493f9fa275f5a5559481/users/c2cdcd8e30c846f99117c413d806e0f7/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:41.825386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e0ac-3cc7-46f1-94b3-9c1935a7a060 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:41.825668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e0ac-3cc7-46f1-94b3-9c1935a7a060 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:41.825943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e0ac-3cc7-46f1-94b3-9c1935a7a060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:41.855319 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-85a5e0ac-3cc7-46f1-94b3-9c1935a7a060 None None] MFA Rules not processed for user `c2cdcd8e30c846f99117c413d806e0f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:41.856590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-85a5e0ac-3cc7-46f1-94b3-9c1935a7a060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:41.926604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1173/2357] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:41.938095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e2749-c698-4600-bae4-1b72cb881d6c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:41.940048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3b1e2749-c698-4600-bae4-1b72cb881d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:42.005600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e2749-c698-4600-bae4-1b72cb881d6c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:42.012569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7de23c-90f2-4773-bda4-37a8e9f445e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f886be277ef84ec28a290380980c6f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:42.013463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7de23c-90f2-4773-bda4-37a8e9f445e5 service glance] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:42.013719 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7de23c-90f2-4773-bda4-37a8e9f445e5 service glance] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:42.014014 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7de23c-90f2-4773-bda4-37a8e9f445e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:42.029142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7de23c-90f2-4773-bda4-37a8e9f445e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:42.031213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7de23c-90f2-4773-bda4-37a8e9f445e5 service glance] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:42.042174 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1185/2358] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:43.396208 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5e0ac-3cc7-46f1-94b3-9c1935a7a060 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:43.397838 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-85a5e0ac-3cc7-46f1-94b3-9c1935a7a060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:43.413047 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:43.462822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5e0ac-3cc7-46f1-94b3-9c1935a7a060 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:43.466744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70493a36-830c-45f2-902f-8f42ff22b074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:43.467353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70493a36-830c-45f2-902f-8f42ff22b074 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:43.467647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70493a36-830c-45f2-902f-8f42ff22b074 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:43.467933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70493a36-830c-45f2-902f-8f42ff22b074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:43.469818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-70493a36-830c-45f2-902f-8f42ff22b074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:43.479338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70493a36-830c-45f2-902f-8f42ff22b074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:43.480810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70493a36-830c-45f2-902f-8f42ff22b074 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:43.488802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1174/2359] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:43.807666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7de23c-90f2-4773-bda4-37a8e9f445e5 service glance] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:43.810402 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-9e7de23c-90f2-4773-bda4-37a8e9f445e5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:43.885522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7de23c-90f2-4773-bda4-37a8e9f445e5 service glance] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:43.892140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48a41-5bce-4a7f-9e0b-270d5d05cd15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01dd2631a81402d8a5bba7007c7fd61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:43.892755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48a41-5bce-4a7f-9e0b-270d5d05cd15 service placement] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:43.893029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48a41-5bce-4a7f-9e0b-270d5d05cd15 service placement] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:43.893294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c48a41-5bce-4a7f-9e0b-270d5d05cd15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:43.895434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e9c48a41-5bce-4a7f-9e0b-270d5d05cd15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:43.907954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c48a41-5bce-4a7f-9e0b-270d5d05cd15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:43.909579 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c48a41-5bce-4a7f-9e0b-270d5d05cd15 service placement] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:43.920123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1186/2360] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:44.398261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70493a36-830c-45f2-902f-8f42ff22b074 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:44.401197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-70493a36-830c-45f2-902f-8f42ff22b074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:44.501942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70493a36-830c-45f2-902f-8f42ff22b074 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:44.509667 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48243f5a-8d10-40ef-9ccb-52c0afae908e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:44.510344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48243f5a-8d10-40ef-9ccb-52c0afae908e service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:44.510647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48243f5a-8d10-40ef-9ccb-52c0afae908e service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:44.510936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48243f5a-8d10-40ef-9ccb-52c0afae908e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:44.512909 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-48243f5a-8d10-40ef-9ccb-52c0afae908e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:44.529439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48243f5a-8d10-40ef-9ccb-52c0afae908e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:44.531043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48243f5a-8d10-40ef-9ccb-52c0afae908e service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:44.542291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1175/2361] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:45.225406 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48a41-5bce-4a7f-9e0b-270d5d05cd15 service placement] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:45.234784 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c48a41-5bce-4a7f-9e0b-270d5d05cd15 service placement] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:45.238699 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4f3d2-24a2-4cdf-b925-6e2c4dd37f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:45.239358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4f3d2-24a2-4cdf-b925-6e2c4dd37f26 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:45.239633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4f3d2-24a2-4cdf-b925-6e2c4dd37f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:45.240418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4f3d2-24a2-4cdf-b925-6e2c4dd37f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:45.242179 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-65b4f3d2-24a2-4cdf-b925-6e2c4dd37f26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:45.323375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4f3d2-24a2-4cdf-b925-6e2c4dd37f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:45.324770 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4f3d2-24a2-4cdf-b925-6e2c4dd37f26 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:45.334702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1187/2362] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:45.783324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689a298-a659-447e-a92b-996227346d85 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:45.784271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689a298-a659-447e-a92b-996227346d85 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:45.784761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689a298-a659-447e-a92b-996227346d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:45.808898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3689a298-a659-447e-a92b-996227346d85 None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:45.810138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3689a298-a659-447e-a92b-996227346d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:45.866832 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1176/2363] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:26:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:45.879088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4f3d2-24a2-4cdf-b925-6e2c4dd37f26 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:45.880696 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-65b4f3d2-24a2-4cdf-b925-6e2c4dd37f26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:45.911997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:45.951718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4f3d2-24a2-4cdf-b925-6e2c4dd37f26 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:45.956797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081712d-16ef-4183-a2ba-c7b78c5ad6bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:45.957401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081712d-16ef-4183-a2ba-c7b78c5ad6bc service swift] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:45.957694 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081712d-16ef-4183-a2ba-c7b78c5ad6bc service swift] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:45.957981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081712d-16ef-4183-a2ba-c7b78c5ad6bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:45.966122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081712d-16ef-4183-a2ba-c7b78c5ad6bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:45.967892 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081712d-16ef-4183-a2ba-c7b78c5ad6bc service swift] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:45.977999 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1188/2364] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:26:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:26:49.698029 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251f117-e814-4d87-86ea-5b08ef13c759 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:49.698579 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251f117-e814-4d87-86ea-5b08ef13c759 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:49.698579 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251f117-e814-4d87-86ea-5b08ef13c759 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:49.700248 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1177/2365] 10.222.0.50 () {54 vars in 961 bytes} [Wed Aug 31 00:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:26:49.705373 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594c65b-4852-4619-a9ad-a029510bca03 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:49.705842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594c65b-4852-4619-a9ad-a029510bca03 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:49.706059 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594c65b-4852-4619-a9ad-a029510bca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:49.742983 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-0594c65b-4852-4619-a9ad-a029510bca03 None None] MFA Rules not processed for user `d01dd2631a81402d8a5bba7007c7fd61`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:49.748068 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-0594c65b-4852-4619-a9ad-a029510bca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:49.770626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1189/2366] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Aug 31 00:26:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:49.771288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251f117-e814-4d87-86ea-5b08ef13c759 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:49.773733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5251f117-e814-4d87-86ea-5b08ef13c759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:49.795922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594c65b-4852-4619-a9ad-a029510bca03 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:49.812138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594c65b-4852-4619-a9ad-a029510bca03 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:49.817044 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251f117-e814-4d87-86ea-5b08ef13c759 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:49.818663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e4b6e-4e27-4a51-b623-63a6ad530561 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01dd2631a81402d8a5bba7007c7fd61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:49.819423 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e4b6e-4e27-4a51-b623-63a6ad530561 service placement] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:49.819801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e4b6e-4e27-4a51-b623-63a6ad530561 service placement] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:49.820138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e4b6e-4e27-4a51-b623-63a6ad530561 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:49.821924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-910e4b6e-4e27-4a51-b623-63a6ad530561 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:49.823132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d5468-da75-4aeb-9ba3-0ec362246879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:49.824003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d5468-da75-4aeb-9ba3-0ec362246879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:49.824287 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d5468-da75-4aeb-9ba3-0ec362246879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:49.824565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d5468-da75-4aeb-9ba3-0ec362246879 admin admin] PATH_INFO: `/v3/users/0ae3ab8ab42b40739a90121bcbeaba2c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:49.825897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d5468-da75-4aeb-9ba3-0ec362246879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ae3ab8ab42b40739a90121bcbeaba2c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:49.828134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d5468-da75-4aeb-9ba3-0ec362246879 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:49.836045 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e4b6e-4e27-4a51-b623-63a6ad530561 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:49.837974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e4b6e-4e27-4a51-b623-63a6ad530561 service placement] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:49.851185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1190/2367] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:49.910556 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:49.917889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a06d5468-da75-4aeb-9ba3-0ec362246879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ae3ab8ab42b40739a90121bcbeaba2c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:49.938319 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a06d5468-da75-4aeb-9ba3-0ec362246879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ae3ab8ab42b40739a90121bcbeaba2c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:49.946808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a06d5468-da75-4aeb-9ba3-0ec362246879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ae3ab8ab42b40739a90121bcbeaba2c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:49.956215 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a06d5468-da75-4aeb-9ba3-0ec362246879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ae3ab8ab42b40739a90121bcbeaba2c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:49.956973 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a06d5468-da75-4aeb-9ba3-0ec362246879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ae3ab8ab42b40739a90121bcbeaba2c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:49.968073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1178/2368] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:49 2022] DELETE /identity/v3/users/0ae3ab8ab42b40739a90121bcbeaba2c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:50.183913 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e4b6e-4e27-4a51-b623-63a6ad530561 service placement] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:50.202392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e4b6e-4e27-4a51-b623-63a6ad530561 service placement] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:50.274286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de746a-9d7a-46a8-b3db-d1b4d643c519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:50.274943 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de746a-9d7a-46a8-b3db-d1b4d643c519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:50.275223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de746a-9d7a-46a8-b3db-d1b4d643c519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:50.275486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de746a-9d7a-46a8-b3db-d1b4d643c519 admin admin] PATH_INFO: `/v3/projects/2899e565da2f4eac90b470fadf5792e6` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:50.276662 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de746a-9d7a-46a8-b3db-d1b4d643c519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2899e565da2f4eac90b470fadf5792e6)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:50.278884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de746a-9d7a-46a8-b3db-d1b4d643c519 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:50.363164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f0de746a-9d7a-46a8-b3db-d1b4d643c519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2899e565da2f4eac90b470fadf5792e6', 'request_id': 'req-f0de746a-9d7a-46a8-b3db-d1b4d643c519'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:50.384434 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f0de746a-9d7a-46a8-b3db-d1b4d643c519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2899e565da2f4eac90b470fadf5792e6', 'request_id': 'req-f0de746a-9d7a-46a8-b3db-d1b4d643c519'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:50.398436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f0de746a-9d7a-46a8-b3db-d1b4d643c519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2899e565da2f4eac90b470fadf5792e6', 'request_id': 'req-f0de746a-9d7a-46a8-b3db-d1b4d643c519'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:50.424234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f0de746a-9d7a-46a8-b3db-d1b4d643c519 admin admin] The token cache is being invalidate because project 2899e565da2f4eac90b470fadf5792e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:50.424531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f0de746a-9d7a-46a8-b3db-d1b4d643c519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:50.425290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f0de746a-9d7a-46a8-b3db-d1b4d643c519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:50.427745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1191/2369] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:50 2022] DELETE /identity/v3/projects/2899e565da2f4eac90b470fadf5792e6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:50.432199 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782d72-49c3-4738-b1d8-e6da70db95c2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:50.432496 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782d72-49c3-4738-b1d8-e6da70db95c2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:50.432776 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782d72-49c3-4738-b1d8-e6da70db95c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:50.484978 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-30782d72-49c3-4738-b1d8-e6da70db95c2 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:50.486373 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-30782d72-49c3-4738-b1d8-e6da70db95c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:50.570262 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1179/2370] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:50.580243 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed67d0a-3b05-4466-bcf9-c97938b4b66c None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:50.581935 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed67d0a-3b05-4466-bcf9-c97938b4b66c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:50.582829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed67d0a-3b05-4466-bcf9-c97938b4b66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:50.608203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-fed67d0a-3b05-4466-bcf9-c97938b4b66c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:50.609447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-fed67d0a-3b05-4466-bcf9-c97938b4b66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:50.622819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1192/2371] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:50.628052 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30782d72-49c3-4738-b1d8-e6da70db95c2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:50.639191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30782d72-49c3-4738-b1d8-e6da70db95c2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:50.644994 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea542df-10d0-4166-bdc6-6c15aee64235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:50.645840 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea542df-10d0-4166-bdc6-6c15aee64235 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:50.646172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea542df-10d0-4166-bdc6-6c15aee64235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:50.646507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea542df-10d0-4166-bdc6-6c15aee64235 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:50.647233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea542df-10d0-4166-bdc6-6c15aee64235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:50.647640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea542df-10d0-4166-bdc6-6c15aee64235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:50.649348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea542df-10d0-4166-bdc6-6c15aee64235 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:50.665613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1180/2372] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:50.667301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed67d0a-3b05-4466-bcf9-c97938b4b66c None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:50.678802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed67d0a-3b05-4466-bcf9-c97938b4b66c None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:50.687442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5a70b-d369-4e86-b1d5-d69899c9fef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:50.688193 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5a70b-d369-4e86-b1d5-d69899c9fef6 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:50.688543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5a70b-d369-4e86-b1d5-d69899c9fef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:50.688858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5a70b-d369-4e86-b1d5-d69899c9fef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:50.689608 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5a70b-d369-4e86-b1d5-d69899c9fef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:50.691618 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5a70b-d369-4e86-b1d5-d69899c9fef6 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:50.716963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:50.727739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1193/2373] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:50 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:50.731229 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea542df-10d0-4166-bdc6-6c15aee64235 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:50.742559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea542df-10d0-4166-bdc6-6c15aee64235 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:50.811266 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29969642-4e49-47c9-8776-6dfdf00d3405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:50.812004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29969642-4e49-47c9-8776-6dfdf00d3405 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:50.812286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29969642-4e49-47c9-8776-6dfdf00d3405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:50.812672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29969642-4e49-47c9-8776-6dfdf00d3405 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:50.813353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29969642-4e49-47c9-8776-6dfdf00d3405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:50.815276 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29969642-4e49-47c9-8776-6dfdf00d3405 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:50.842289 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1181/2374] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:50 2022] POST /identity/v3/users => generated 282 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:50.847739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5a70b-d369-4e86-b1d5-d69899c9fef6 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:50.862040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5a70b-d369-4e86-b1d5-d69899c9fef6 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:50.866829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bcb43-95f1-4206-8a07-60317c4a2c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:50.867501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bcb43-95f1-4206-8a07-60317c4a2c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:50.867810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bcb43-95f1-4206-8a07-60317c4a2c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:50.868085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bcb43-95f1-4206-8a07-60317c4a2c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:50.868731 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bcb43-95f1-4206-8a07-60317c4a2c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:50.870391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bcb43-95f1-4206-8a07-60317c4a2c51 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:50.887105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1194/2375] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:50.888508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29969642-4e49-47c9-8776-6dfdf00d3405 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:50.899320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29969642-4e49-47c9-8776-6dfdf00d3405 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:50.905220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef1281-4371-4f5d-b477-957d7937ce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:50.906817 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef1281-4371-4f5d-b477-957d7937ce81 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:50.907132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef1281-4371-4f5d-b477-957d7937ce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:50.907414 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef1281-4371-4f5d-b477-957d7937ce81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:50.908216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef1281-4371-4f5d-b477-957d7937ce81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:50.910081 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef1281-4371-4f5d-b477-957d7937ce81 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:50.921726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1182/2376] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:50.926590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bcb43-95f1-4206-8a07-60317c4a2c51 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:50.937306 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bcb43-95f1-4206-8a07-60317c4a2c51 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:50.941982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582bd7-23fa-4b99-a968-912b57b132d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:50.942788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582bd7-23fa-4b99-a968-912b57b132d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:50.943115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582bd7-23fa-4b99-a968-912b57b132d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:50.943391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582bd7-23fa-4b99-a968-912b57b132d9 admin admin] PATH_INFO: `/v3/projects/965b5d7fb640422fa279d136e5b209c1/users/1fa3b7255bee415c9d7b4c250839e7cf/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:50.959308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff582bd7-23fa-4b99-a968-912b57b132d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965b5d7fb640422fa279d136e5b209c1, user_id=1fa3b7255bee415c9d7b4c250839e7cf, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:50.962128 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff582bd7-23fa-4b99-a968-912b57b132d9 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:50.977636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1195/2377] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:50 2022] PUT /identity/v3/projects/965b5d7fb640422fa279d136e5b209c1/users/1fa3b7255bee415c9d7b4c250839e7cf/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:50.994279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b4201-e9b5-428a-8a6e-9656ffc730ff None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:50.994590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b4201-e9b5-428a-8a6e-9656ffc730ff None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:50.994869 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b4201-e9b5-428a-8a6e-9656ffc730ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.026426 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-958b4201-e9b5-428a-8a6e-9656ffc730ff None None] MFA Rules not processed for user `1fa3b7255bee415c9d7b4c250839e7cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:51.027796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-958b4201-e9b5-428a-8a6e-9656ffc730ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:51.047235 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:51.129589 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1183/2378] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:51.134499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582bd7-23fa-4b99-a968-912b57b132d9 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.202980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582bd7-23fa-4b99-a968-912b57b132d9 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.208051 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b17dc-3b3f-4793-b32e-792e21dad738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.208675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b17dc-3b3f-4793-b32e-792e21dad738 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.208951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b17dc-3b3f-4793-b32e-792e21dad738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.209258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b17dc-3b3f-4793-b32e-792e21dad738 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.209986 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b17dc-3b3f-4793-b32e-792e21dad738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:51.211961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b17dc-3b3f-4793-b32e-792e21dad738 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:51.243574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1196/2379] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:51 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:51.245168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b4201-e9b5-428a-8a6e-9656ffc730ff None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.258562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b4201-e9b5-428a-8a6e-9656ffc730ff None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.327681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c64165-6546-49f2-978c-57875896ed4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.328613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c64165-6546-49f2-978c-57875896ed4b admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.328928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c64165-6546-49f2-978c-57875896ed4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.329203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c64165-6546-49f2-978c-57875896ed4b admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.329854 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c64165-6546-49f2-978c-57875896ed4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:51.331806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c64165-6546-49f2-978c-57875896ed4b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:51.358856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1184/2380] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:51 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:51.363115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b17dc-3b3f-4793-b32e-792e21dad738 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.374741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b17dc-3b3f-4793-b32e-792e21dad738 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.379735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0630a-6d7c-4e42-a322-acb5ba3af92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.380273 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0630a-6d7c-4e42-a322-acb5ba3af92e admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.380556 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0630a-6d7c-4e42-a322-acb5ba3af92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.380830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0630a-6d7c-4e42-a322-acb5ba3af92e admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.381493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0630a-6d7c-4e42-a322-acb5ba3af92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:51.383139 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0630a-6d7c-4e42-a322-acb5ba3af92e admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:51.395917 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1197/2381] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:51.404503 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c64165-6546-49f2-978c-57875896ed4b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.415221 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c64165-6546-49f2-978c-57875896ed4b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.420030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a735367-b8c8-4ee9-a04e-59500fadcf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.420714 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a735367-b8c8-4ee9-a04e-59500fadcf62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.420996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a735367-b8c8-4ee9-a04e-59500fadcf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.421274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a735367-b8c8-4ee9-a04e-59500fadcf62 admin admin] PATH_INFO: `/v3/projects/7a735fbd8d994f98a9e2a10be95eb4fd/users/3daa7224858c4c098f8a4ca7c57baeae/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.438848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a735367-b8c8-4ee9-a04e-59500fadcf62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a735fbd8d994f98a9e2a10be95eb4fd, user_id=3daa7224858c4c098f8a4ca7c57baeae, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:51.441796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a735367-b8c8-4ee9-a04e-59500fadcf62 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:51.460043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1185/2382] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:51 2022] PUT /identity/v3/projects/7a735fbd8d994f98a9e2a10be95eb4fd/users/3daa7224858c4c098f8a4ca7c57baeae/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:51.464166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0630a-6d7c-4e42-a322-acb5ba3af92e admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.475258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0630a-6d7c-4e42-a322-acb5ba3af92e admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.541044 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd99524-3ff4-412c-9424-0a2809000074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.541679 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd99524-3ff4-412c-9424-0a2809000074 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.541984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd99524-3ff4-412c-9424-0a2809000074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.542496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd99524-3ff4-412c-9424-0a2809000074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.543178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd99524-3ff4-412c-9424-0a2809000074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:51.544815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd99524-3ff4-412c-9424-0a2809000074 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:51.557553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1198/2383] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:51.561778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a735367-b8c8-4ee9-a04e-59500fadcf62 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.572648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a735367-b8c8-4ee9-a04e-59500fadcf62 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.577678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974af659-a891-46ec-9c22-e153b887f513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.578350 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974af659-a891-46ec-9c22-e153b887f513 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.578626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974af659-a891-46ec-9c22-e153b887f513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.579063 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974af659-a891-46ec-9c22-e153b887f513 admin admin] PATH_INFO: `/v3/projects/7a735fbd8d994f98a9e2a10be95eb4fd/users/3daa7224858c4c098f8a4ca7c57baeae/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.580999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974af659-a891-46ec-9c22-e153b887f513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a735fbd8d994f98a9e2a10be95eb4fd, user_id=3daa7224858c4c098f8a4ca7c57baeae, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:51.583883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974af659-a891-46ec-9c22-e153b887f513 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:51.596330 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1186/2384] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:51 2022] PUT /identity/v3/projects/7a735fbd8d994f98a9e2a10be95eb4fd/users/3daa7224858c4c098f8a4ca7c57baeae/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:51.607412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f543e-319f-449f-bc5f-cd21d03bd659 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.607833 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f543e-319f-449f-bc5f-cd21d03bd659 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.608114 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f543e-319f-449f-bc5f-cd21d03bd659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.648422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-b53f543e-319f-449f-bc5f-cd21d03bd659 None None] MFA Rules not processed for user `3daa7224858c4c098f8a4ca7c57baeae`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:51.650272 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b53f543e-319f-449f-bc5f-cd21d03bd659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:51.672094 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:51.763063 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1199/2385] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:51.775204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974af659-a891-46ec-9c22-e153b887f513 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.775204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-974af659-a891-46ec-9c22-e153b887f513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:51.848736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974af659-a891-46ec-9c22-e153b887f513 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.852562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef5c59-ff71-45c9-b91e-5802f5c4f85f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.853691 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef5c59-ff71-45c9-b91e-5802f5c4f85f service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.854001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef5c59-ff71-45c9-b91e-5802f5c4f85f service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.854277 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef5c59-ff71-45c9-b91e-5802f5c4f85f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.864304 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef5c59-ff71-45c9-b91e-5802f5c4f85f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:51.865763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef5c59-ff71-45c9-b91e-5802f5c4f85f service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:51.875987 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1187/2386] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:51.969468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f543e-319f-449f-bc5f-cd21d03bd659 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.979539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f543e-319f-449f-bc5f-cd21d03bd659 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.983220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a560ab-f2d3-4828-a472-75d8ed2f7967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.984143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a560ab-f2d3-4828-a472-75d8ed2f7967 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.984495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a560ab-f2d3-4828-a472-75d8ed2f7967 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.984931 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a560ab-f2d3-4828-a472-75d8ed2f7967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:52.044819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a560ab-f2d3-4828-a472-75d8ed2f7967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:52.046418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a560ab-f2d3-4828-a472-75d8ed2f7967 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:52.056879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1200/2387] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:54.932475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef5c59-ff71-45c9-b91e-5802f5c4f85f service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:54.941397 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:54.999034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef5c59-ff71-45c9-b91e-5802f5c4f85f service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:55.004481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd1a57-3147-4bf2-82cf-6e7a146f9509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:55.005141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd1a57-3147-4bf2-82cf-6e7a146f9509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.005418 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd1a57-3147-4bf2-82cf-6e7a146f9509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.005704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd1a57-3147-4bf2-82cf-6e7a146f9509 admin admin] PATH_INFO: `/v3/users/1fa3b7255bee415c9d7b4c250839e7cf` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.006854 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd1a57-3147-4bf2-82cf-6e7a146f9509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa3b7255bee415c9d7b4c250839e7cf)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:55.008824 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd1a57-3147-4bf2-82cf-6e7a146f9509 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:55.062386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-facd1a57-3147-4bf2-82cf-6e7a146f9509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa3b7255bee415c9d7b4c250839e7cf'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.081631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-facd1a57-3147-4bf2-82cf-6e7a146f9509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa3b7255bee415c9d7b4c250839e7cf'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.089781 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-facd1a57-3147-4bf2-82cf-6e7a146f9509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa3b7255bee415c9d7b4c250839e7cf'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.101677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-facd1a57-3147-4bf2-82cf-6e7a146f9509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa3b7255bee415c9d7b4c250839e7cf'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.102524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-facd1a57-3147-4bf2-82cf-6e7a146f9509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa3b7255bee415c9d7b4c250839e7cf'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.109338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1188/2388] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:54 2022] DELETE /identity/v3/users/1fa3b7255bee415c9d7b4c250839e7cf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:55.113949 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448bebe-a5ff-40ff-8b8b-dc39d768ea7a None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.114551 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448bebe-a5ff-40ff-8b8b-dc39d768ea7a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.114551 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448bebe-a5ff-40ff-8b8b-dc39d768ea7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.133708 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-4448bebe-a5ff-40ff-8b8b-dc39d768ea7a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:55.134915 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-4448bebe-a5ff-40ff-8b8b-dc39d768ea7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:55.206036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1201/2389] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:55.216185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd1a57-3147-4bf2-82cf-6e7a146f9509 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:55.217661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-facd1a57-3147-4bf2-82cf-6e7a146f9509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:55.289625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd1a57-3147-4bf2-82cf-6e7a146f9509 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:55.295180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aa7a8-07ce-420a-9045-c3416bb330c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:55.295180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aa7a8-07ce-420a-9045-c3416bb330c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.295180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aa7a8-07ce-420a-9045-c3416bb330c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.295180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aa7a8-07ce-420a-9045-c3416bb330c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.308353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65aa7a8-07ce-420a-9045-c3416bb330c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:55.312284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65aa7a8-07ce-420a-9045-c3416bb330c6 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:55.322810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1189/2390] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:55.677948 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448bebe-a5ff-40ff-8b8b-dc39d768ea7a None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:55.679454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-4448bebe-a5ff-40ff-8b8b-dc39d768ea7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:55.694338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448bebe-a5ff-40ff-8b8b-dc39d768ea7a None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:55.699748 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:55.700389 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.700666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.701638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] PATH_INFO: `/v3/projects/965b5d7fb640422fa279d136e5b209c1` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.703088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=965b5d7fb640422fa279d136e5b209c1)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:55.705074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:55.761462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '965b5d7fb640422fa279d136e5b209c1', 'request_id': 'req-e010d492-8a5b-43ca-b022-5ca065fba6ff'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.763958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:55.772070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '965b5d7fb640422fa279d136e5b209c1', 'request_id': 'req-e010d492-8a5b-43ca-b022-5ca065fba6ff'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.778756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '965b5d7fb640422fa279d136e5b209c1', 'request_id': 'req-e010d492-8a5b-43ca-b022-5ca065fba6ff'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.790667 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] The token cache is being invalidate because project 965b5d7fb640422fa279d136e5b209c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:55.790970 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.791658 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.793197 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1202/2391] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:55 2022] DELETE /identity/v3/projects/965b5d7fb640422fa279d136e5b209c1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:55.800211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aa7a8-07ce-420a-9045-c3416bb330c6 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:55.810350 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aa7a8-07ce-420a-9045-c3416bb330c6 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:55.840976 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:55.878371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a857a-6258-4aac-ad76-7a0ab3804b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:55.879041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a857a-6258-4aac-ad76-7a0ab3804b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.879321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a857a-6258-4aac-ad76-7a0ab3804b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.879592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a857a-6258-4aac-ad76-7a0ab3804b07 admin admin] PATH_INFO: `/v3/users/3daa7224858c4c098f8a4ca7c57baeae` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.880923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a857a-6258-4aac-ad76-7a0ab3804b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3daa7224858c4c098f8a4ca7c57baeae)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:55.882873 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a857a-6258-4aac-ad76-7a0ab3804b07 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:55.940615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-965a857a-6258-4aac-ad76-7a0ab3804b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3daa7224858c4c098f8a4ca7c57baeae'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.954476 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-965a857a-6258-4aac-ad76-7a0ab3804b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3daa7224858c4c098f8a4ca7c57baeae'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.962550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-965a857a-6258-4aac-ad76-7a0ab3804b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3daa7224858c4c098f8a4ca7c57baeae'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.973281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-965a857a-6258-4aac-ad76-7a0ab3804b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3daa7224858c4c098f8a4ca7c57baeae'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.973885 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-965a857a-6258-4aac-ad76-7a0ab3804b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3daa7224858c4c098f8a4ca7c57baeae'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:55.981480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1190/2392] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:55 2022] DELETE /identity/v3/users/3daa7224858c4c098f8a4ca7c57baeae => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:56.280049 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.281479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:56.296732 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010d492-8a5b-43ca-b022-5ca065fba6ff admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.371565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477ce00-ed04-444c-9613-7a397a37e517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.372493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477ce00-ed04-444c-9613-7a397a37e517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.372806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477ce00-ed04-444c-9613-7a397a37e517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.373142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477ce00-ed04-444c-9613-7a397a37e517 admin admin] PATH_INFO: `/v3/projects/7a735fbd8d994f98a9e2a10be95eb4fd` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.374359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477ce00-ed04-444c-9613-7a397a37e517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a735fbd8d994f98a9e2a10be95eb4fd)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.376912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477ce00-ed04-444c-9613-7a397a37e517 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.448327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-3477ce00-ed04-444c-9613-7a397a37e517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a735fbd8d994f98a9e2a10be95eb4fd', 'request_id': 'req-3477ce00-ed04-444c-9613-7a397a37e517'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:56.459087 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-3477ce00-ed04-444c-9613-7a397a37e517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a735fbd8d994f98a9e2a10be95eb4fd', 'request_id': 'req-3477ce00-ed04-444c-9613-7a397a37e517'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:56.466421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-3477ce00-ed04-444c-9613-7a397a37e517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a735fbd8d994f98a9e2a10be95eb4fd', 'request_id': 'req-3477ce00-ed04-444c-9613-7a397a37e517'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:56.479547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-3477ce00-ed04-444c-9613-7a397a37e517 admin admin] The token cache is being invalidate because project 7a735fbd8d994f98a9e2a10be95eb4fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:56.480070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-3477ce00-ed04-444c-9613-7a397a37e517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:56.481128 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-3477ce00-ed04-444c-9613-7a397a37e517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:56.483770 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1203/2393] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:56 2022] DELETE /identity/v3/projects/7a735fbd8d994f98a9e2a10be95eb4fd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:56.489751 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d1156-4a04-4b72-8d5c-11152a12c4b9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.490037 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d1156-4a04-4b72-8d5c-11152a12c4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.490309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d1156-4a04-4b72-8d5c-11152a12c4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.512152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-216d1156-4a04-4b72-8d5c-11152a12c4b9 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:56.513355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-216d1156-4a04-4b72-8d5c-11152a12c4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:56.576069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1191/2394] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:56.584099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68d60-3fc7-406e-8b70-61c25ed8d698 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.584488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68d60-3fc7-406e-8b70-61c25ed8d698 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.584848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68d60-3fc7-406e-8b70-61c25ed8d698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.606446 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-b3a68d60-3fc7-406e-8b70-61c25ed8d698 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:56.607545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b3a68d60-3fc7-406e-8b70-61c25ed8d698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:56.615841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1204/2395] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:56.625926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d1156-4a04-4b72-8d5c-11152a12c4b9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.636087 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d1156-4a04-4b72-8d5c-11152a12c4b9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.641257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da7762-7a6f-4fd1-9abf-0567ffaea527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.642133 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7762-7a6f-4fd1-9abf-0567ffaea527 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.642476 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7762-7a6f-4fd1-9abf-0567ffaea527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.642959 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7762-7a6f-4fd1-9abf-0567ffaea527 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.643585 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da7762-7a6f-4fd1-9abf-0567ffaea527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:56.644038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da7762-7a6f-4fd1-9abf-0567ffaea527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.645876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da7762-7a6f-4fd1-9abf-0567ffaea527 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.661426 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1192/2396] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:26:56.663924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a68d60-3fc7-406e-8b70-61c25ed8d698 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.674536 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a68d60-3fc7-406e-8b70-61c25ed8d698 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.679402 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbd713-b6d4-4c58-8825-d293e5a8754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.680054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbd713-b6d4-4c58-8825-d293e5a8754d admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.680331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbd713-b6d4-4c58-8825-d293e5a8754d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.680601 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbd713-b6d4-4c58-8825-d293e5a8754d admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.681228 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbd713-b6d4-4c58-8825-d293e5a8754d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.683249 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbd713-b6d4-4c58-8825-d293e5a8754d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.720228 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1205/2397] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:56 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:56.722153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da7762-7a6f-4fd1-9abf-0567ffaea527 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.739406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da7762-7a6f-4fd1-9abf-0567ffaea527 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.776828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:56.807709 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf549fb-1446-415c-a8cd-28743adce26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.808362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf549fb-1446-415c-a8cd-28743adce26a admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.808637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf549fb-1446-415c-a8cd-28743adce26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.808911 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf549fb-1446-415c-a8cd-28743adce26a admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.809545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf549fb-1446-415c-a8cd-28743adce26a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.811453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf549fb-1446-415c-a8cd-28743adce26a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.840499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1193/2398] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:56 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:56.845188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbd713-b6d4-4c58-8825-d293e5a8754d admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.857001 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbd713-b6d4-4c58-8825-d293e5a8754d admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.862134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77512fe9-9e7e-4f51-b83c-4bae2082004d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.862739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77512fe9-9e7e-4f51-b83c-4bae2082004d admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.863017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77512fe9-9e7e-4f51-b83c-4bae2082004d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.863285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77512fe9-9e7e-4f51-b83c-4bae2082004d admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.863958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77512fe9-9e7e-4f51-b83c-4bae2082004d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.865609 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77512fe9-9e7e-4f51-b83c-4bae2082004d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.875964 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1206/2399] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:56.880342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf549fb-1446-415c-a8cd-28743adce26a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.891185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf549fb-1446-415c-a8cd-28743adce26a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.897036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cea4b-d2e4-4f16-a329-651d90d2eb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.897591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cea4b-d2e4-4f16-a329-651d90d2eb03 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.897866 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cea4b-d2e4-4f16-a329-651d90d2eb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.898134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cea4b-d2e4-4f16-a329-651d90d2eb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.898773 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cea4b-d2e4-4f16-a329-651d90d2eb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.900450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cea4b-d2e4-4f16-a329-651d90d2eb03 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.910992 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1194/2400] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:56.915547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77512fe9-9e7e-4f51-b83c-4bae2082004d admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.926549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77512fe9-9e7e-4f51-b83c-4bae2082004d admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.932167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44d7f8-665f-4279-88d3-8ffd45946c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.932829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44d7f8-665f-4279-88d3-8ffd45946c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.933101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44d7f8-665f-4279-88d3-8ffd45946c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.933379 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44d7f8-665f-4279-88d3-8ffd45946c48 admin admin] PATH_INFO: `/v3/projects/4eeaf5efcb824ea9aa8cb108ba720a5c/users/140dfb92f6de4c51826c72810a69c388/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.949809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44d7f8-665f-4279-88d3-8ffd45946c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eeaf5efcb824ea9aa8cb108ba720a5c, user_id=140dfb92f6de4c51826c72810a69c388, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.952597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44d7f8-665f-4279-88d3-8ffd45946c48 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.969356 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1207/2401] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:56 2022] PUT /identity/v3/projects/4eeaf5efcb824ea9aa8cb108ba720a5c/users/140dfb92f6de4c51826c72810a69c388/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:56.981126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad8d55-14c8-4ae3-bc6e-476cc06cfc0d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.981622 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad8d55-14c8-4ae3-bc6e-476cc06cfc0d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.981741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad8d55-14c8-4ae3-bc6e-476cc06cfc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:57.009683 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-50ad8d55-14c8-4ae3-bc6e-476cc06cfc0d None None] MFA Rules not processed for user `140dfb92f6de4c51826c72810a69c388`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:57.010802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-50ad8d55-14c8-4ae3-bc6e-476cc06cfc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:57.075123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1195/2402] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:57.080239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44d7f8-665f-4279-88d3-8ffd45946c48 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:57.089883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:57.152515 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44d7f8-665f-4279-88d3-8ffd45946c48 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:57.162747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11888ff-9a18-4ab3-bd8f-d802f0b80db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:57.163381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11888ff-9a18-4ab3-bd8f-d802f0b80db2 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:57.163658 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11888ff-9a18-4ab3-bd8f-d802f0b80db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:57.163958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11888ff-9a18-4ab3-bd8f-d802f0b80db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:57.164609 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11888ff-9a18-4ab3-bd8f-d802f0b80db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:57.166535 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11888ff-9a18-4ab3-bd8f-d802f0b80db2 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:57.195836 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1208/2403] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:57 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:57.200108 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad8d55-14c8-4ae3-bc6e-476cc06cfc0d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:57.211510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad8d55-14c8-4ae3-bc6e-476cc06cfc0d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:57.269814 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2f7a8-ef11-47c9-b038-26005c33f328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:57.270489 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2f7a8-ef11-47c9-b038-26005c33f328 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:57.270769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2f7a8-ef11-47c9-b038-26005c33f328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:57.271046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2f7a8-ef11-47c9-b038-26005c33f328 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:57.271690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2f7a8-ef11-47c9-b038-26005c33f328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:57.273665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2f7a8-ef11-47c9-b038-26005c33f328 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:57.296764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1196/2404] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:57 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:57.301180 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11888ff-9a18-4ab3-bd8f-d802f0b80db2 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:57.312509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11888ff-9a18-4ab3-bd8f-d802f0b80db2 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:57.318864 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3141128-246d-4eaf-b88a-dfc403b073a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:57.319471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3141128-246d-4eaf-b88a-dfc403b073a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:57.319774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3141128-246d-4eaf-b88a-dfc403b073a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:57.320088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3141128-246d-4eaf-b88a-dfc403b073a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:57.320726 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3141128-246d-4eaf-b88a-dfc403b073a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:57.322370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3141128-246d-4eaf-b88a-dfc403b073a0 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:57.334062 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1209/2405] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:57.338324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2f7a8-ef11-47c9-b038-26005c33f328 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:57.348705 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2f7a8-ef11-47c9-b038-26005c33f328 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:57.353819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e95794-4c02-4871-bbc2-e84d103079b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:57.354465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e95794-4c02-4871-bbc2-e84d103079b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:57.354742 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e95794-4c02-4871-bbc2-e84d103079b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:57.355011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e95794-4c02-4871-bbc2-e84d103079b9 admin admin] PATH_INFO: `/v3/projects/38d3af0dd5eb41c79334b99d1b8f5f76/users/568f0227904648278eb0ba0df6833f36/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:57.370337 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e95794-4c02-4871-bbc2-e84d103079b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d3af0dd5eb41c79334b99d1b8f5f76, user_id=568f0227904648278eb0ba0df6833f36, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:57.373048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e95794-4c02-4871-bbc2-e84d103079b9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:57.389035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1197/2406] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:57 2022] PUT /identity/v3/projects/38d3af0dd5eb41c79334b99d1b8f5f76/users/568f0227904648278eb0ba0df6833f36/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:57.393530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3141128-246d-4eaf-b88a-dfc403b073a0 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:57.405181 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3141128-246d-4eaf-b88a-dfc403b073a0 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:57.474987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176a03e-bff7-49e4-a3a1-5390bea6354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:57.475612 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a03e-bff7-49e4-a3a1-5390bea6354d admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:57.476075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a03e-bff7-49e4-a3a1-5390bea6354d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:57.476342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a03e-bff7-49e4-a3a1-5390bea6354d admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:57.476966 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a03e-bff7-49e4-a3a1-5390bea6354d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:57.487935 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a03e-bff7-49e4-a3a1-5390bea6354d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:57.494700 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1210/2407] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:57.495012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e95794-4c02-4871-bbc2-e84d103079b9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:57.505678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e95794-4c02-4871-bbc2-e84d103079b9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:57.510396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eecbd-0afb-43c5-a871-4edc285bab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:57.511062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eecbd-0afb-43c5-a871-4edc285bab87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:57.511408 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eecbd-0afb-43c5-a871-4edc285bab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:57.511757 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eecbd-0afb-43c5-a871-4edc285bab87 admin admin] PATH_INFO: `/v3/projects/38d3af0dd5eb41c79334b99d1b8f5f76/users/568f0227904648278eb0ba0df6833f36/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:57.513802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eecbd-0afb-43c5-a871-4edc285bab87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d3af0dd5eb41c79334b99d1b8f5f76, user_id=568f0227904648278eb0ba0df6833f36, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:57.517184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eecbd-0afb-43c5-a871-4edc285bab87 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:57.520802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:57.535048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1198/2408] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:57 2022] PUT /identity/v3/projects/38d3af0dd5eb41c79334b99d1b8f5f76/users/568f0227904648278eb0ba0df6833f36/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:57.547044 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d499-067f-4029-b643-9631df52fa8b None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:57.547339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d499-067f-4029-b643-9631df52fa8b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:57.547594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d499-067f-4029-b643-9631df52fa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:57.579472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-d9b6d499-067f-4029-b643-9631df52fa8b None None] MFA Rules not processed for user `568f0227904648278eb0ba0df6833f36`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:57.581355 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d9b6d499-067f-4029-b643-9631df52fa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:57.672801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1211/2409] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:57.685930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eecbd-0afb-43c5-a871-4edc285bab87 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:57.688106 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-913eecbd-0afb-43c5-a871-4edc285bab87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:57.778836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eecbd-0afb-43c5-a871-4edc285bab87 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:57.784101 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9959f11-bba7-43f6-bc84-ca92b69cece3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:57.785045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9959f11-bba7-43f6-bc84-ca92b69cece3 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:57.785483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9959f11-bba7-43f6-bc84-ca92b69cece3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:57.785703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9959f11-bba7-43f6-bc84-ca92b69cece3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:57.799392 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9959f11-bba7-43f6-bc84-ca92b69cece3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:57.801000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9959f11-bba7-43f6-bc84-ca92b69cece3 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:57.817657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1199/2410] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:57.922722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6d499-067f-4029-b643-9631df52fa8b None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:57.928396 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:57.943834 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6d499-067f-4029-b643-9631df52fa8b None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:57.948730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfc764-a61c-4006-a916-229c3c885782 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:57.949468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc764-a61c-4006-a916-229c3c885782 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:57.949808 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc764-a61c-4006-a916-229c3c885782 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:57.950145 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc764-a61c-4006-a916-229c3c885782 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:58.012078 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfc764-a61c-4006-a916-229c3c885782 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:58.013709 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfc764-a61c-4006-a916-229c3c885782 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:58.025059 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1212/2411] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:58.971233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9959f11-bba7-43f6-bc84-ca92b69cece3 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:58.973048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f9959f11-bba7-43f6-bc84-ca92b69cece3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:59.037880 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9959f11-bba7-43f6-bc84-ca92b69cece3 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:59.042565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c239d-e916-4ba5-923d-8f2f9facecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:59.043191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c239d-e916-4ba5-923d-8f2f9facecc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:59.043467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c239d-e916-4ba5-923d-8f2f9facecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:59.043730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c239d-e916-4ba5-923d-8f2f9facecc8 admin admin] PATH_INFO: `/v3/users/c2cdcd8e30c846f99117c413d806e0f7` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:59.044863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c239d-e916-4ba5-923d-8f2f9facecc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2cdcd8e30c846f99117c413d806e0f7)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:59.046810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c239d-e916-4ba5-923d-8f2f9facecc8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:59.098390 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d64c239d-e916-4ba5-923d-8f2f9facecc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2cdcd8e30c846f99117c413d806e0f7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:59.110789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d64c239d-e916-4ba5-923d-8f2f9facecc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2cdcd8e30c846f99117c413d806e0f7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:59.118101 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d64c239d-e916-4ba5-923d-8f2f9facecc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2cdcd8e30c846f99117c413d806e0f7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:59.126078 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d64c239d-e916-4ba5-923d-8f2f9facecc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2cdcd8e30c846f99117c413d806e0f7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:59.126727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d64c239d-e916-4ba5-923d-8f2f9facecc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2cdcd8e30c846f99117c413d806e0f7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:59.132717 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1200/2412] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:58 2022] DELETE /identity/v3/users/c2cdcd8e30c846f99117c413d806e0f7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:59.137281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bff1-923f-43bb-a190-7cfb8d33ec15 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:59.137794 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bff1-923f-43bb-a190-7cfb8d33ec15 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:59.138001 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bff1-923f-43bb-a190-7cfb8d33ec15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:59.157196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-6249bff1-923f-43bb-a190-7cfb8d33ec15 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:59.158381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6249bff1-923f-43bb-a190-7cfb8d33ec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:59.220013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1213/2413] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:59.229858 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c239d-e916-4ba5-923d-8f2f9facecc8 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:59.231279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d64c239d-e916-4ba5-923d-8f2f9facecc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:59.252019 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:59.296646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c239d-e916-4ba5-923d-8f2f9facecc8 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:59.300671 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48e557-b7f8-47f3-8304-c3df6395ac3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:59.301289 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48e557-b7f8-47f3-8304-c3df6395ac3d service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:59.301568 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48e557-b7f8-47f3-8304-c3df6395ac3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:59.301840 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48e557-b7f8-47f3-8304-c3df6395ac3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:59.311815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48e557-b7f8-47f3-8304-c3df6395ac3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:59.313253 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48e557-b7f8-47f3-8304-c3df6395ac3d service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:59.323405 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1201/2414] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:59.674311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249bff1-923f-43bb-a190-7cfb8d33ec15 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:59.677026 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6249bff1-923f-43bb-a190-7cfb8d33ec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:59.694663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249bff1-923f-43bb-a190-7cfb8d33ec15 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:59.703791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d242f-4eee-4aed-ba88-958a49e931ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:59.704602 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d242f-4eee-4aed-ba88-958a49e931ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:59.704932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d242f-4eee-4aed-ba88-958a49e931ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:59.705187 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d242f-4eee-4aed-ba88-958a49e931ca admin admin] PATH_INFO: `/v3/projects/3d8f97fb1f60493f9fa275f5a5559481` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:59.706413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d242f-4eee-4aed-ba88-958a49e931ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8f97fb1f60493f9fa275f5a5559481)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:59.708513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d242f-4eee-4aed-ba88-958a49e931ca admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:59.759246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-351d242f-4eee-4aed-ba88-958a49e931ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8f97fb1f60493f9fa275f5a5559481', 'request_id': 'req-351d242f-4eee-4aed-ba88-958a49e931ca'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:59.768034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-351d242f-4eee-4aed-ba88-958a49e931ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8f97fb1f60493f9fa275f5a5559481', 'request_id': 'req-351d242f-4eee-4aed-ba88-958a49e931ca'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:59.773630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-351d242f-4eee-4aed-ba88-958a49e931ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8f97fb1f60493f9fa275f5a5559481', 'request_id': 'req-351d242f-4eee-4aed-ba88-958a49e931ca'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:59.785756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-351d242f-4eee-4aed-ba88-958a49e931ca admin admin] The token cache is being invalidate because project 3d8f97fb1f60493f9fa275f5a5559481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:59.786189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-351d242f-4eee-4aed-ba88-958a49e931ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:59.787397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-351d242f-4eee-4aed-ba88-958a49e931ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:59.789175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1214/2415] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:59 2022] DELETE /identity/v3/projects/3d8f97fb1f60493f9fa275f5a5559481 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:59.794775 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d14d4-2e36-4d15-9413-f043f6d6b9f4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:59.795065 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d14d4-2e36-4d15-9413-f043f6d6b9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:59.795344 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d14d4-2e36-4d15-9413-f043f6d6b9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:59.822990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-280d14d4-2e36-4d15-9413-f043f6d6b9f4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:59.824349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-280d14d4-2e36-4d15-9413-f043f6d6b9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:59.881979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1202/2416] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:59.890701 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ba0f9-c47a-4ec8-9ff5-fdafd0a5cb48 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:59.891020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ba0f9-c47a-4ec8-9ff5-fdafd0a5cb48 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:59.891295 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ba0f9-c47a-4ec8-9ff5-fdafd0a5cb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:59.916678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-8d1ba0f9-c47a-4ec8-9ff5-fdafd0a5cb48 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:59.917888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-8d1ba0f9-c47a-4ec8-9ff5-fdafd0a5cb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:59.927292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1215/2417] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:59.931676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d14d4-2e36-4d15-9413-f043f6d6b9f4 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:59.941678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d14d4-2e36-4d15-9413-f043f6d6b9f4 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:59.946913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caeb357-417d-4683-b6eb-6a0bd39006b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:59.947516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeb357-417d-4683-b6eb-6a0bd39006b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:59.947832 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeb357-417d-4683-b6eb-6a0bd39006b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:59.948108 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeb357-417d-4683-b6eb-6a0bd39006b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:59.948766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caeb357-417d-4683-b6eb-6a0bd39006b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:59.949068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caeb357-417d-4683-b6eb-6a0bd39006b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:59.950692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caeb357-417d-4683-b6eb-6a0bd39006b5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:59.964977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1203/2418] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:59.969342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ba0f9-c47a-4ec8-9ff5-fdafd0a5cb48 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:59.979471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ba0f9-c47a-4ec8-9ff5-fdafd0a5cb48 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:59.985514 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7b354-0b74-4ffa-93d8-ffa56bc7f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:59.986156 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7b354-0b74-4ffa-93d8-ffa56bc7f18f admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:59.986431 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7b354-0b74-4ffa-93d8-ffa56bc7f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:59.986694 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7b354-0b74-4ffa-93d8-ffa56bc7f18f admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:59.987326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7b354-0b74-4ffa-93d8-ffa56bc7f18f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:59.989304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7b354-0b74-4ffa-93d8-ffa56bc7f18f admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:00.006719 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:00.024998 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1216/2419] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:59 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:00.029154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caeb357-417d-4683-b6eb-6a0bd39006b5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:00.039452 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caeb357-417d-4683-b6eb-6a0bd39006b5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:00.096444 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53e0e4-4752-42d3-a3de-9d4be8a3361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:00.097128 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53e0e4-4752-42d3-a3de-9d4be8a3361a admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:00.097474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53e0e4-4752-42d3-a3de-9d4be8a3361a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:00.097812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53e0e4-4752-42d3-a3de-9d4be8a3361a admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:00.098580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53e0e4-4752-42d3-a3de-9d4be8a3361a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:00.100519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53e0e4-4752-42d3-a3de-9d4be8a3361a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:00.125903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1204/2420] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:00 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:00.127341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7b354-0b74-4ffa-93d8-ffa56bc7f18f admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:00.137661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7b354-0b74-4ffa-93d8-ffa56bc7f18f admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:00.142422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62537722-49f8-4e31-81d5-082d630e0520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:00.143040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62537722-49f8-4e31-81d5-082d630e0520 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:00.143325 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62537722-49f8-4e31-81d5-082d630e0520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:00.143822 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62537722-49f8-4e31-81d5-082d630e0520 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:00.144474 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62537722-49f8-4e31-81d5-082d630e0520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:00.146353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62537722-49f8-4e31-81d5-082d630e0520 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:00.157088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1217/2421] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:00.161179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53e0e4-4752-42d3-a3de-9d4be8a3361a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:00.176212 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53e0e4-4752-42d3-a3de-9d4be8a3361a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:00.180898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98146f30-af2c-4605-bb6b-4de200785564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:00.181512 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98146f30-af2c-4605-bb6b-4de200785564 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:00.181794 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98146f30-af2c-4605-bb6b-4de200785564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:00.182068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98146f30-af2c-4605-bb6b-4de200785564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:00.182723 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98146f30-af2c-4605-bb6b-4de200785564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:00.184367 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98146f30-af2c-4605-bb6b-4de200785564 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:00.203233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1205/2422] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:00.205147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62537722-49f8-4e31-81d5-082d630e0520 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:00.216048 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62537722-49f8-4e31-81d5-082d630e0520 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:00.220759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dcb22-0b98-4f8e-8488-bee0c3c93fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:00.221423 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dcb22-0b98-4f8e-8488-bee0c3c93fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:00.221912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dcb22-0b98-4f8e-8488-bee0c3c93fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:00.222185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dcb22-0b98-4f8e-8488-bee0c3c93fe6 admin admin] PATH_INFO: `/v3/projects/db018351a75e4e0a96cec20c97151d72/users/9671aafe395b4368b73c761fa49c46d8/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:00.237009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623dcb22-0b98-4f8e-8488-bee0c3c93fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db018351a75e4e0a96cec20c97151d72, user_id=9671aafe395b4368b73c761fa49c46d8, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:00.239836 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623dcb22-0b98-4f8e-8488-bee0c3c93fe6 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:00.253619 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1218/2423] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:00 2022] PUT /identity/v3/projects/db018351a75e4e0a96cec20c97151d72/users/9671aafe395b4368b73c761fa49c46d8/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:00.265139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d9b7a-6208-4b12-9d59-1e9fcbb4d988 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:00.265853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d9b7a-6208-4b12-9d59-1e9fcbb4d988 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:00.265853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d9b7a-6208-4b12-9d59-1e9fcbb4d988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:00.295683 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-0f0d9b7a-6208-4b12-9d59-1e9fcbb4d988 None None] MFA Rules not processed for user `9671aafe395b4368b73c761fa49c46d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:00.297952 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0f0d9b7a-6208-4b12-9d59-1e9fcbb4d988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:00.313078 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:00.370064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1206/2424] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:00.383403 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dcb22-0b98-4f8e-8488-bee0c3c93fe6 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:00.385152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-623dcb22-0b98-4f8e-8488-bee0c3c93fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:00.448122 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dcb22-0b98-4f8e-8488-bee0c3c93fe6 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:00.452744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48013e3-aba8-4132-afd2-265c318ff6be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:00.453388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48013e3-aba8-4132-afd2-265c318ff6be service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:00.453886 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48013e3-aba8-4132-afd2-265c318ff6be service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:00.454282 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48013e3-aba8-4132-afd2-265c318ff6be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:00.464403 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48013e3-aba8-4132-afd2-265c318ff6be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:00.466114 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48013e3-aba8-4132-afd2-265c318ff6be service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:00.478765 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1219/2425] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:03.018856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d9b7a-6208-4b12-9d59-1e9fcbb4d988 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:03.020587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0f0d9b7a-6208-4b12-9d59-1e9fcbb4d988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:03.126140 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d9b7a-6208-4b12-9d59-1e9fcbb4d988 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.133226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a4b6f-f2c6-4f86-b215-45a07a685938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.134149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a4b6f-f2c6-4f86-b215-45a07a685938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.134626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a4b6f-f2c6-4f86-b215-45a07a685938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.135087 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a4b6f-f2c6-4f86-b215-45a07a685938 admin admin] PATH_INFO: `/v3/users/140dfb92f6de4c51826c72810a69c388` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.136835 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a4b6f-f2c6-4f86-b215-45a07a685938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140dfb92f6de4c51826c72810a69c388)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.143982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a4b6f-f2c6-4f86-b215-45a07a685938 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.230075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-530a4b6f-f2c6-4f86-b215-45a07a685938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140dfb92f6de4c51826c72810a69c388'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:03.246752 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-530a4b6f-f2c6-4f86-b215-45a07a685938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140dfb92f6de4c51826c72810a69c388'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:03.254933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-530a4b6f-f2c6-4f86-b215-45a07a685938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140dfb92f6de4c51826c72810a69c388'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:03.263787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-530a4b6f-f2c6-4f86-b215-45a07a685938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140dfb92f6de4c51826c72810a69c388'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:03.264639 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-530a4b6f-f2c6-4f86-b215-45a07a685938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140dfb92f6de4c51826c72810a69c388'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:03.271821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1207/2426] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:03 2022] DELETE /identity/v3/users/140dfb92f6de4c51826c72810a69c388 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:03.276229 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af659c0-36b7-4dd1-bb71-c2b64911aa65 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.276718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af659c0-36b7-4dd1-bb71-c2b64911aa65 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.276981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af659c0-36b7-4dd1-bb71-c2b64911aa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.303870 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5af659c0-36b7-4dd1-bb71-c2b64911aa65 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:03.305192 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5af659c0-36b7-4dd1-bb71-c2b64911aa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:03.378147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1220/2427] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:03.388769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a4b6f-f2c6-4f86-b215-45a07a685938 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:03.390233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-530a4b6f-f2c6-4f86-b215-45a07a685938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:03.437988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:03.457845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a4b6f-f2c6-4f86-b215-45a07a685938 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.462096 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808fdcd-2839-49f0-9a7b-ccdac5656b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.462898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808fdcd-2839-49f0-9a7b-ccdac5656b5b service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.463194 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808fdcd-2839-49f0-9a7b-ccdac5656b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.463469 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808fdcd-2839-49f0-9a7b-ccdac5656b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.473393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808fdcd-2839-49f0-9a7b-ccdac5656b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.475000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808fdcd-2839-49f0-9a7b-ccdac5656b5b service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.486013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1208/2428] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:03.718565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cb7f1-97dc-4d69-b352-adc971dbdb41 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.719046 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cb7f1-97dc-4d69-b352-adc971dbdb41 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.719316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cb7f1-97dc-4d69-b352-adc971dbdb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.766031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5b4cb7f1-97dc-4d69-b352-adc971dbdb41 None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:03.767641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5b4cb7f1-97dc-4d69-b352-adc971dbdb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:03.852633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1221/2429] 10.222.0.50 () {58 vars in 967 bytes} [Wed Aug 31 00:27:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:03.868744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808fdcd-2839-49f0-9a7b-ccdac5656b5b service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:03.870505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b808fdcd-2839-49f0-9a7b-ccdac5656b5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:03.950992 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cb7f1-97dc-4d69-b352-adc971dbdb41 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:03.952780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5b4cb7f1-97dc-4d69-b352-adc971dbdb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:03.968798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cb7f1-97dc-4d69-b352-adc971dbdb41 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.974639 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.975912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.976426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.976919 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] PATH_INFO: `/v3/projects/4eeaf5efcb824ea9aa8cb108ba720a5c` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.978238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eeaf5efcb824ea9aa8cb108ba720a5c)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.983660 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808fdcd-2839-49f0-9a7b-ccdac5656b5b service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:03.992264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.994079 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f509a-a95e-42c4-a1e9-0072b5426264 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:03.996157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:03.996784 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f509a-a95e-42c4-a1e9-0072b5426264 service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.997134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f509a-a95e-42c4-a1e9-0072b5426264 service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.997465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f509a-a95e-42c4-a1e9-0072b5426264 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:04.007466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f509a-a95e-42c4-a1e9-0072b5426264 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:04.009293 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f509a-a95e-42c4-a1e9-0072b5426264 service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:04.021643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1209/2430] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:27:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:27:04.075146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eeaf5efcb824ea9aa8cb108ba720a5c', 'request_id': 'req-41789057-8b85-471a-9684-e41d10519314'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.084747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eeaf5efcb824ea9aa8cb108ba720a5c', 'request_id': 'req-41789057-8b85-471a-9684-e41d10519314'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.092329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eeaf5efcb824ea9aa8cb108ba720a5c', 'request_id': 'req-41789057-8b85-471a-9684-e41d10519314'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.108438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] The token cache is being invalidate because project 4eeaf5efcb824ea9aa8cb108ba720a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:04.108973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.110318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.113676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1222/2431] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:03 2022] DELETE /identity/v3/projects/4eeaf5efcb824ea9aa8cb108ba720a5c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:04.117055 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f509a-a95e-42c4-a1e9-0072b5426264 service swift] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:04.137572 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f509a-a95e-42c4-a1e9-0072b5426264 service swift] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:04.218361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc836be-9851-406e-8337-cc4d628a8e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:04.219145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc836be-9851-406e-8337-cc4d628a8e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:04.219626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc836be-9851-406e-8337-cc4d628a8e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:04.220147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc836be-9851-406e-8337-cc4d628a8e25 admin admin] PATH_INFO: `/v3/users/568f0227904648278eb0ba0df6833f36` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:04.221632 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc836be-9851-406e-8337-cc4d628a8e25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568f0227904648278eb0ba0df6833f36)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:04.223847 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc836be-9851-406e-8337-cc4d628a8e25 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:04.314155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5bc836be-9851-406e-8337-cc4d628a8e25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568f0227904648278eb0ba0df6833f36'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.339935 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5bc836be-9851-406e-8337-cc4d628a8e25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568f0227904648278eb0ba0df6833f36'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.352356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:04.356352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5bc836be-9851-406e-8337-cc4d628a8e25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568f0227904648278eb0ba0df6833f36'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.364974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5bc836be-9851-406e-8337-cc4d628a8e25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568f0227904648278eb0ba0df6833f36'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.365782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5bc836be-9851-406e-8337-cc4d628a8e25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568f0227904648278eb0ba0df6833f36'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.372499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1210/2432] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:04 2022] DELETE /identity/v3/users/568f0227904648278eb0ba0df6833f36 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:04.658783 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:04.660394 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:04.677774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41789057-8b85-471a-9684-e41d10519314 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:04.746725 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059362a-7574-4546-86af-b6d52a404677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:04.747371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059362a-7574-4546-86af-b6d52a404677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:04.747649 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059362a-7574-4546-86af-b6d52a404677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:04.747958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059362a-7574-4546-86af-b6d52a404677 admin admin] PATH_INFO: `/v3/projects/38d3af0dd5eb41c79334b99d1b8f5f76` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:04.749080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059362a-7574-4546-86af-b6d52a404677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d3af0dd5eb41c79334b99d1b8f5f76)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:04.750998 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059362a-7574-4546-86af-b6d52a404677 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:04.797760 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b059362a-7574-4546-86af-b6d52a404677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d3af0dd5eb41c79334b99d1b8f5f76', 'request_id': 'req-b059362a-7574-4546-86af-b6d52a404677'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.808602 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b059362a-7574-4546-86af-b6d52a404677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d3af0dd5eb41c79334b99d1b8f5f76', 'request_id': 'req-b059362a-7574-4546-86af-b6d52a404677'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.814175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b059362a-7574-4546-86af-b6d52a404677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d3af0dd5eb41c79334b99d1b8f5f76', 'request_id': 'req-b059362a-7574-4546-86af-b6d52a404677'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.825918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b059362a-7574-4546-86af-b6d52a404677 admin admin] The token cache is being invalidate because project 38d3af0dd5eb41c79334b99d1b8f5f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:04.826203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b059362a-7574-4546-86af-b6d52a404677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.826911 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b059362a-7574-4546-86af-b6d52a404677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.828687 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1223/2433] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:04 2022] DELETE /identity/v3/projects/38d3af0dd5eb41c79334b99d1b8f5f76 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:04.833939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990f3f8-cf1b-4660-afd4-61a434d94b1f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:04.834224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990f3f8-cf1b-4660-afd4-61a434d94b1f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:04.834496 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990f3f8-cf1b-4660-afd4-61a434d94b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:04.853871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7990f3f8-cf1b-4660-afd4-61a434d94b1f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:04.855070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7990f3f8-cf1b-4660-afd4-61a434d94b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:04.930707 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1211/2434] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:04.939942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5ad4f-99ec-4872-a138-51b7ee80a06a None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:04.940236 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5ad4f-99ec-4872-a138-51b7ee80a06a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:04.940508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5ad4f-99ec-4872-a138-51b7ee80a06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:04.975058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7db5ad4f-99ec-4872-a138-51b7ee80a06a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:04.976676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7db5ad4f-99ec-4872-a138-51b7ee80a06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:04.986945 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1224/2435] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:04.992912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990f3f8-cf1b-4660-afd4-61a434d94b1f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.004209 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990f3f8-cf1b-4660-afd4-61a434d94b1f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.010907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9031fe-b80a-4b0e-a807-39a911c5f7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.011604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9031fe-b80a-4b0e-a807-39a911c5f7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.011800 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9031fe-b80a-4b0e-a807-39a911c5f7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.011964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9031fe-b80a-4b0e-a807-39a911c5f7f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.012757 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9031fe-b80a-4b0e-a807-39a911c5f7f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:05.013085 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9031fe-b80a-4b0e-a807-39a911c5f7f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.014676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9031fe-b80a-4b0e-a807-39a911c5f7f5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.027955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1212/2436] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:05.032641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5ad4f-99ec-4872-a138-51b7ee80a06a None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.047953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5ad4f-99ec-4872-a138-51b7ee80a06a None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.059174 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1a95a-78f2-4770-b88f-610840ad07ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.060144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1a95a-78f2-4770-b88f-610840ad07ea admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.060513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1a95a-78f2-4770-b88f-610840ad07ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.060879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1a95a-78f2-4770-b88f-610840ad07ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.061608 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1a95a-78f2-4770-b88f-610840ad07ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.063688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1a95a-78f2-4770-b88f-610840ad07ea admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.081871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:05.100569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1225/2437] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:05 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:05.104578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9031fe-b80a-4b0e-a807-39a911c5f7f5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.116531 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9031fe-b80a-4b0e-a807-39a911c5f7f5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.183616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7ab1b-0007-405f-bc07-e8f739c560d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.184352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7ab1b-0007-405f-bc07-e8f739c560d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.184635 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7ab1b-0007-405f-bc07-e8f739c560d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.184910 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7ab1b-0007-405f-bc07-e8f739c560d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.185549 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7ab1b-0007-405f-bc07-e8f739c560d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.187598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7ab1b-0007-405f-bc07-e8f739c560d4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.210356 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1213/2438] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:05 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:05.214606 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1a95a-78f2-4770-b88f-610840ad07ea admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.225345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1a95a-78f2-4770-b88f-610840ad07ea admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.230224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06150f27-21bb-48ab-88e0-5d80a83cfb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.231056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06150f27-21bb-48ab-88e0-5d80a83cfb66 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.231330 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06150f27-21bb-48ab-88e0-5d80a83cfb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.231798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06150f27-21bb-48ab-88e0-5d80a83cfb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.232463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06150f27-21bb-48ab-88e0-5d80a83cfb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.234063 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06150f27-21bb-48ab-88e0-5d80a83cfb66 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.244944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1226/2439] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:05.249059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7ab1b-0007-405f-bc07-e8f739c560d4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.259399 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7ab1b-0007-405f-bc07-e8f739c560d4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.264295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe59690-a252-42cc-9ea8-18124cd35005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.264938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe59690-a252-42cc-9ea8-18124cd35005 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.265221 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe59690-a252-42cc-9ea8-18124cd35005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.265493 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe59690-a252-42cc-9ea8-18124cd35005 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.266203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe59690-a252-42cc-9ea8-18124cd35005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.267969 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe59690-a252-42cc-9ea8-18124cd35005 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.281034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1214/2440] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:05.285830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06150f27-21bb-48ab-88e0-5d80a83cfb66 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.295969 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06150f27-21bb-48ab-88e0-5d80a83cfb66 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.301061 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc8f21-4e1c-4e7c-aceb-6b45e99ae331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.301958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc8f21-4e1c-4e7c-aceb-6b45e99ae331 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.302960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc8f21-4e1c-4e7c-aceb-6b45e99ae331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.303259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc8f21-4e1c-4e7c-aceb-6b45e99ae331 admin admin] PATH_INFO: `/v3/projects/da19d82aa9e847bdbbba8a438176a08f/users/020412d7cb5143f295dda418be2bd77d/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.321354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc8f21-4e1c-4e7c-aceb-6b45e99ae331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da19d82aa9e847bdbbba8a438176a08f, user_id=020412d7cb5143f295dda418be2bd77d, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.324616 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc8f21-4e1c-4e7c-aceb-6b45e99ae331 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.343118 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1227/2441] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:05 2022] PUT /identity/v3/projects/da19d82aa9e847bdbbba8a438176a08f/users/020412d7cb5143f295dda418be2bd77d/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:05.354158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60729f-6fcc-43c9-b97b-3f28b6922fc8 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.354464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60729f-6fcc-43c9-b97b-3f28b6922fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.354720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60729f-6fcc-43c9-b97b-3f28b6922fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.384504 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2c60729f-6fcc-43c9-b97b-3f28b6922fc8 None None] MFA Rules not processed for user `020412d7cb5143f295dda418be2bd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:05.385725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2c60729f-6fcc-43c9-b97b-3f28b6922fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:05.432156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:05.460233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1215/2442] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:05.464557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc8f21-4e1c-4e7c-aceb-6b45e99ae331 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.545428 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc8f21-4e1c-4e7c-aceb-6b45e99ae331 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.552758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f0c26-3c50-4571-a345-61587e2899f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.553456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0c26-3c50-4571-a345-61587e2899f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.553807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0c26-3c50-4571-a345-61587e2899f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.554150 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0c26-3c50-4571-a345-61587e2899f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.554881 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f0c26-3c50-4571-a345-61587e2899f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.556893 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f0c26-3c50-4571-a345-61587e2899f9 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.587497 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1228/2443] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:05 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:05.591734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60729f-6fcc-43c9-b97b-3f28b6922fc8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.602937 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60729f-6fcc-43c9-b97b-3f28b6922fc8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.669283 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91420d75-9495-45a0-a5f5-0fb020576778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.670055 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420d75-9495-45a0-a5f5-0fb020576778 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.670333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420d75-9495-45a0-a5f5-0fb020576778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.670603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420d75-9495-45a0-a5f5-0fb020576778 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.671246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91420d75-9495-45a0-a5f5-0fb020576778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.673521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91420d75-9495-45a0-a5f5-0fb020576778 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.697102 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1216/2444] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:05 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:05.701967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f0c26-3c50-4571-a345-61587e2899f9 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.719455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f0c26-3c50-4571-a345-61587e2899f9 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.724666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb106acd-0a75-4bd9-b992-c9fe6503a43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.725305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106acd-0a75-4bd9-b992-c9fe6503a43b admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.725583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106acd-0a75-4bd9-b992-c9fe6503a43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.725856 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106acd-0a75-4bd9-b992-c9fe6503a43b admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.726503 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb106acd-0a75-4bd9-b992-c9fe6503a43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.728153 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb106acd-0a75-4bd9-b992-c9fe6503a43b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.740829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1229/2445] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:05.745595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91420d75-9495-45a0-a5f5-0fb020576778 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.759744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91420d75-9495-45a0-a5f5-0fb020576778 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.763179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253887a2-8ded-47b7-9f3b-a0d8a0b4f4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.763924 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253887a2-8ded-47b7-9f3b-a0d8a0b4f4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.764203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253887a2-8ded-47b7-9f3b-a0d8a0b4f4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.764475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253887a2-8ded-47b7-9f3b-a0d8a0b4f4e5 admin admin] PATH_INFO: `/v3/projects/cdccc1f54a0d41f5ac2b50b4c00cbad4/users/1599bf8f2b834cacae0b7131e708e3ac/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.779960 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253887a2-8ded-47b7-9f3b-a0d8a0b4f4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdccc1f54a0d41f5ac2b50b4c00cbad4, user_id=1599bf8f2b834cacae0b7131e708e3ac, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.782707 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253887a2-8ded-47b7-9f3b-a0d8a0b4f4e5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.797886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1217/2446] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:05 2022] PUT /identity/v3/projects/cdccc1f54a0d41f5ac2b50b4c00cbad4/users/1599bf8f2b834cacae0b7131e708e3ac/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:05.802221 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb106acd-0a75-4bd9-b992-c9fe6503a43b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.813396 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb106acd-0a75-4bd9-b992-c9fe6503a43b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.873397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d63185-6891-49cb-9d86-32155aaa5605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.874172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63185-6891-49cb-9d86-32155aaa5605 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.874516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63185-6891-49cb-9d86-32155aaa5605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.874792 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63185-6891-49cb-9d86-32155aaa5605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.875438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d63185-6891-49cb-9d86-32155aaa5605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.877098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d63185-6891-49cb-9d86-32155aaa5605 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.890082 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1230/2447] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:05.895960 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253887a2-8ded-47b7-9f3b-a0d8a0b4f4e5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.910913 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253887a2-8ded-47b7-9f3b-a0d8a0b4f4e5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.916168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3db63-2eba-4f67-8acc-4a8bde2847eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.916827 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3db63-2eba-4f67-8acc-4a8bde2847eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.917123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3db63-2eba-4f67-8acc-4a8bde2847eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.917394 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3db63-2eba-4f67-8acc-4a8bde2847eb admin admin] PATH_INFO: `/v3/projects/cdccc1f54a0d41f5ac2b50b4c00cbad4/users/1599bf8f2b834cacae0b7131e708e3ac/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.919829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3db63-2eba-4f67-8acc-4a8bde2847eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdccc1f54a0d41f5ac2b50b4c00cbad4, user_id=1599bf8f2b834cacae0b7131e708e3ac, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.923178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3db63-2eba-4f67-8acc-4a8bde2847eb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.934919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1218/2448] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:05 2022] PUT /identity/v3/projects/cdccc1f54a0d41f5ac2b50b4c00cbad4/users/1599bf8f2b834cacae0b7131e708e3ac/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:05.945490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f943b13-ab31-4da2-b8ec-3e03062a5015 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.945774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f943b13-ab31-4da2-b8ec-3e03062a5015 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.946043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f943b13-ab31-4da2-b8ec-3e03062a5015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.978382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-3f943b13-ab31-4da2-b8ec-3e03062a5015 None None] MFA Rules not processed for user `1599bf8f2b834cacae0b7131e708e3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:05.980353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3f943b13-ab31-4da2-b8ec-3e03062a5015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:05.998905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:06.056262 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1231/2449] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:06.069441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3db63-2eba-4f67-8acc-4a8bde2847eb admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:06.071386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-28c3db63-2eba-4f67-8acc-4a8bde2847eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:06.139281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3db63-2eba-4f67-8acc-4a8bde2847eb admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:06.143748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa022f80-4e43-478a-8c1f-5218f171c896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:06.144184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa022f80-4e43-478a-8c1f-5218f171c896 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.144470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa022f80-4e43-478a-8c1f-5218f171c896 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.144744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa022f80-4e43-478a-8c1f-5218f171c896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.147840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f943b13-ab31-4da2-b8ec-3e03062a5015 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:06.149413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3f943b13-ab31-4da2-b8ec-3e03062a5015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:06.155310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa022f80-4e43-478a-8c1f-5218f171c896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:06.156786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa022f80-4e43-478a-8c1f-5218f171c896 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:06.167780 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1219/2450] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:06.220247 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f943b13-ab31-4da2-b8ec-3e03062a5015 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:06.225272 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f97c1-8de5-45a9-9b79-c460413f1eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:06.225910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f97c1-8de5-45a9-9b79-c460413f1eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.226189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f97c1-8de5-45a9-9b79-c460413f1eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.226478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f97c1-8de5-45a9-9b79-c460413f1eda admin admin] PATH_INFO: `/v3/users/9671aafe395b4368b73c761fa49c46d8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.227675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f97c1-8de5-45a9-9b79-c460413f1eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=9671aafe395b4368b73c761fa49c46d8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:06.229650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f97c1-8de5-45a9-9b79-c460413f1eda admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:06.280864 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6d3f97c1-8de5-45a9-9b79-c460413f1eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9671aafe395b4368b73c761fa49c46d8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.294147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6d3f97c1-8de5-45a9-9b79-c460413f1eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9671aafe395b4368b73c761fa49c46d8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.302677 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6d3f97c1-8de5-45a9-9b79-c460413f1eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9671aafe395b4368b73c761fa49c46d8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.312265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6d3f97c1-8de5-45a9-9b79-c460413f1eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9671aafe395b4368b73c761fa49c46d8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.314178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-6d3f97c1-8de5-45a9-9b79-c460413f1eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9671aafe395b4368b73c761fa49c46d8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.321962 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1232/2451] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:06 2022] DELETE /identity/v3/users/9671aafe395b4368b73c761fa49c46d8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:06.326962 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af8ac6-837c-4972-b779-4b2d94b279ad None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.327249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af8ac6-837c-4972-b779-4b2d94b279ad None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.327524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af8ac6-837c-4972-b779-4b2d94b279ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.347648 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d3af8ac6-837c-4972-b779-4b2d94b279ad None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:06.349114 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d3af8ac6-837c-4972-b779-4b2d94b279ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:06.383158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:06.413763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1220/2452] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:06.424579 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f97c1-8de5-45a9-9b79-c460413f1eda admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:06.426362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6d3f97c1-8de5-45a9-9b79-c460413f1eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:06.463617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:06.488661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f97c1-8de5-45a9-9b79-c460413f1eda admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:06.492864 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248f30c-a8d5-4b00-9c7d-af5e03b77616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:06.493486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248f30c-a8d5-4b00-9c7d-af5e03b77616 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.493796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248f30c-a8d5-4b00-9c7d-af5e03b77616 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.494031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248f30c-a8d5-4b00-9c7d-af5e03b77616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.503667 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248f30c-a8d5-4b00-9c7d-af5e03b77616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:06.505893 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248f30c-a8d5-4b00-9c7d-af5e03b77616 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:06.515609 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1233/2453] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:06.562181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af8ac6-837c-4972-b779-4b2d94b279ad None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:06.563772 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d3af8ac6-837c-4972-b779-4b2d94b279ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:06.576667 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af8ac6-837c-4972-b779-4b2d94b279ad None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:06.581653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629e8e3-7a30-47ac-9a7a-8024f5089428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:06.582347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629e8e3-7a30-47ac-9a7a-8024f5089428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.582670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629e8e3-7a30-47ac-9a7a-8024f5089428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.582944 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629e8e3-7a30-47ac-9a7a-8024f5089428 admin admin] PATH_INFO: `/v3/users/020412d7cb5143f295dda418be2bd77d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.584123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629e8e3-7a30-47ac-9a7a-8024f5089428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=020412d7cb5143f295dda418be2bd77d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:06.586036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629e8e3-7a30-47ac-9a7a-8024f5089428 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:06.635583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c629e8e3-7a30-47ac-9a7a-8024f5089428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020412d7cb5143f295dda418be2bd77d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.648168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c629e8e3-7a30-47ac-9a7a-8024f5089428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020412d7cb5143f295dda418be2bd77d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.655141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c629e8e3-7a30-47ac-9a7a-8024f5089428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020412d7cb5143f295dda418be2bd77d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.666441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c629e8e3-7a30-47ac-9a7a-8024f5089428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020412d7cb5143f295dda418be2bd77d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.666441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c629e8e3-7a30-47ac-9a7a-8024f5089428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020412d7cb5143f295dda418be2bd77d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.677591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1221/2454] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:06 2022] DELETE /identity/v3/users/020412d7cb5143f295dda418be2bd77d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:06.682369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741fc41-519c-4785-a733-83bae59c9607 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.682849 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741fc41-519c-4785-a733-83bae59c9607 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.683127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741fc41-519c-4785-a733-83bae59c9607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.703177 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-2741fc41-519c-4785-a733-83bae59c9607 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:06.704594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2741fc41-519c-4785-a733-83bae59c9607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:06.765657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1234/2455] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:06.776770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629e8e3-7a30-47ac-9a7a-8024f5089428 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:06.779467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c629e8e3-7a30-47ac-9a7a-8024f5089428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:06.801318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741fc41-519c-4785-a733-83bae59c9607 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:06.802802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2741fc41-519c-4785-a733-83bae59c9607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:06.833841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741fc41-519c-4785-a733-83bae59c9607 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:06.839109 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4d250-513d-45e5-b871-e679610d632c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:06.839786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d250-513d-45e5-b871-e679610d632c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.840072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d250-513d-45e5-b871-e679610d632c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.840344 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d250-513d-45e5-b871-e679610d632c admin admin] PATH_INFO: `/v3/projects/db018351a75e4e0a96cec20c97151d72` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.841530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4d250-513d-45e5-b871-e679610d632c admin admin] RBAC: Authorizing `identity:delete_project(project_id=db018351a75e4e0a96cec20c97151d72)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:06.843870 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4d250-513d-45e5-b871-e679610d632c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:06.851141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629e8e3-7a30-47ac-9a7a-8024f5089428 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:06.854208 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1935f4-a6e3-4dad-aa89-4450b9e490af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:06.854837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1935f4-a6e3-4dad-aa89-4450b9e490af service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.855117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1935f4-a6e3-4dad-aa89-4450b9e490af service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.855860 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1935f4-a6e3-4dad-aa89-4450b9e490af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.865713 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1935f4-a6e3-4dad-aa89-4450b9e490af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:06.867215 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1935f4-a6e3-4dad-aa89-4450b9e490af service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:06.877538 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1222/2456] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:06.915020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-07c4d250-513d-45e5-b871-e679610d632c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db018351a75e4e0a96cec20c97151d72', 'request_id': 'req-07c4d250-513d-45e5-b871-e679610d632c'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.926944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-07c4d250-513d-45e5-b871-e679610d632c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db018351a75e4e0a96cec20c97151d72', 'request_id': 'req-07c4d250-513d-45e5-b871-e679610d632c'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.934734 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-07c4d250-513d-45e5-b871-e679610d632c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db018351a75e4e0a96cec20c97151d72', 'request_id': 'req-07c4d250-513d-45e5-b871-e679610d632c'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.950203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-07c4d250-513d-45e5-b871-e679610d632c admin admin] The token cache is being invalidate because project db018351a75e4e0a96cec20c97151d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:06.950563 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-07c4d250-513d-45e5-b871-e679610d632c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.951458 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-07c4d250-513d-45e5-b871-e679610d632c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.953956 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1235/2457] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:06 2022] DELETE /identity/v3/projects/db018351a75e4e0a96cec20c97151d72 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:06.961178 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762351a1-6c6b-467a-b200-9f4674d00860 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.961757 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762351a1-6c6b-467a-b200-9f4674d00860 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.962172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762351a1-6c6b-467a-b200-9f4674d00860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.993001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-762351a1-6c6b-467a-b200-9f4674d00860 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:06.994354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-762351a1-6c6b-467a-b200-9f4674d00860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.056928 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:07.073480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1223/2458] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:07.082126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816bccf-3ffe-42cc-b524-c66289adbac1 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.082536 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816bccf-3ffe-42cc-b524-c66289adbac1 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.082895 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816bccf-3ffe-42cc-b524-c66289adbac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.112357 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-c816bccf-3ffe-42cc-b524-c66289adbac1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:07.113636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c816bccf-3ffe-42cc-b524-c66289adbac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.122331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1236/2459] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:07.126730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762351a1-6c6b-467a-b200-9f4674d00860 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.138766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762351a1-6c6b-467a-b200-9f4674d00860 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.144507 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d915e0-f32a-410b-9cd5-572bbc50ceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.145304 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d915e0-f32a-410b-9cd5-572bbc50ceac admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.145653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d915e0-f32a-410b-9cd5-572bbc50ceac admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.145989 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d915e0-f32a-410b-9cd5-572bbc50ceac admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.146710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d915e0-f32a-410b-9cd5-572bbc50ceac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:07.147079 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d915e0-f32a-410b-9cd5-572bbc50ceac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.148807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d915e0-f32a-410b-9cd5-572bbc50ceac admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.164595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1224/2460] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:07.166479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816bccf-3ffe-42cc-b524-c66289adbac1 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.180315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816bccf-3ffe-42cc-b524-c66289adbac1 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.186275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f9962-8d0c-4005-afbf-8fe545d4ae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.187017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f9962-8d0c-4005-afbf-8fe545d4ae48 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.187333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f9962-8d0c-4005-afbf-8fe545d4ae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.187637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f9962-8d0c-4005-afbf-8fe545d4ae48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.188557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f9962-8d0c-4005-afbf-8fe545d4ae48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.190692 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f9962-8d0c-4005-afbf-8fe545d4ae48 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.197951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d915e0-f32a-410b-9cd5-572bbc50ceac admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.199849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f6d915e0-f32a-410b-9cd5-572bbc50ceac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.214627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d915e0-f32a-410b-9cd5-572bbc50ceac admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.222949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.223725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.224196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.224663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] PATH_INFO: `/v3/projects/da19d82aa9e847bdbbba8a438176a08f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.225823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=da19d82aa9e847bdbbba8a438176a08f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.226394 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1237/2461] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:07 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:07.228084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.230311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f9962-8d0c-4005-afbf-8fe545d4ae48 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.265737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:07.277869 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da19d82aa9e847bdbbba8a438176a08f', 'request_id': 'req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.287376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da19d82aa9e847bdbbba8a438176a08f', 'request_id': 'req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.293448 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da19d82aa9e847bdbbba8a438176a08f', 'request_id': 'req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.302814 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f9962-8d0c-4005-afbf-8fe545d4ae48 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.305259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] The token cache is being invalidate because project da19d82aa9e847bdbbba8a438176a08f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:07.305675 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.306328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.307866 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1225/2462] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:07 2022] DELETE /identity/v3/projects/da19d82aa9e847bdbbba8a438176a08f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:07.312044 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.313355 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.358739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864cb02-cebd-4889-8728-5845337702b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.359344 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864cb02-cebd-4889-8728-5845337702b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.359617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864cb02-cebd-4889-8728-5845337702b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.359920 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864cb02-cebd-4889-8728-5845337702b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.360539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864cb02-cebd-4889-8728-5845337702b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.362523 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864cb02-cebd-4889-8728-5845337702b5 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.377425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99995061-fe5f-4ef0-a1e8-eff1bfa22bac admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.382577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea9ded-30cf-45eb-a9e2-da2f6e05be3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.383211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea9ded-30cf-45eb-a9e2-da2f6e05be3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.383493 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea9ded-30cf-45eb-a9e2-da2f6e05be3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.383798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea9ded-30cf-45eb-a9e2-da2f6e05be3c admin admin] PATH_INFO: `/v3/users/1599bf8f2b834cacae0b7131e708e3ac` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.384939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea9ded-30cf-45eb-a9e2-da2f6e05be3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1599bf8f2b834cacae0b7131e708e3ac)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.386590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1238/2463] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:07 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:07.389827 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea9ded-30cf-45eb-a9e2-da2f6e05be3c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.390530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864cb02-cebd-4889-8728-5845337702b5 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.392196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b864cb02-cebd-4889-8728-5845337702b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.403780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864cb02-cebd-4889-8728-5845337702b5 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.408341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf024d-7597-4766-a5f0-f0abe03cf8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.408922 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf024d-7597-4766-a5f0-f0abe03cf8cb admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.409199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf024d-7597-4766-a5f0-f0abe03cf8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.409769 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf024d-7597-4766-a5f0-f0abe03cf8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.410187 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf024d-7597-4766-a5f0-f0abe03cf8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.411963 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf024d-7597-4766-a5f0-f0abe03cf8cb admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.427000 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1239/2464] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:07.428510 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf024d-7597-4766-a5f0-f0abe03cf8cb admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.438536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2eea9ded-30cf-45eb-a9e2-da2f6e05be3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1599bf8f2b834cacae0b7131e708e3ac'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.438961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf024d-7597-4766-a5f0-f0abe03cf8cb admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.444228 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5405b-0662-4fa7-97bb-df90b0516c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.444813 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5405b-0662-4fa7-97bb-df90b0516c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.445088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5405b-0662-4fa7-97bb-df90b0516c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.445355 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5405b-0662-4fa7-97bb-df90b0516c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.445983 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5405b-0662-4fa7-97bb-df90b0516c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.447558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5405b-0662-4fa7-97bb-df90b0516c1c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.450645 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2eea9ded-30cf-45eb-a9e2-da2f6e05be3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1599bf8f2b834cacae0b7131e708e3ac'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.451853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:07.458938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2eea9ded-30cf-45eb-a9e2-da2f6e05be3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1599bf8f2b834cacae0b7131e708e3ac'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.468063 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2eea9ded-30cf-45eb-a9e2-da2f6e05be3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1599bf8f2b834cacae0b7131e708e3ac'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.468848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2eea9ded-30cf-45eb-a9e2-da2f6e05be3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1599bf8f2b834cacae0b7131e708e3ac'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.475688 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1226/2465] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:07 2022] DELETE /identity/v3/users/1599bf8f2b834cacae0b7131e708e3ac => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:07.589323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1240/2466] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:07.593537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea9ded-30cf-45eb-a9e2-da2f6e05be3c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.594960 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2eea9ded-30cf-45eb-a9e2-da2f6e05be3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.665851 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea9ded-30cf-45eb-a9e2-da2f6e05be3c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.670823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d21213-0d68-4692-9f60-4e658c1dde29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.671425 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d21213-0d68-4692-9f60-4e658c1dde29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.671808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d21213-0d68-4692-9f60-4e658c1dde29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.672455 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d21213-0d68-4692-9f60-4e658c1dde29 admin admin] PATH_INFO: `/v3/projects/ce0009285e88429ea02b255277a0934a/users/1fd1e4b79ef64ab386973007f014f84c/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.687727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d21213-0d68-4692-9f60-4e658c1dde29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0009285e88429ea02b255277a0934a, user_id=1fd1e4b79ef64ab386973007f014f84c, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.690305 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d21213-0d68-4692-9f60-4e658c1dde29 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.704549 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1227/2467] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:07 2022] PUT /identity/v3/projects/ce0009285e88429ea02b255277a0934a/users/1fd1e4b79ef64ab386973007f014f84c/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:07.770090 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5405b-0662-4fa7-97bb-df90b0516c1c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.771988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-34b5405b-0662-4fa7-97bb-df90b0516c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.774676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e0ae4-5d9f-4931-9348-4521d820a9e7 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.774958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e0ae4-5d9f-4931-9348-4521d820a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.775259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e0ae4-5d9f-4931-9348-4521d820a9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.787447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5405b-0662-4fa7-97bb-df90b0516c1c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.805268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c96e0ae4-5d9f-4931-9348-4521d820a9e7 None None] MFA Rules not processed for user `1fd1e4b79ef64ab386973007f014f84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:07.806661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c96e0ae4-5d9f-4931-9348-4521d820a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.853080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdf125-b057-4e1b-afde-5307e05f77c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.853650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdf125-b057-4e1b-afde-5307e05f77c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.853927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdf125-b057-4e1b-afde-5307e05f77c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.854193 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdf125-b057-4e1b-afde-5307e05f77c3 admin admin] PATH_INFO: `/v3/projects/cdccc1f54a0d41f5ac2b50b4c00cbad4` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.855304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbdf125-b057-4e1b-afde-5307e05f77c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdccc1f54a0d41f5ac2b50b4c00cbad4)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.857274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbdf125-b057-4e1b-afde-5307e05f77c3 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.870370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1228/2468] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:07.874709 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e0ae4-5d9f-4931-9348-4521d820a9e7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.887220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e0ae4-5d9f-4931-9348-4521d820a9e7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.892001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e710b-1679-45ce-9da3-aa6c88178406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.892636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e710b-1679-45ce-9da3-aa6c88178406 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.892916 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e710b-1679-45ce-9da3-aa6c88178406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.893186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e710b-1679-45ce-9da3-aa6c88178406 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.893790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e710b-1679-45ce-9da3-aa6c88178406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.895813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e710b-1679-45ce-9da3-aa6c88178406 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.904628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:07.905872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5bbdf125-b057-4e1b-afde-5307e05f77c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdccc1f54a0d41f5ac2b50b4c00cbad4', 'request_id': 'req-5bbdf125-b057-4e1b-afde-5307e05f77c3'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.915347 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5bbdf125-b057-4e1b-afde-5307e05f77c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdccc1f54a0d41f5ac2b50b4c00cbad4', 'request_id': 'req-5bbdf125-b057-4e1b-afde-5307e05f77c3'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.921684 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5bbdf125-b057-4e1b-afde-5307e05f77c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdccc1f54a0d41f5ac2b50b4c00cbad4', 'request_id': 'req-5bbdf125-b057-4e1b-afde-5307e05f77c3'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.924852 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1229/2469] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:07 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:07.928743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e710b-1679-45ce-9da3-aa6c88178406 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:07.933401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5bbdf125-b057-4e1b-afde-5307e05f77c3 admin admin] The token cache is being invalidate because project cdccc1f54a0d41f5ac2b50b4c00cbad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:07.933682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5bbdf125-b057-4e1b-afde-5307e05f77c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.934327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5bbdf125-b057-4e1b-afde-5307e05f77c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:07.935801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1241/2470] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:07 2022] DELETE /identity/v3/projects/cdccc1f54a0d41f5ac2b50b4c00cbad4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:07.940571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89be87-b320-4a93-ace5-d0e13439cb42 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.940850 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89be87-b320-4a93-ace5-d0e13439cb42 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.941109 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89be87-b320-4a93-ace5-d0e13439cb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.959997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-4c89be87-b320-4a93-ace5-d0e13439cb42 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:07.961292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-4c89be87-b320-4a93-ace5-d0e13439cb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:07.962041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:07.997953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e710b-1679-45ce-9da3-aa6c88178406 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.004199 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1b68b-8f91-48f0-83bf-90132948e73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.004815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1b68b-8f91-48f0-83bf-90132948e73d admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.005094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1b68b-8f91-48f0-83bf-90132948e73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.005367 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1b68b-8f91-48f0-83bf-90132948e73d admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.006002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1b68b-8f91-48f0-83bf-90132948e73d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.007940 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1b68b-8f91-48f0-83bf-90132948e73d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.021757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1242/2471] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:08.030141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483347b9-e5eb-4c1f-b2a9-39910f215d30 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.030418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483347b9-e5eb-4c1f-b2a9-39910f215d30 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.030748 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483347b9-e5eb-4c1f-b2a9-39910f215d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.041672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1230/2472] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:07 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:08.042690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1b68b-8f91-48f0-83bf-90132948e73d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.044499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-30c1b68b-8f91-48f0-83bf-90132948e73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:08.051893 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-483347b9-e5eb-4c1f-b2a9-39910f215d30 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:08.053130 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-483347b9-e5eb-4c1f-b2a9-39910f215d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:08.059348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1b68b-8f91-48f0-83bf-90132948e73d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.061367 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1243/2473] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:08.065366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483347b9-e5eb-4c1f-b2a9-39910f215d30 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.067635 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e404e5-1496-459c-82aa-daf282643a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.068415 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e404e5-1496-459c-82aa-daf282643a88 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.068846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e404e5-1496-459c-82aa-daf282643a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.069149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e404e5-1496-459c-82aa-daf282643a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.069926 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e404e5-1496-459c-82aa-daf282643a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.071957 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e404e5-1496-459c-82aa-daf282643a88 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.075192 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483347b9-e5eb-4c1f-b2a9-39910f215d30 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.081216 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481ba9f-198c-4f79-93a9-a6e814c3e94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.083960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481ba9f-198c-4f79-93a9-a6e814c3e94b admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.084282 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481ba9f-198c-4f79-93a9-a6e814c3e94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.084547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481ba9f-198c-4f79-93a9-a6e814c3e94b admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.085205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481ba9f-198c-4f79-93a9-a6e814c3e94b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:08.085504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481ba9f-198c-4f79-93a9-a6e814c3e94b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.087003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1231/2474] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:08.087456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481ba9f-198c-4f79-93a9-a6e814c3e94b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.091301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e404e5-1496-459c-82aa-daf282643a88 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.102938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1244/2475] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:08.103363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e404e5-1496-459c-82aa-daf282643a88 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.104798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481ba9f-198c-4f79-93a9-a6e814c3e94b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.107787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a1256-0a61-4831-a014-1ac12668fe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.108659 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a1256-0a61-4831-a014-1ac12668fe02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.109019 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a1256-0a61-4831-a014-1ac12668fe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.109363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a1256-0a61-4831-a014-1ac12668fe02 admin admin] PATH_INFO: `/v3/projects/561d57fca4c04763b55532307940f75e/users/de76002a42124bdc80a56255efd125fa/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.116222 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481ba9f-198c-4f79-93a9-a6e814c3e94b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.121056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bae77-8849-45e5-bc66-72f0303f0cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.121839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bae77-8849-45e5-bc66-72f0303f0cab admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.122280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bae77-8849-45e5-bc66-72f0303f0cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.122735 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bae77-8849-45e5-bc66-72f0303f0cab admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.123451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bae77-8849-45e5-bc66-72f0303f0cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.125874 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bae77-8849-45e5-bc66-72f0303f0cab admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.127280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a1256-0a61-4831-a014-1ac12668fe02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561d57fca4c04763b55532307940f75e, user_id=de76002a42124bdc80a56255efd125fa, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.130642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a1256-0a61-4831-a014-1ac12668fe02 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.148058 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1232/2476] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:08 2022] PUT /identity/v3/projects/561d57fca4c04763b55532307940f75e/users/de76002a42124bdc80a56255efd125fa/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:08.152250 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a1256-0a61-4831-a014-1ac12668fe02 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.170401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1245/2477] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:08.175016 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bae77-8849-45e5-bc66-72f0303f0cab admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.217464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a1256-0a61-4831-a014-1ac12668fe02 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.253916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bae77-8849-45e5-bc66-72f0303f0cab admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.258757 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8c6f1-54f9-437b-8163-aa3bda9a25eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.259368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8c6f1-54f9-437b-8163-aa3bda9a25eb admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.259789 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8c6f1-54f9-437b-8163-aa3bda9a25eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.260069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8c6f1-54f9-437b-8163-aa3bda9a25eb admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.260698 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8c6f1-54f9-437b-8163-aa3bda9a25eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.262633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8c6f1-54f9-437b-8163-aa3bda9a25eb admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.287427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796359ac-4289-4dbd-b894-6dc764edb3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.288419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796359ac-4289-4dbd-b894-6dc764edb3ce admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.288890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1246/2478] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:08.291967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796359ac-4289-4dbd-b894-6dc764edb3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.292315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796359ac-4289-4dbd-b894-6dc764edb3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.293634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8c6f1-54f9-437b-8163-aa3bda9a25eb admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.293774 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796359ac-4289-4dbd-b894-6dc764edb3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.294998 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796359ac-4289-4dbd-b894-6dc764edb3ce admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.305867 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8c6f1-54f9-437b-8163-aa3bda9a25eb admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.307567 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1233/2479] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:08.312288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796359ac-4289-4dbd-b894-6dc764edb3ce admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.314954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd07031-f131-4582-9659-8c28eaa41f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.316079 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd07031-f131-4582-9659-8c28eaa41f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.316274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd07031-f131-4582-9659-8c28eaa41f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.316692 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd07031-f131-4582-9659-8c28eaa41f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.317426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd07031-f131-4582-9659-8c28eaa41f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.319217 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd07031-f131-4582-9659-8c28eaa41f62 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.326299 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796359ac-4289-4dbd-b894-6dc764edb3ce admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.332679 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1247/2480] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:08.333768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533f09a-5c35-4574-a047-029285671690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.334548 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533f09a-5c35-4574-a047-029285671690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.334850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533f09a-5c35-4574-a047-029285671690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.335198 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533f09a-5c35-4574-a047-029285671690 admin admin] PATH_INFO: `/v3/projects/561d57fca4c04763b55532307940f75e/users/de76002a42124bdc80a56255efd125fa/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.336831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd07031-f131-4582-9659-8c28eaa41f62 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.337559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533f09a-5c35-4574-a047-029285671690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561d57fca4c04763b55532307940f75e, user_id=de76002a42124bdc80a56255efd125fa, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.340408 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533f09a-5c35-4574-a047-029285671690 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.347325 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd07031-f131-4582-9659-8c28eaa41f62 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.353590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1234/2481] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:08 2022] PUT /identity/v3/projects/561d57fca4c04763b55532307940f75e/users/de76002a42124bdc80a56255efd125fa/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:08.356175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:08.364245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609e92-c22c-4296-8cac-6f728b87ebf3 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.364536 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609e92-c22c-4296-8cac-6f728b87ebf3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.364811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609e92-c22c-4296-8cac-6f728b87ebf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.401474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-50609e92-c22c-4296-8cac-6f728b87ebf3 None None] MFA Rules not processed for user `de76002a42124bdc80a56255efd125fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:08.402872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-50609e92-c22c-4296-8cac-6f728b87ebf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:08.407929 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dfa6e-0630-48a7-9188-7433750cfab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.408626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dfa6e-0630-48a7-9188-7433750cfab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.408852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dfa6e-0630-48a7-9188-7433750cfab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.408967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:08.409134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dfa6e-0630-48a7-9188-7433750cfab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.409977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dfa6e-0630-48a7-9188-7433750cfab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.411887 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dfa6e-0630-48a7-9188-7433750cfab3 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.423072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1248/2482] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:08.427472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dfa6e-0630-48a7-9188-7433750cfab3 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.437557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dfa6e-0630-48a7-9188-7433750cfab3 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.444552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ffe76-debc-4be9-a50d-e01f6b380f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.445327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ffe76-debc-4be9-a50d-e01f6b380f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.445686 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ffe76-debc-4be9-a50d-e01f6b380f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.445947 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ffe76-debc-4be9-a50d-e01f6b380f45 admin admin] PATH_INFO: `/v3/projects/6581dc69b181451d855d5fa15b500a66/users/257c89b572db44b69fa8a56720c64c55/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.463151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ffe76-debc-4be9-a50d-e01f6b380f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6581dc69b181451d855d5fa15b500a66, user_id=257c89b572db44b69fa8a56720c64c55, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.466234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ffe76-debc-4be9-a50d-e01f6b380f45 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.479756 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1235/2483] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:08.479916 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1249/2484] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:08 2022] PUT /identity/v3/projects/6581dc69b181451d855d5fa15b500a66/users/257c89b572db44b69fa8a56720c64c55/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:08.490465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b0566-3461-464e-90d1-4b2015bc897d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.490796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b0566-3461-464e-90d1-4b2015bc897d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.491020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ffe76-debc-4be9-a50d-e01f6b380f45 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.491416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b0566-3461-464e-90d1-4b2015bc897d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.492713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2d6ffe76-debc-4be9-a50d-e01f6b380f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:08.519896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-062b0566-3461-464e-90d1-4b2015bc897d None None] MFA Rules not processed for user `257c89b572db44b69fa8a56720c64c55`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:08.521101 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-062b0566-3461-464e-90d1-4b2015bc897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:08.552860 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ffe76-debc-4be9-a50d-e01f6b380f45 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.556438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5957c21-1808-4ce1-8059-d426ba87328f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.557036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5957c21-1808-4ce1-8059-d426ba87328f service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.557310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5957c21-1808-4ce1-8059-d426ba87328f service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.557574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5957c21-1808-4ce1-8059-d426ba87328f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.559299 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a5957c21-1808-4ce1-8059-d426ba87328f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:08.588974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1236/2485] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:08.593821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b0566-3461-464e-90d1-4b2015bc897d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.617412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5957c21-1808-4ce1-8059-d426ba87328f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.618847 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5957c21-1808-4ce1-8059-d426ba87328f service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.627996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1250/2486] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:08.658455 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b0566-3461-464e-90d1-4b2015bc897d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.664048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24e593-4ce2-4a32-ad56-67fa661d31fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.664787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24e593-4ce2-4a32-ad56-67fa661d31fc admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.665033 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24e593-4ce2-4a32-ad56-67fa661d31fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.665315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24e593-4ce2-4a32-ad56-67fa661d31fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.665923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24e593-4ce2-4a32-ad56-67fa661d31fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.667901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24e593-4ce2-4a32-ad56-67fa661d31fc admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.696252 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1237/2487] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:08.700440 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5957c21-1808-4ce1-8059-d426ba87328f service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.711119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5957c21-1808-4ce1-8059-d426ba87328f service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.750289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:08.770934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271613c7-f002-43ed-b6ea-b8b28d3feb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.771669 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271613c7-f002-43ed-b6ea-b8b28d3feb65 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.771973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271613c7-f002-43ed-b6ea-b8b28d3feb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.772241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271613c7-f002-43ed-b6ea-b8b28d3feb65 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.772878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271613c7-f002-43ed-b6ea-b8b28d3feb65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.774829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271613c7-f002-43ed-b6ea-b8b28d3feb65 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.798370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1251/2488] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:08.802706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24e593-4ce2-4a32-ad56-67fa661d31fc admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.813390 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24e593-4ce2-4a32-ad56-67fa661d31fc admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.818971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121121c-e145-40b6-8e78-eb9427462cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.819613 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121121c-e145-40b6-8e78-eb9427462cee admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.819970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121121c-e145-40b6-8e78-eb9427462cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.820187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121121c-e145-40b6-8e78-eb9427462cee admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.821057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121121c-e145-40b6-8e78-eb9427462cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.822834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121121c-e145-40b6-8e78-eb9427462cee admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.833993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1238/2489] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:08.838171 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271613c7-f002-43ed-b6ea-b8b28d3feb65 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.849102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271613c7-f002-43ed-b6ea-b8b28d3feb65 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.855010 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8f4e0-3309-4633-b329-07953514b2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.855674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f4e0-3309-4633-b329-07953514b2f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.855999 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f4e0-3309-4633-b329-07953514b2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.856258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f4e0-3309-4633-b329-07953514b2f0 admin admin] PATH_INFO: `/v3/projects/aad235d75c4c4eb29f4db7688d13fa8e/users/1c84c6f0c0f0488fa184e358b753b132/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.871185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8f4e0-3309-4633-b329-07953514b2f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad235d75c4c4eb29f4db7688d13fa8e, user_id=1c84c6f0c0f0488fa184e358b753b132, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.873981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8f4e0-3309-4633-b329-07953514b2f0 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.894726 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1252/2490] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:08 2022] PUT /identity/v3/projects/aad235d75c4c4eb29f4db7688d13fa8e/users/1c84c6f0c0f0488fa184e358b753b132/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:08.898933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121121c-e145-40b6-8e78-eb9427462cee admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.911037 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121121c-e145-40b6-8e78-eb9427462cee admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.915632 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:08.978068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d9c23-6081-43c6-b0e4-a039a526de10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.978894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9c23-6081-43c6-b0e4-a039a526de10 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.979360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9c23-6081-43c6-b0e4-a039a526de10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.979901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9c23-6081-43c6-b0e4-a039a526de10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.980766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d9c23-6081-43c6-b0e4-a039a526de10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.982736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d9c23-6081-43c6-b0e4-a039a526de10 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:09.000676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1239/2491] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:09.005258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8f4e0-3309-4633-b329-07953514b2f0 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:09.016114 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8f4e0-3309-4633-b329-07953514b2f0 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:09.021583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4942551-830f-4a4b-9f06-e01e98784dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:09.022232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4942551-830f-4a4b-9f06-e01e98784dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.022513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4942551-830f-4a4b-9f06-e01e98784dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.022784 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4942551-830f-4a4b-9f06-e01e98784dd4 admin admin] PATH_INFO: `/v3/projects/aad235d75c4c4eb29f4db7688d13fa8e/users/1c84c6f0c0f0488fa184e358b753b132/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.025588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4942551-830f-4a4b-9f06-e01e98784dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad235d75c4c4eb29f4db7688d13fa8e, user_id=1c84c6f0c0f0488fa184e358b753b132, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:09.028323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4942551-830f-4a4b-9f06-e01e98784dd4 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:09.039384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1253/2492] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:09 2022] PUT /identity/v3/projects/aad235d75c4c4eb29f4db7688d13fa8e/users/1c84c6f0c0f0488fa184e358b753b132/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:09.051183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e259a-3b9c-4c3a-a0dc-d6e78afc5649 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.051655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e259a-3b9c-4c3a-a0dc-d6e78afc5649 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.051979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e259a-3b9c-4c3a-a0dc-d6e78afc5649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.080891 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ec4e259a-3b9c-4c3a-a0dc-d6e78afc5649 None None] MFA Rules not processed for user `1c84c6f0c0f0488fa184e358b753b132`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:09.082209 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ec4e259a-3b9c-4c3a-a0dc-d6e78afc5649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:09.160629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1240/2493] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:09.175514 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4942551-830f-4a4b-9f06-e01e98784dd4 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:09.235190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4942551-830f-4a4b-9f06-e01e98784dd4 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:09.239479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e57f37-8630-4069-a3f8-347d738ce369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:09.240142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e57f37-8630-4069-a3f8-347d738ce369 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.240412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e57f37-8630-4069-a3f8-347d738ce369 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.240678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e57f37-8630-4069-a3f8-347d738ce369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.250116 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e57f37-8630-4069-a3f8-347d738ce369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:09.251572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e57f37-8630-4069-a3f8-347d738ce369 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:09.261641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1254/2494] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:09.340207 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e259a-3b9c-4c3a-a0dc-d6e78afc5649 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:09.350016 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e259a-3b9c-4c3a-a0dc-d6e78afc5649 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:09.354015 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b545bc-b235-4d6b-8971-a5ffe261292f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:09.354622 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b545bc-b235-4d6b-8971-a5ffe261292f service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.354955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b545bc-b235-4d6b-8971-a5ffe261292f service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.355168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b545bc-b235-4d6b-8971-a5ffe261292f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.421138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b545bc-b235-4d6b-8971-a5ffe261292f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:09.423117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b545bc-b235-4d6b-8971-a5ffe261292f service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:09.432458 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1241/2495] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:09.458190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e57f37-8630-4069-a3f8-347d738ce369 service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:09.458190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-26e57f37-8630-4069-a3f8-347d738ce369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:09.524208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e57f37-8630-4069-a3f8-347d738ce369 service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:09.530869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f49a51-d9be-4e71-8061-479fc095cfa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:09.530869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49a51-d9be-4e71-8061-479fc095cfa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.530869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49a51-d9be-4e71-8061-479fc095cfa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.530869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49a51-d9be-4e71-8061-479fc095cfa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.531261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e6f49a51-d9be-4e71-8061-479fc095cfa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:09.583547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:09.600098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f49a51-d9be-4e71-8061-479fc095cfa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:09.601602 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f49a51-d9be-4e71-8061-479fc095cfa5 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:09.611432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1255/2496] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:09.710884 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b545bc-b235-4d6b-8971-a5ffe261292f service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:09.722642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b545bc-b235-4d6b-8971-a5ffe261292f service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:09.727335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6458d-68b4-40b5-9182-1c99f4a22185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:09.727993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6458d-68b4-40b5-9182-1c99f4a22185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.728360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6458d-68b4-40b5-9182-1c99f4a22185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.728655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6458d-68b4-40b5-9182-1c99f4a22185 admin admin] PATH_INFO: `/v3/users/257c89b572db44b69fa8a56720c64c55` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.729787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6458d-68b4-40b5-9182-1c99f4a22185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=257c89b572db44b69fa8a56720c64c55)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:09.732248 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6458d-68b4-40b5-9182-1c99f4a22185 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:09.755362 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:09.782789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-edd6458d-68b4-40b5-9182-1c99f4a22185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '257c89b572db44b69fa8a56720c64c55'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:09.798000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-edd6458d-68b4-40b5-9182-1c99f4a22185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '257c89b572db44b69fa8a56720c64c55'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:09.806239 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-edd6458d-68b4-40b5-9182-1c99f4a22185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '257c89b572db44b69fa8a56720c64c55'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:09.815300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-edd6458d-68b4-40b5-9182-1c99f4a22185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '257c89b572db44b69fa8a56720c64c55'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:09.816061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-edd6458d-68b4-40b5-9182-1c99f4a22185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '257c89b572db44b69fa8a56720c64c55'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:09.822654 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1242/2497] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:09 2022] DELETE /identity/v3/users/257c89b572db44b69fa8a56720c64c55 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:09.827514 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5955a-6dbf-4d45-af5c-498793e6784c None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.828039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5955a-6dbf-4d45-af5c-498793e6784c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.828168 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5955a-6dbf-4d45-af5c-498793e6784c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.848144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-cbc5955a-6dbf-4d45-af5c-498793e6784c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:09.849343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-cbc5955a-6dbf-4d45-af5c-498793e6784c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:09.908037 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1256/2498] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:09.917991 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6458d-68b4-40b5-9182-1c99f4a22185 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:09.919413 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-edd6458d-68b4-40b5-9182-1c99f4a22185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:09.980145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6458d-68b4-40b5-9182-1c99f4a22185 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:09.984338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a354fbb-6222-49fc-81ac-80ff1071cdc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:09.984965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a354fbb-6222-49fc-81ac-80ff1071cdc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.985253 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a354fbb-6222-49fc-81ac-80ff1071cdc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.985530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a354fbb-6222-49fc-81ac-80ff1071cdc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.997934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a354fbb-6222-49fc-81ac-80ff1071cdc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:09.997934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a354fbb-6222-49fc-81ac-80ff1071cdc0 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:10.006888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1243/2499] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:10.322202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5955a-6dbf-4d45-af5c-498793e6784c None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:10.323716 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-cbc5955a-6dbf-4d45-af5c-498793e6784c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:10.338222 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5955a-6dbf-4d45-af5c-498793e6784c None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:10.343463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:10.344192 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:10.344538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:10.344819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] PATH_INFO: `/v3/projects/6581dc69b181451d855d5fa15b500a66` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:10.346259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6581dc69b181451d855d5fa15b500a66)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:10.348465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:10.402207 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6581dc69b181451d855d5fa15b500a66', 'request_id': 'req-f2132fd5-551d-4e3e-b2ff-07c832426cf7'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:10.411081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6581dc69b181451d855d5fa15b500a66', 'request_id': 'req-f2132fd5-551d-4e3e-b2ff-07c832426cf7'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:10.417158 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6581dc69b181451d855d5fa15b500a66', 'request_id': 'req-f2132fd5-551d-4e3e-b2ff-07c832426cf7'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:10.435562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] The token cache is being invalidate because project 6581dc69b181451d855d5fa15b500a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:10.435900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:10.436583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:10.438126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1257/2500] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:10 2022] DELETE /identity/v3/projects/6581dc69b181451d855d5fa15b500a66 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:10.442668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a354fbb-6222-49fc-81ac-80ff1071cdc0 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:10.453071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a354fbb-6222-49fc-81ac-80ff1071cdc0 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:10.514117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffb802-d799-477a-95ef-d101aba9925d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:10.514761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb802-d799-477a-95ef-d101aba9925d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:10.515013 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb802-d799-477a-95ef-d101aba9925d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:10.515315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb802-d799-477a-95ef-d101aba9925d admin admin] PATH_INFO: `/v3/users/1c84c6f0c0f0488fa184e358b753b132` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:10.516510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffb802-d799-477a-95ef-d101aba9925d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c84c6f0c0f0488fa184e358b753b132)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:10.518486 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffb802-d799-477a-95ef-d101aba9925d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:10.564806 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:10.567379 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1cffb802-d799-477a-95ef-d101aba9925d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c84c6f0c0f0488fa184e358b753b132'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:10.581616 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1cffb802-d799-477a-95ef-d101aba9925d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c84c6f0c0f0488fa184e358b753b132'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:10.588366 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1cffb802-d799-477a-95ef-d101aba9925d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c84c6f0c0f0488fa184e358b753b132'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:10.597046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1cffb802-d799-477a-95ef-d101aba9925d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c84c6f0c0f0488fa184e358b753b132'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:10.597719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1cffb802-d799-477a-95ef-d101aba9925d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c84c6f0c0f0488fa184e358b753b132'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:10.605463 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1244/2501] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:10 2022] DELETE /identity/v3/users/1c84c6f0c0f0488fa184e358b753b132 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:10.911125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:10.913588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:10.939088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2132fd5-551d-4e3e-b2ff-07c832426cf7 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:11.020300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:11.020961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:11.021235 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:11.021501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07 admin admin] PATH_INFO: `/v3/projects/aad235d75c4c4eb29f4db7688d13fa8e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:11.022628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad235d75c4c4eb29f4db7688d13fa8e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:11.024847 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:11.035464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:11.075687 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad235d75c4c4eb29f4db7688d13fa8e', 'request_id': 'req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:11.083414 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad235d75c4c4eb29f4db7688d13fa8e', 'request_id': 'req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:11.089392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad235d75c4c4eb29f4db7688d13fa8e', 'request_id': 'req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:11.100473 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07 admin admin] The token cache is being invalidate because project aad235d75c4c4eb29f4db7688d13fa8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:11.100739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:11.101395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fa4ffd81-1380-4ee2-ab53-02a688bdaf07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:11.102876 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1258/2502] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:10 2022] DELETE /identity/v3/projects/aad235d75c4c4eb29f4db7688d13fa8e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:11.107906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c0e4-2926-4a20-94f8-57dc0944c114 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:11.108291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c0e4-2926-4a20-94f8-57dc0944c114 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:11.108647 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c0e4-2926-4a20-94f8-57dc0944c114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:11.129110 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-86b5c0e4-2926-4a20-94f8-57dc0944c114 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:11.130368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-86b5c0e4-2926-4a20-94f8-57dc0944c114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:11.194626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1245/2503] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:11.201432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da974754-e829-4e39-9f17-853ef915f852 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:11.201761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da974754-e829-4e39-9f17-853ef915f852 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:11.201992 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da974754-e829-4e39-9f17-853ef915f852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:11.220111 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5c0e4-2926-4a20-94f8-57dc0944c114 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:11.222119 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-86b5c0e4-2926-4a20-94f8-57dc0944c114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:11.222997 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-da974754-e829-4e39-9f17-853ef915f852 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:11.224193 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-da974754-e829-4e39-9f17-853ef915f852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:11.233043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1259/2504] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:11.237058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da974754-e829-4e39-9f17-853ef915f852 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:11.237281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5c0e4-2926-4a20-94f8-57dc0944c114 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:11.242116 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb6a96-eaba-4405-a399-be69c89cd958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:11.242756 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb6a96-eaba-4405-a399-be69c89cd958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:11.243032 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb6a96-eaba-4405-a399-be69c89cd958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:11.243287 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb6a96-eaba-4405-a399-be69c89cd958 admin admin] PATH_INFO: `/v3/users/1fd1e4b79ef64ab386973007f014f84c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:11.244553 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb6a96-eaba-4405-a399-be69c89cd958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd1e4b79ef64ab386973007f014f84c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:11.246215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da974754-e829-4e39-9f17-853ef915f852 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:11.246634 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb6a96-eaba-4405-a399-be69c89cd958 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:11.250932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574db0f-1a9c-4386-9200-87d9c3fac20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:11.251540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574db0f-1a9c-4386-9200-87d9c3fac20d admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:11.251899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574db0f-1a9c-4386-9200-87d9c3fac20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:11.252169 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574db0f-1a9c-4386-9200-87d9c3fac20d admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:11.252806 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574db0f-1a9c-4386-9200-87d9c3fac20d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:11.253096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574db0f-1a9c-4386-9200-87d9c3fac20d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:11.254868 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574db0f-1a9c-4386-9200-87d9c3fac20d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:11.267123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1260/2505] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:11.271376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574db0f-1a9c-4386-9200-87d9c3fac20d admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:11.283090 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574db0f-1a9c-4386-9200-87d9c3fac20d admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:11.288912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dd4f7-a6c3-4a6c-a296-92c4438ca04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:11.289586 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dd4f7-a6c3-4a6c-a296-92c4438ca04f admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:11.289789 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dd4f7-a6c3-4a6c-a296-92c4438ca04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:11.290051 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dd4f7-a6c3-4a6c-a296-92c4438ca04f admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:11.290776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dd4f7-a6c3-4a6c-a296-92c4438ca04f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:11.292609 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dd4f7-a6c3-4a6c-a296-92c4438ca04f admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:11.335979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-26bb6a96-eaba-4405-a399-be69c89cd958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd1e4b79ef64ab386973007f014f84c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:11.342351 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1261/2506] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:11 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:11.343436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dd4f7-a6c3-4a6c-a296-92c4438ca04f admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:11.365766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-26bb6a96-eaba-4405-a399-be69c89cd958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd1e4b79ef64ab386973007f014f84c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:11.377093 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-26bb6a96-eaba-4405-a399-be69c89cd958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd1e4b79ef64ab386973007f014f84c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:11.394371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-26bb6a96-eaba-4405-a399-be69c89cd958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd1e4b79ef64ab386973007f014f84c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:11.395405 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-26bb6a96-eaba-4405-a399-be69c89cd958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd1e4b79ef64ab386973007f014f84c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:11.404481 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1246/2507] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:11 2022] DELETE /identity/v3/users/1fd1e4b79ef64ab386973007f014f84c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:11.409313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cac407-87ba-4d4e-bbfe-b94f1ef804b2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:11.409933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cac407-87ba-4d4e-bbfe-b94f1ef804b2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:11.410766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cac407-87ba-4d4e-bbfe-b94f1ef804b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:11.426057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dd4f7-a6c3-4a6c-a296-92c4438ca04f admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:11.441517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f8cac407-87ba-4d4e-bbfe-b94f1ef804b2 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:11.444216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f8cac407-87ba-4d4e-bbfe-b94f1ef804b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:11.498466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:11.514607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fef69-27be-480a-b002-bded928134b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:11.515406 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fef69-27be-480a-b002-bded928134b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:11.517024 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fef69-27be-480a-b002-bded928134b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:11.517478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fef69-27be-480a-b002-bded928134b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:11.518135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fef69-27be-480a-b002-bded928134b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:11.521315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fef69-27be-480a-b002-bded928134b5 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:11.536268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:11.544412 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1247/2508] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:11.557312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cac407-87ba-4d4e-bbfe-b94f1ef804b2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:11.558750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f8cac407-87ba-4d4e-bbfe-b94f1ef804b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:11.559494 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1262/2509] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:11 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:11.560363 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fef69-27be-480a-b002-bded928134b5 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:11.561961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7e4fef69-27be-480a-b002-bded928134b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:11.581583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fef69-27be-480a-b002-bded928134b5 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:11.588570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a6436-4b16-4914-930e-3775e0ec39e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:11.590604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a6436-4b16-4914-930e-3775e0ec39e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:11.591131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a6436-4b16-4914-930e-3775e0ec39e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:11.591787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a6436-4b16-4914-930e-3775e0ec39e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:11.592647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a6436-4b16-4914-930e-3775e0ec39e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:11.594576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a6436-4b16-4914-930e-3775e0ec39e7 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:11.608661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1263/2510] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:11.613028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a6436-4b16-4914-930e-3775e0ec39e7 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:11.621895 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cac407-87ba-4d4e-bbfe-b94f1ef804b2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:11.625790 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a6436-4b16-4914-930e-3775e0ec39e7 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:11.625946 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e55a51-d9db-40e3-8046-65459ac07816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:11.626860 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e55a51-d9db-40e3-8046-65459ac07816 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:11.627185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e55a51-d9db-40e3-8046-65459ac07816 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:11.627466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e55a51-d9db-40e3-8046-65459ac07816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:11.632575 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b7a2-c42b-468c-861f-31f59591eb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:11.633572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b7a2-c42b-468c-861f-31f59591eb97 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:11.634076 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b7a2-c42b-468c-861f-31f59591eb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:11.634878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b7a2-c42b-468c-861f-31f59591eb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:11.636508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b7a2-c42b-468c-861f-31f59591eb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:11.638655 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b7a2-c42b-468c-861f-31f59591eb97 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:11.639080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e55a51-d9db-40e3-8046-65459ac07816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:11.641211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e55a51-d9db-40e3-8046-65459ac07816 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:11.653038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1248/2512] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:11.653233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1264/2512] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:11.657393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e55a51-d9db-40e3-8046-65459ac07816 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:11.668119 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e55a51-d9db-40e3-8046-65459ac07816 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:11.673125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a02672-2f54-4f2e-a9ff-24cd2f01943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:11.673798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a02672-2f54-4f2e-a9ff-24cd2f01943c admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:11.674074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a02672-2f54-4f2e-a9ff-24cd2f01943c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:11.674341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a02672-2f54-4f2e-a9ff-24cd2f01943c admin admin] PATH_INFO: `/v3/projects/644ce509531a47aca7b259b33fb95d20/users/b50284e2f60843a08d4de09226e710c8/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:11.690086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a02672-2f54-4f2e-a9ff-24cd2f01943c admin admin] RBAC: Authorizing `identity:create_grant(project_id=644ce509531a47aca7b259b33fb95d20, user_id=b50284e2f60843a08d4de09226e710c8, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:11.693012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a02672-2f54-4f2e-a9ff-24cd2f01943c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:11.707633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1249/2513] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:11 2022] PUT /identity/v3/projects/644ce509531a47aca7b259b33fb95d20/users/b50284e2f60843a08d4de09226e710c8/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:11.718815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2438a9-8508-4f35-a131-85ff17738a65 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:11.719369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2438a9-8508-4f35-a131-85ff17738a65 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:11.719788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2438a9-8508-4f35-a131-85ff17738a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:11.751861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-1c2438a9-8508-4f35-a131-85ff17738a65 None None] MFA Rules not processed for user `b50284e2f60843a08d4de09226e710c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:11.753449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-1c2438a9-8508-4f35-a131-85ff17738a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:11.840136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1265/2514] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:11.848313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a02672-2f54-4f2e-a9ff-24cd2f01943c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:11.851073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-07a02672-2f54-4f2e-a9ff-24cd2f01943c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:11.928690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a02672-2f54-4f2e-a9ff-24cd2f01943c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:11.933468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec3c3e-46b7-4db9-83ed-5e3c4e2db2b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:11.934157 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3c3e-46b7-4db9-83ed-5e3c4e2db2b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:11.934510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3c3e-46b7-4db9-83ed-5e3c4e2db2b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:11.934881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3c3e-46b7-4db9-83ed-5e3c4e2db2b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:11.945005 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec3c3e-46b7-4db9-83ed-5e3c4e2db2b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:11.946637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec3c3e-46b7-4db9-83ed-5e3c4e2db2b5 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:11.958373 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1250/2515] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:12.137464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2438a9-8508-4f35-a131-85ff17738a65 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:12.139584 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-1c2438a9-8508-4f35-a131-85ff17738a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:12.227413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2438a9-8508-4f35-a131-85ff17738a65 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:12.234953 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:12.235683 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:12.236009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:12.236281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] PATH_INFO: `/v3/projects/ce0009285e88429ea02b255277a0934a` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:12.237682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce0009285e88429ea02b255277a0934a)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:12.239873 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:12.304698 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0009285e88429ea02b255277a0934a', 'request_id': 'req-9294fdb2-7338-422c-bd03-ecbab3306eac'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:12.325110 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0009285e88429ea02b255277a0934a', 'request_id': 'req-9294fdb2-7338-422c-bd03-ecbab3306eac'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:12.337512 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:12.339615 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0009285e88429ea02b255277a0934a', 'request_id': 'req-9294fdb2-7338-422c-bd03-ecbab3306eac'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:12.358246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] The token cache is being invalidate because project ce0009285e88429ea02b255277a0934a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:12.358635 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:12.359194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:12.361042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1266/2516] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:12 2022] DELETE /identity/v3/projects/ce0009285e88429ea02b255277a0934a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:12.365038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec3c3e-46b7-4db9-83ed-5e3c4e2db2b5 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:12.378273 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec3c3e-46b7-4db9-83ed-5e3c4e2db2b5 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:12.454375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:12.466538 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5773130-d1a0-4b2d-b6de-070e40e84a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:12.467192 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5773130-d1a0-4b2d-b6de-070e40e84a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:12.467467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5773130-d1a0-4b2d-b6de-070e40e84a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:12.467764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5773130-d1a0-4b2d-b6de-070e40e84a53 admin admin] PATH_INFO: `/v3/users/de76002a42124bdc80a56255efd125fa` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:12.468894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5773130-d1a0-4b2d-b6de-070e40e84a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de76002a42124bdc80a56255efd125fa)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:12.470809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5773130-d1a0-4b2d-b6de-070e40e84a53 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:12.520320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b5773130-d1a0-4b2d-b6de-070e40e84a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de76002a42124bdc80a56255efd125fa'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:12.533433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b5773130-d1a0-4b2d-b6de-070e40e84a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de76002a42124bdc80a56255efd125fa'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:12.540565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b5773130-d1a0-4b2d-b6de-070e40e84a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de76002a42124bdc80a56255efd125fa'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:12.549266 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b5773130-d1a0-4b2d-b6de-070e40e84a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de76002a42124bdc80a56255efd125fa'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:12.549900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b5773130-d1a0-4b2d-b6de-070e40e84a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de76002a42124bdc80a56255efd125fa'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:12.556191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1251/2517] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:12 2022] DELETE /identity/v3/users/de76002a42124bdc80a56255efd125fa => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:12.874578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:12.876449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:12.900266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294fdb2-7338-422c-bd03-ecbab3306eac admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:12.974628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:12.978528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:12.978875 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:12.979156 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] PATH_INFO: `/v3/projects/561d57fca4c04763b55532307940f75e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:12.980459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561d57fca4c04763b55532307940f75e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:12.984629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:13.060389 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561d57fca4c04763b55532307940f75e', 'request_id': 'req-1d442507-e31f-4df8-9691-122b6a7f7748'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.071368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561d57fca4c04763b55532307940f75e', 'request_id': 'req-1d442507-e31f-4df8-9691-122b6a7f7748'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.078317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561d57fca4c04763b55532307940f75e', 'request_id': 'req-1d442507-e31f-4df8-9691-122b6a7f7748'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.097255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] The token cache is being invalidate because project 561d57fca4c04763b55532307940f75e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:13.097451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.100214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.106889 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1267/2518] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:12 2022] DELETE /identity/v3/projects/561d57fca4c04763b55532307940f75e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:13.108969 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c990fd3-b7d7-4143-9d79-e3a72f8859d7 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.108969 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c990fd3-b7d7-4143-9d79-e3a72f8859d7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.109279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c990fd3-b7d7-4143-9d79-e3a72f8859d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.130353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4c990fd3-b7d7-4143-9d79-e3a72f8859d7 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:13.131565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4c990fd3-b7d7-4143-9d79-e3a72f8859d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:13.169776 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:13.171272 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:13.252271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1252/2519] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:13.253701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c990fd3-b7d7-4143-9d79-e3a72f8859d7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:13.256148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4c990fd3-b7d7-4143-9d79-e3a72f8859d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:13.269385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c990fd3-b7d7-4143-9d79-e3a72f8859d7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:13.274208 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d81cd-9412-4289-af65-49bc0a43d4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:13.274836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d81cd-9412-4289-af65-49bc0a43d4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.275113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d81cd-9412-4289-af65-49bc0a43d4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.275389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d81cd-9412-4289-af65-49bc0a43d4ba admin admin] PATH_INFO: `/v3/users/1aeead6fcbc54b39826b5da033dd9d5f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.276557 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d81cd-9412-4289-af65-49bc0a43d4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aeead6fcbc54b39826b5da033dd9d5f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:13.278526 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d81cd-9412-4289-af65-49bc0a43d4ba admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:13.281387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d442507-e31f-4df8-9691-122b6a7f7748 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:13.287113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93861b9-b5bd-40b8-9daa-50112b85fd5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01dd2631a81402d8a5bba7007c7fd61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:13.287902 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93861b9-b5bd-40b8-9daa-50112b85fd5a service placement] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.288018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93861b9-b5bd-40b8-9daa-50112b85fd5a service placement] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.288293 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93861b9-b5bd-40b8-9daa-50112b85fd5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.290018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a93861b9-b5bd-40b8-9daa-50112b85fd5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:13.302653 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93861b9-b5bd-40b8-9daa-50112b85fd5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:13.304310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93861b9-b5bd-40b8-9daa-50112b85fd5a service placement] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:13.316110 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1268/2520] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:13.317771 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09eeca-2c32-447f-b874-439feee2edbb None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.318319 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09eeca-2c32-447f-b874-439feee2edbb None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.318599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09eeca-2c32-447f-b874-439feee2edbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.349539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-fc09eeca-2c32-447f-b874-439feee2edbb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:13.350741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-fc09eeca-2c32-447f-b874-439feee2edbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:13.367120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6d7d81cd-9412-4289-af65-49bc0a43d4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aeead6fcbc54b39826b5da033dd9d5f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.386391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1269/2521] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:13.386391 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09eeca-2c32-447f-b874-439feee2edbb None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:13.390760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6d7d81cd-9412-4289-af65-49bc0a43d4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aeead6fcbc54b39826b5da033dd9d5f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.393131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:13.398265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:13.398678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09eeca-2c32-447f-b874-439feee2edbb None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:13.411574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e91df-47ab-463e-91fc-8b02143ba521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:13.412274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e91df-47ab-463e-91fc-8b02143ba521 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.412583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e91df-47ab-463e-91fc-8b02143ba521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.412955 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e91df-47ab-463e-91fc-8b02143ba521 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.413560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e91df-47ab-463e-91fc-8b02143ba521 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:13.414285 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e91df-47ab-463e-91fc-8b02143ba521 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:13.414677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6d7d81cd-9412-4289-af65-49bc0a43d4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aeead6fcbc54b39826b5da033dd9d5f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.416705 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e91df-47ab-463e-91fc-8b02143ba521 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:13.425879 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6d7d81cd-9412-4289-af65-49bc0a43d4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aeead6fcbc54b39826b5da033dd9d5f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.429030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6d7d81cd-9412-4289-af65-49bc0a43d4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aeead6fcbc54b39826b5da033dd9d5f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.435442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1270/2522] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:13.438826 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1253/2523] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:13 2022] DELETE /identity/v3/users/1aeead6fcbc54b39826b5da033dd9d5f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:13.439971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e91df-47ab-463e-91fc-8b02143ba521 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:13.442271 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d54e91df-47ab-463e-91fc-8b02143ba521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:13.456443 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e91df-47ab-463e-91fc-8b02143ba521 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:13.529888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c53cc-214c-4103-8aa0-3830955c0290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:13.530516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c53cc-214c-4103-8aa0-3830955c0290 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.530796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c53cc-214c-4103-8aa0-3830955c0290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.531069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c53cc-214c-4103-8aa0-3830955c0290 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.531855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c53cc-214c-4103-8aa0-3830955c0290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:13.535101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c53cc-214c-4103-8aa0-3830955c0290 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:13.577024 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1271/2524] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:13 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:13.581753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d81cd-9412-4289-af65-49bc0a43d4ba admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:13.600189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d81cd-9412-4289-af65-49bc0a43d4ba admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:13.642146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c53cc-214c-4103-8aa0-3830955c0290 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:13.644665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2d6c53cc-214c-4103-8aa0-3830955c0290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:13.697787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486a0a2-88cd-4b6e-8f86-6a13c21717f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:13.698486 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486a0a2-88cd-4b6e-8f86-6a13c21717f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.698861 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486a0a2-88cd-4b6e-8f86-6a13c21717f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.699214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486a0a2-88cd-4b6e-8f86-6a13c21717f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.699963 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486a0a2-88cd-4b6e-8f86-6a13c21717f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:13.701949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486a0a2-88cd-4b6e-8f86-6a13c21717f2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:13.720553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c53cc-214c-4103-8aa0-3830955c0290 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:13.725924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b40d91-86b8-4023-ac6c-9c384f20db2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:13.726550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b40d91-86b8-4023-ac6c-9c384f20db2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.726688 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1254/2525] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:13 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:13.730102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b40d91-86b8-4023-ac6c-9c384f20db2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.730102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b40d91-86b8-4023-ac6c-9c384f20db2e admin admin] PATH_INFO: `/v3/projects/ec9c4e090047403a802aee0fc48a8c47` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.730102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b40d91-86b8-4023-ac6c-9c384f20db2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9c4e090047403a802aee0fc48a8c47)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:13.730851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b40d91-86b8-4023-ac6c-9c384f20db2e admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:13.731505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486a0a2-88cd-4b6e-8f86-6a13c21717f2 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:13.745475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486a0a2-88cd-4b6e-8f86-6a13c21717f2 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:13.747660 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b4d5c-2b76-4bce-a375-0b90e79634c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:13.748298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b4d5c-2b76-4bce-a375-0b90e79634c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.748573 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b4d5c-2b76-4bce-a375-0b90e79634c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.748839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b4d5c-2b76-4bce-a375-0b90e79634c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.749476 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b4d5c-2b76-4bce-a375-0b90e79634c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:13.751051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b4d5c-2b76-4bce-a375-0b90e79634c3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:13.766159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1255/2526] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:13.767313 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b4d5c-2b76-4bce-a375-0b90e79634c3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:13.777745 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b4d5c-2b76-4bce-a375-0b90e79634c3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:13.789105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-47b40d91-86b8-4023-ac6c-9c384f20db2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9c4e090047403a802aee0fc48a8c47', 'request_id': 'req-47b40d91-86b8-4023-ac6c-9c384f20db2e'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.803725 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-47b40d91-86b8-4023-ac6c-9c384f20db2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9c4e090047403a802aee0fc48a8c47', 'request_id': 'req-47b40d91-86b8-4023-ac6c-9c384f20db2e'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.811189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-47b40d91-86b8-4023-ac6c-9c384f20db2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9c4e090047403a802aee0fc48a8c47', 'request_id': 'req-47b40d91-86b8-4023-ac6c-9c384f20db2e'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.823504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-47b40d91-86b8-4023-ac6c-9c384f20db2e admin admin] The token cache is being invalidate because project ec9c4e090047403a802aee0fc48a8c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:13.823741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-47b40d91-86b8-4023-ac6c-9c384f20db2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.824415 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-47b40d91-86b8-4023-ac6c-9c384f20db2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:13.826357 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1272/2527] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:13 2022] DELETE /identity/v3/projects/ec9c4e090047403a802aee0fc48a8c47 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:13.831523 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c30b8-cd7d-4be4-809d-00f7817dc382 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.832001 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c30b8-cd7d-4be4-809d-00f7817dc382 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.832230 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c30b8-cd7d-4be4-809d-00f7817dc382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.847944 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:13.853584 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34a2ec-a3c1-4048-9924-a8f49618ff7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:13.854382 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34a2ec-a3c1-4048-9924-a8f49618ff7d admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.854737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34a2ec-a3c1-4048-9924-a8f49618ff7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.854930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34a2ec-a3c1-4048-9924-a8f49618ff7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.855554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-8d6c30b8-cd7d-4be4-809d-00f7817dc382 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:13.855756 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34a2ec-a3c1-4048-9924-a8f49618ff7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:13.857335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34a2ec-a3c1-4048-9924-a8f49618ff7d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:13.858226 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-8d6c30b8-cd7d-4be4-809d-00f7817dc382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:13.868040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1273/2528] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:13.869027 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1256/2529] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:13.873038 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c30b8-cd7d-4be4-809d-00f7817dc382 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:13.874356 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-8d6c30b8-cd7d-4be4-809d-00f7817dc382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:13.876518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b39557-608f-4c82-9395-91a3efe4cf69 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.876991 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b39557-608f-4c82-9395-91a3efe4cf69 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.877427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b39557-608f-4c82-9395-91a3efe4cf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.886169 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c30b8-cd7d-4be4-809d-00f7817dc382 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:13.890968 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1b8dd-e68a-4f17-9eef-7c742b0b68b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:13.891620 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1b8dd-e68a-4f17-9eef-7c742b0b68b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.891933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1b8dd-e68a-4f17-9eef-7c742b0b68b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.892206 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1b8dd-e68a-4f17-9eef-7c742b0b68b3 admin admin] PATH_INFO: `/v3/projects/ebffc71e295f4556a1a10ea25a0aa7e5/users/84c52ad83f8745f59cfe829928037dba/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.902308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-07b39557-608f-4c82-9395-91a3efe4cf69 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:13.903530 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-07b39557-608f-4c82-9395-91a3efe4cf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:13.908084 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1b8dd-e68a-4f17-9eef-7c742b0b68b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebffc71e295f4556a1a10ea25a0aa7e5, user_id=84c52ad83f8745f59cfe829928037dba, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:13.910759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1b8dd-e68a-4f17-9eef-7c742b0b68b3 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:13.912435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1257/2530] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:13.917159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b39557-608f-4c82-9395-91a3efe4cf69 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:13.928099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1274/2531] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:13 2022] PUT /identity/v3/projects/ebffc71e295f4556a1a10ea25a0aa7e5/users/84c52ad83f8745f59cfe829928037dba/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:13.928880 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b39557-608f-4c82-9395-91a3efe4cf69 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:13.942430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a811b5-87c3-4b10-9454-45ad43a1cdea None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:13.942713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a811b5-87c3-4b10-9454-45ad43a1cdea None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:13.943299 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a811b5-87c3-4b10-9454-45ad43a1cdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:13.973106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-19a811b5-87c3-4b10-9454-45ad43a1cdea None None] MFA Rules not processed for user `84c52ad83f8745f59cfe829928037dba`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:13.974321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-19a811b5-87c3-4b10-9454-45ad43a1cdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:13.990989 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:14.001921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e1367-32b7-4673-97a5-a01d10c17683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:14.003020 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e1367-32b7-4673-97a5-a01d10c17683 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:14.003246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e1367-32b7-4673-97a5-a01d10c17683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:14.003736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e1367-32b7-4673-97a5-a01d10c17683 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:14.004404 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e1367-32b7-4673-97a5-a01d10c17683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:14.005004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e1367-32b7-4673-97a5-a01d10c17683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:14.007963 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e1367-32b7-4673-97a5-a01d10c17683 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:14.023765 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1258/2532] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:27:14.025766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e1367-32b7-4673-97a5-a01d10c17683 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:14.038504 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e1367-32b7-4673-97a5-a01d10c17683 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:14.048472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9119719-7b65-4000-b56c-bea2e18e1895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:14.049153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9119719-7b65-4000-b56c-bea2e18e1895 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:14.049992 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9119719-7b65-4000-b56c-bea2e18e1895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:14.050339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9119719-7b65-4000-b56c-bea2e18e1895 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:14.051427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9119719-7b65-4000-b56c-bea2e18e1895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:14.053069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9119719-7b65-4000-b56c-bea2e18e1895 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:14.060644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1275/2533] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:14.074805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a811b5-87c3-4b10-9454-45ad43a1cdea None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:14.076504 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-19a811b5-87c3-4b10-9454-45ad43a1cdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:14.087953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1259/2534] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:14 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:14.091741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9119719-7b65-4000-b56c-bea2e18e1895 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:14.144157 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a811b5-87c3-4b10-9454-45ad43a1cdea None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:14.167276 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9119719-7b65-4000-b56c-bea2e18e1895 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:14.173045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d5c28-2f7c-412a-91a9-ca7c582a7d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:14.173547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d5c28-2f7c-412a-91a9-ca7c582a7d11 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:14.173906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d5c28-2f7c-412a-91a9-ca7c582a7d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:14.174221 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d5c28-2f7c-412a-91a9-ca7c582a7d11 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:14.174936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d5c28-2f7c-412a-91a9-ca7c582a7d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:14.177275 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d5c28-2f7c-412a-91a9-ca7c582a7d11 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:14.199857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18819753-f8d0-4f1b-9cc0-36b13589b7f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:14.203795 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1260/2535] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:14 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:14.204015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18819753-f8d0-4f1b-9cc0-36b13589b7f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:14.204015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18819753-f8d0-4f1b-9cc0-36b13589b7f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:14.204015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18819753-f8d0-4f1b-9cc0-36b13589b7f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:14.204463 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d5c28-2f7c-412a-91a9-ca7c582a7d11 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:14.214988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d5c28-2f7c-412a-91a9-ca7c582a7d11 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:14.219719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3dfc1-2df3-47fc-b52f-7bfc85432935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:14.220330 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3dfc1-2df3-47fc-b52f-7bfc85432935 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:14.220612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3dfc1-2df3-47fc-b52f-7bfc85432935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:14.220911 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3dfc1-2df3-47fc-b52f-7bfc85432935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:14.221560 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3dfc1-2df3-47fc-b52f-7bfc85432935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:14.223298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3dfc1-2df3-47fc-b52f-7bfc85432935 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:14.234166 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1261/2536] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:14.237731 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:14.238877 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3dfc1-2df3-47fc-b52f-7bfc85432935 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:14.249030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3dfc1-2df3-47fc-b52f-7bfc85432935 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:14.254232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0491c9-44b5-4b83-9122-68b88bb9b585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:14.254846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0491c9-44b5-4b83-9122-68b88bb9b585 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:14.255122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0491c9-44b5-4b83-9122-68b88bb9b585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:14.255427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0491c9-44b5-4b83-9122-68b88bb9b585 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:14.256064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0491c9-44b5-4b83-9122-68b88bb9b585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:14.257776 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0491c9-44b5-4b83-9122-68b88bb9b585 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:14.263973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18819753-f8d0-4f1b-9cc0-36b13589b7f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:14.265418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18819753-f8d0-4f1b-9cc0-36b13589b7f8 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:14.268990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1262/2537] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:14.273099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0491c9-44b5-4b83-9122-68b88bb9b585 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:14.279111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1276/2538] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:14.283161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0491c9-44b5-4b83-9122-68b88bb9b585 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:14.288307 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d51e4-9b72-4cb3-9cfe-9471f9a8006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:14.289087 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d51e4-9b72-4cb3-9cfe-9471f9a8006f admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:14.289491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d51e4-9b72-4cb3-9cfe-9471f9a8006f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:14.289879 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d51e4-9b72-4cb3-9cfe-9471f9a8006f admin admin] PATH_INFO: `/v3/projects/18456ff42cb045caaeb26bc8f23e1b34/users/7b5e3765ef724a3ca6664f9ab4703090/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:14.308812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d51e4-9b72-4cb3-9cfe-9471f9a8006f admin admin] RBAC: Authorizing `identity:create_grant(project_id=18456ff42cb045caaeb26bc8f23e1b34, user_id=7b5e3765ef724a3ca6664f9ab4703090, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:14.311883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d51e4-9b72-4cb3-9cfe-9471f9a8006f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:14.325700 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1263/2539] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:14 2022] PUT /identity/v3/projects/18456ff42cb045caaeb26bc8f23e1b34/users/7b5e3765ef724a3ca6664f9ab4703090/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:14.336242 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba180-811e-4421-875e-468b2dfb17eb None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:14.336523 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba180-811e-4421-875e-468b2dfb17eb None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:14.336790 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba180-811e-4421-875e-468b2dfb17eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:14.369222 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-e95ba180-811e-4421-875e-468b2dfb17eb None None] MFA Rules not processed for user `7b5e3765ef724a3ca6664f9ab4703090`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:14.370577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e95ba180-811e-4421-875e-468b2dfb17eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:14.443868 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1277/2540] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:14.458343 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d51e4-9b72-4cb3-9cfe-9471f9a8006f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:14.460861 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-aa3d51e4-9b72-4cb3-9cfe-9471f9a8006f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:14.557645 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d51e4-9b72-4cb3-9cfe-9471f9a8006f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:14.580770 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9913462-88f6-4299-a2a9-89ee1cb8a5ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:14.581476 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9913462-88f6-4299-a2a9-89ee1cb8a5ac service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:14.581764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9913462-88f6-4299-a2a9-89ee1cb8a5ac service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:14.582045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9913462-88f6-4299-a2a9-89ee1cb8a5ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:14.588930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:14.594297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9913462-88f6-4299-a2a9-89ee1cb8a5ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:14.596041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9913462-88f6-4299-a2a9-89ee1cb8a5ac service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:14.606564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1264/2541] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:15.189774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba180-811e-4421-875e-468b2dfb17eb None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:15.191502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e95ba180-811e-4421-875e-468b2dfb17eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:15.258218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba180-811e-4421-875e-468b2dfb17eb None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:15.263869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424689c7-236a-4fec-aca2-a721d189b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:15.264495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424689c7-236a-4fec-aca2-a721d189b248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:15.264767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424689c7-236a-4fec-aca2-a721d189b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:15.265030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424689c7-236a-4fec-aca2-a721d189b248 admin admin] PATH_INFO: `/v3/users/b50284e2f60843a08d4de09226e710c8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:15.266369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424689c7-236a-4fec-aca2-a721d189b248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b50284e2f60843a08d4de09226e710c8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:15.268354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424689c7-236a-4fec-aca2-a721d189b248 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:15.323900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-424689c7-236a-4fec-aca2-a721d189b248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b50284e2f60843a08d4de09226e710c8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:15.336026 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-424689c7-236a-4fec-aca2-a721d189b248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b50284e2f60843a08d4de09226e710c8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:15.338071 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:15.343737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-424689c7-236a-4fec-aca2-a721d189b248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b50284e2f60843a08d4de09226e710c8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:15.352134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-424689c7-236a-4fec-aca2-a721d189b248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b50284e2f60843a08d4de09226e710c8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:15.352758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-424689c7-236a-4fec-aca2-a721d189b248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b50284e2f60843a08d4de09226e710c8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:15.358638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1278/2542] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:15 2022] DELETE /identity/v3/users/b50284e2f60843a08d4de09226e710c8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:15.363229 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0409644-d949-463c-8d0b-e51befc97dda None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:15.363517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0409644-d949-463c-8d0b-e51befc97dda None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:15.363837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0409644-d949-463c-8d0b-e51befc97dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:15.383552 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b0409644-d949-463c-8d0b-e51befc97dda None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:15.384797 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b0409644-d949-463c-8d0b-e51befc97dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:15.446439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1265/2543] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:15.456899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424689c7-236a-4fec-aca2-a721d189b248 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:15.458353 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-424689c7-236a-4fec-aca2-a721d189b248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:15.515455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424689c7-236a-4fec-aca2-a721d189b248 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:15.519320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8875c26-8c12-4200-99c6-200abc9848d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:15.519959 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8875c26-8c12-4200-99c6-200abc9848d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:15.520264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8875c26-8c12-4200-99c6-200abc9848d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:15.520680 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8875c26-8c12-4200-99c6-200abc9848d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:15.530532 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8875c26-8c12-4200-99c6-200abc9848d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:15.532040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8875c26-8c12-4200-99c6-200abc9848d4 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:15.541488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1279/2544] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:15.814525 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0409644-d949-463c-8d0b-e51befc97dda None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:15.816777 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b0409644-d949-463c-8d0b-e51befc97dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:15.829669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0409644-d949-463c-8d0b-e51befc97dda None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:15.834989 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627859e6-358d-4b08-8010-83d784c37da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:15.835639 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627859e6-358d-4b08-8010-83d784c37da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:15.835958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627859e6-358d-4b08-8010-83d784c37da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:15.836237 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627859e6-358d-4b08-8010-83d784c37da5 admin admin] PATH_INFO: `/v3/projects/644ce509531a47aca7b259b33fb95d20` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:15.837385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627859e6-358d-4b08-8010-83d784c37da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=644ce509531a47aca7b259b33fb95d20)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:15.839312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627859e6-358d-4b08-8010-83d784c37da5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:15.897148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-627859e6-358d-4b08-8010-83d784c37da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644ce509531a47aca7b259b33fb95d20', 'request_id': 'req-627859e6-358d-4b08-8010-83d784c37da5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:15.906221 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-627859e6-358d-4b08-8010-83d784c37da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644ce509531a47aca7b259b33fb95d20', 'request_id': 'req-627859e6-358d-4b08-8010-83d784c37da5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:15.912508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-627859e6-358d-4b08-8010-83d784c37da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644ce509531a47aca7b259b33fb95d20', 'request_id': 'req-627859e6-358d-4b08-8010-83d784c37da5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:15.924051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-627859e6-358d-4b08-8010-83d784c37da5 admin admin] The token cache is being invalidate because project 644ce509531a47aca7b259b33fb95d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:15.924342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-627859e6-358d-4b08-8010-83d784c37da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:15.925165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-627859e6-358d-4b08-8010-83d784c37da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:15.926636 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1266/2545] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:15 2022] DELETE /identity/v3/projects/644ce509531a47aca7b259b33fb95d20 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:15.931482 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0082382-1f3b-4371-a322-59edba708eb3 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:15.931781 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0082382-1f3b-4371-a322-59edba708eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:15.932307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0082382-1f3b-4371-a322-59edba708eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:15.952247 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-d0082382-1f3b-4371-a322-59edba708eb3 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:15.953344 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d0082382-1f3b-4371-a322-59edba708eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:16.013420 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1280/2546] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:16.023246 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f032a-ca13-49a5-a526-1c354e65dac4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:16.023509 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f032a-ca13-49a5-a526-1c354e65dac4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:16.023825 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f032a-ca13-49a5-a526-1c354e65dac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:16.046075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-672f032a-ca13-49a5-a526-1c354e65dac4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:16.047670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-672f032a-ca13-49a5-a526-1c354e65dac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:16.056228 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1267/2547] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:16.060644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0082382-1f3b-4371-a322-59edba708eb3 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:16.070570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0082382-1f3b-4371-a322-59edba708eb3 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:16.075486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbe68e-324a-49c3-ab78-fa4e37e192f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:16.076117 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe68e-324a-49c3-ab78-fa4e37e192f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:16.076416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe68e-324a-49c3-ab78-fa4e37e192f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:16.076669 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe68e-324a-49c3-ab78-fa4e37e192f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:16.077316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbe68e-324a-49c3-ab78-fa4e37e192f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:16.077612 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbe68e-324a-49c3-ab78-fa4e37e192f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:16.079213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbe68e-324a-49c3-ab78-fa4e37e192f7 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:16.095316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1281/2548] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:27:16.096486 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f032a-ca13-49a5-a526-1c354e65dac4 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:16.105857 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f032a-ca13-49a5-a526-1c354e65dac4 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:16.110932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b403cf-d283-4c5e-98cc-339d683377f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:16.111540 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b403cf-d283-4c5e-98cc-339d683377f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:16.111862 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b403cf-d283-4c5e-98cc-339d683377f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:16.112136 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b403cf-d283-4c5e-98cc-339d683377f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:16.112953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b403cf-d283-4c5e-98cc-339d683377f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:16.114837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b403cf-d283-4c5e-98cc-339d683377f8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:16.151098 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1268/2549] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:16 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:16.152345 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbe68e-324a-49c3-ab78-fa4e37e192f7 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:16.162999 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbe68e-324a-49c3-ab78-fa4e37e192f7 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:16.222803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a2eda-c4b2-4f9d-9d3d-ef9d204aee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:16.223426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a2eda-c4b2-4f9d-9d3d-ef9d204aee5c admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:16.223775 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a2eda-c4b2-4f9d-9d3d-ef9d204aee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:16.224148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a2eda-c4b2-4f9d-9d3d-ef9d204aee5c admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:16.224727 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a2eda-c4b2-4f9d-9d3d-ef9d204aee5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:16.226863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a2eda-c4b2-4f9d-9d3d-ef9d204aee5c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:16.253104 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1282/2550] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:16 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:16.254315 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b403cf-d283-4c5e-98cc-339d683377f8 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:16.266914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b403cf-d283-4c5e-98cc-339d683377f8 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:16.271895 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1aee6-99e6-47f4-8b34-940fe9101d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:16.272517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1aee6-99e6-47f4-8b34-940fe9101d05 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:16.272803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1aee6-99e6-47f4-8b34-940fe9101d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:16.273082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1aee6-99e6-47f4-8b34-940fe9101d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:16.273739 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1aee6-99e6-47f4-8b34-940fe9101d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:16.275494 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1aee6-99e6-47f4-8b34-940fe9101d05 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:16.287124 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1269/2551] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:16.291890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a2eda-c4b2-4f9d-9d3d-ef9d204aee5c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:16.299620 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:16.303581 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a2eda-c4b2-4f9d-9d3d-ef9d204aee5c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:16.310111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea7be0-60ff-43d0-b416-61b0a1720979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:16.310740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea7be0-60ff-43d0-b416-61b0a1720979 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:16.311031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea7be0-60ff-43d0-b416-61b0a1720979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:16.311558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea7be0-60ff-43d0-b416-61b0a1720979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:16.312461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea7be0-60ff-43d0-b416-61b0a1720979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:16.314242 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea7be0-60ff-43d0-b416-61b0a1720979 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:16.326338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1283/2552] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:16.330488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1aee6-99e6-47f4-8b34-940fe9101d05 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:16.341276 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1aee6-99e6-47f4-8b34-940fe9101d05 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:16.346100 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b43792-47c7-414d-9658-2703c481d53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:16.346872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b43792-47c7-414d-9658-2703c481d53d admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:16.347213 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b43792-47c7-414d-9658-2703c481d53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:16.347571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b43792-47c7-414d-9658-2703c481d53d admin admin] PATH_INFO: `/v3/projects/3d33c83877f741df96cc95c470ff4d2f/users/cdc684401b5e4553973667ad50c66e20/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:16.363150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b43792-47c7-414d-9658-2703c481d53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d33c83877f741df96cc95c470ff4d2f, user_id=cdc684401b5e4553973667ad50c66e20, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:16.366559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b43792-47c7-414d-9658-2703c481d53d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:16.380374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1270/2553] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:16 2022] PUT /identity/v3/projects/3d33c83877f741df96cc95c470ff4d2f/users/cdc684401b5e4553973667ad50c66e20/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:16.390658 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a394b-4130-4675-bdec-e41413f7a611 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:16.391009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a394b-4130-4675-bdec-e41413f7a611 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:16.391288 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a394b-4130-4675-bdec-e41413f7a611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:16.419308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-be2a394b-4130-4675-bdec-e41413f7a611 None None] MFA Rules not processed for user `cdc684401b5e4553973667ad50c66e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:16.420693 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-be2a394b-4130-4675-bdec-e41413f7a611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:16.489788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1284/2554] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:16.501839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b43792-47c7-414d-9658-2703c481d53d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:16.504039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-28b43792-47c7-414d-9658-2703c481d53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:16.523687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:16.564866 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b43792-47c7-414d-9658-2703c481d53d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:16.568996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3896a-8965-4482-b622-be3d97849677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:16.569600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3896a-8965-4482-b622-be3d97849677 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:16.569876 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3896a-8965-4482-b622-be3d97849677 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:16.570147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3896a-8965-4482-b622-be3d97849677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:16.578545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3896a-8965-4482-b622-be3d97849677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:16.579988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3896a-8965-4482-b622-be3d97849677 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:16.588914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1271/2555] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:19.168938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a394b-4130-4675-bdec-e41413f7a611 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:19.233864 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a394b-4130-4675-bdec-e41413f7a611 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:19.238866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde511a-4f9c-4e6c-8185-cabc2d93ea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:19.239506 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde511a-4f9c-4e6c-8185-cabc2d93ea3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.239839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde511a-4f9c-4e6c-8185-cabc2d93ea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.240113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde511a-4f9c-4e6c-8185-cabc2d93ea3b admin admin] PATH_INFO: `/v3/users/cdc684401b5e4553973667ad50c66e20` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:19.241287 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde511a-4f9c-4e6c-8185-cabc2d93ea3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc684401b5e4553973667ad50c66e20)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:19.243250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde511a-4f9c-4e6c-8185-cabc2d93ea3b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:19.297049 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4cde511a-4f9c-4e6c-8185-cabc2d93ea3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc684401b5e4553973667ad50c66e20'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.310021 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4cde511a-4f9c-4e6c-8185-cabc2d93ea3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc684401b5e4553973667ad50c66e20'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.316811 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4cde511a-4f9c-4e6c-8185-cabc2d93ea3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc684401b5e4553973667ad50c66e20'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.324861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4cde511a-4f9c-4e6c-8185-cabc2d93ea3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc684401b5e4553973667ad50c66e20'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.325589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-4cde511a-4f9c-4e6c-8185-cabc2d93ea3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc684401b5e4553973667ad50c66e20'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.331747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1285/2556] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:19 2022] DELETE /identity/v3/users/cdc684401b5e4553973667ad50c66e20 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:19.336567 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ad7f8-00b5-4da7-bcc7-c8ce837b848c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.337102 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ad7f8-00b5-4da7-bcc7-c8ce837b848c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.337379 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ad7f8-00b5-4da7-bcc7-c8ce837b848c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:19.360764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b84ad7f8-00b5-4da7-bcc7-c8ce837b848c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:19.361844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b84ad7f8-00b5-4da7-bcc7-c8ce837b848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:19.424674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1272/2557] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:19.434688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde511a-4f9c-4e6c-8185-cabc2d93ea3b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:19.436186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-4cde511a-4f9c-4e6c-8185-cabc2d93ea3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:19.441650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:19.500549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde511a-4f9c-4e6c-8185-cabc2d93ea3b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:19.504270 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0d850-5971-46e0-b640-43afa0f76bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:19.504872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0d850-5971-46e0-b640-43afa0f76bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.505149 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0d850-5971-46e0-b640-43afa0f76bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.505416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0d850-5971-46e0-b640-43afa0f76bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:19.514742 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0d850-5971-46e0-b640-43afa0f76bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:19.516250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0d850-5971-46e0-b640-43afa0f76bc8 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:19.526487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1286/2558] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:19.840171 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ad7f8-00b5-4da7-bcc7-c8ce837b848c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:19.842292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b84ad7f8-00b5-4da7-bcc7-c8ce837b848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:19.866719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ad7f8-00b5-4da7-bcc7-c8ce837b848c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:19.875858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0d850-5971-46e0-b640-43afa0f76bc8 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:19.875990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23fb99-6c8d-4780-96db-8864b1a4c403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:19.876577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23fb99-6c8d-4780-96db-8864b1a4c403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.876868 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23fb99-6c8d-4780-96db-8864b1a4c403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.877135 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23fb99-6c8d-4780-96db-8864b1a4c403 admin admin] PATH_INFO: `/v3/projects/3d33c83877f741df96cc95c470ff4d2f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:19.877579 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-07b0d850-5971-46e0-b640-43afa0f76bc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:19.878462 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23fb99-6c8d-4780-96db-8864b1a4c403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d33c83877f741df96cc95c470ff4d2f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:19.880379 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23fb99-6c8d-4780-96db-8864b1a4c403 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:19.890824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0d850-5971-46e0-b640-43afa0f76bc8 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:19.895902 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a848c-b7f8-4aca-b15b-14162b6ef603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:19.896627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a848c-b7f8-4aca-b15b-14162b6ef603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.896981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a848c-b7f8-4aca-b15b-14162b6ef603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.897299 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a848c-b7f8-4aca-b15b-14162b6ef603 admin admin] PATH_INFO: `/v3/users/7b5e3765ef724a3ca6664f9ab4703090` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:19.898473 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a848c-b7f8-4aca-b15b-14162b6ef603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b5e3765ef724a3ca6664f9ab4703090)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:19.900528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a848c-b7f8-4aca-b15b-14162b6ef603 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:19.929099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3f23fb99-6c8d-4780-96db-8864b1a4c403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d33c83877f741df96cc95c470ff4d2f', 'request_id': 'req-3f23fb99-6c8d-4780-96db-8864b1a4c403'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.939309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3f23fb99-6c8d-4780-96db-8864b1a4c403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d33c83877f741df96cc95c470ff4d2f', 'request_id': 'req-3f23fb99-6c8d-4780-96db-8864b1a4c403'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.945595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3f23fb99-6c8d-4780-96db-8864b1a4c403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d33c83877f741df96cc95c470ff4d2f', 'request_id': 'req-3f23fb99-6c8d-4780-96db-8864b1a4c403'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.951505 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-871a848c-b7f8-4aca-b15b-14162b6ef603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b5e3765ef724a3ca6664f9ab4703090'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.957685 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3f23fb99-6c8d-4780-96db-8864b1a4c403 admin admin] The token cache is being invalidate because project 3d33c83877f741df96cc95c470ff4d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:19.957980 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3f23fb99-6c8d-4780-96db-8864b1a4c403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.958682 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3f23fb99-6c8d-4780-96db-8864b1a4c403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.960309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1273/2559] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:19 2022] DELETE /identity/v3/projects/3d33c83877f741df96cc95c470ff4d2f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:19.964889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a60046-711e-4ab5-9e9e-b2cbb665a62f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.965018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-871a848c-b7f8-4aca-b15b-14162b6ef603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b5e3765ef724a3ca6664f9ab4703090'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.965170 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a60046-711e-4ab5-9e9e-b2cbb665a62f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.965441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a60046-711e-4ab5-9e9e-b2cbb665a62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:19.971780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-871a848c-b7f8-4aca-b15b-14162b6ef603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b5e3765ef724a3ca6664f9ab4703090'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.980544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-871a848c-b7f8-4aca-b15b-14162b6ef603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b5e3765ef724a3ca6664f9ab4703090'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.981169 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-871a848c-b7f8-4aca-b15b-14162b6ef603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b5e3765ef724a3ca6664f9ab4703090'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:19.984911 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-50a60046-711e-4ab5-9e9e-b2cbb665a62f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:19.986125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-50a60046-711e-4ab5-9e9e-b2cbb665a62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:19.987829 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1287/2560] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:19 2022] DELETE /identity/v3/users/7b5e3765ef724a3ca6664f9ab4703090 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:19.992439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bfdea-8c56-4988-b43e-899028ef7bd7 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:19.992728 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bfdea-8c56-4988-b43e-899028ef7bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:19.993050 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bfdea-8c56-4988-b43e-899028ef7bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.011415 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-982bfdea-8c56-4988-b43e-899028ef7bd7 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:20.012643 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-982bfdea-8c56-4988-b43e-899028ef7bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:20.028538 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:20.055598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1274/2561] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:20.063661 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100174c-2ce6-484b-a885-2fedb974478e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.064003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100174c-2ce6-484b-a885-2fedb974478e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.064336 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100174c-2ce6-484b-a885-2fedb974478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.073011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1288/2562] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:20.083172 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bfdea-8c56-4988-b43e-899028ef7bd7 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.084672 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-982bfdea-8c56-4988-b43e-899028ef7bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:20.085039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-5100174c-2ce6-484b-a885-2fedb974478e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:20.086213 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5100174c-2ce6-484b-a885-2fedb974478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:20.094395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1275/2563] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:20.098467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100174c-2ce6-484b-a885-2fedb974478e None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.106786 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:20.107629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100174c-2ce6-484b-a885-2fedb974478e None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.114262 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214bed6-584f-4a69-90b3-5aea81c30221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.114670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214bed6-584f-4a69-90b3-5aea81c30221 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.114949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214bed6-584f-4a69-90b3-5aea81c30221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.115207 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214bed6-584f-4a69-90b3-5aea81c30221 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.115892 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214bed6-584f-4a69-90b3-5aea81c30221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:20.116196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214bed6-584f-4a69-90b3-5aea81c30221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.118369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214bed6-584f-4a69-90b3-5aea81c30221 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.131126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1276/2564] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:27:20.135609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214bed6-584f-4a69-90b3-5aea81c30221 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.145478 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214bed6-584f-4a69-90b3-5aea81c30221 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.150273 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77cc8f-b276-4b43-be38-08b606421533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.150871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77cc8f-b276-4b43-be38-08b606421533 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.151150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77cc8f-b276-4b43-be38-08b606421533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.151427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77cc8f-b276-4b43-be38-08b606421533 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.151539 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bfdea-8c56-4988-b43e-899028ef7bd7 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.152082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77cc8f-b276-4b43-be38-08b606421533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.153982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77cc8f-b276-4b43-be38-08b606421533 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.155106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd85ca-ba9d-4d05-9ca0-70fae9a05142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.155722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd85ca-ba9d-4d05-9ca0-70fae9a05142 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.156018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd85ca-ba9d-4d05-9ca0-70fae9a05142 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.156293 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd85ca-ba9d-4d05-9ca0-70fae9a05142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.165603 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd85ca-ba9d-4d05-9ca0-70fae9a05142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.166975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd85ca-ba9d-4d05-9ca0-70fae9a05142 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.177316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1289/2565] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:20.184753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1277/2566] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:20 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:20.188923 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd85ca-ba9d-4d05-9ca0-70fae9a05142 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.198626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd85ca-ba9d-4d05-9ca0-70fae9a05142 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.260249 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eaf92c-146c-4ae4-92da-b9c84b5f878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.260860 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaf92c-146c-4ae4-92da-b9c84b5f878b admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.261135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaf92c-146c-4ae4-92da-b9c84b5f878b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.261404 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaf92c-146c-4ae4-92da-b9c84b5f878b admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.262029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eaf92c-146c-4ae4-92da-b9c84b5f878b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.263974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eaf92c-146c-4ae4-92da-b9c84b5f878b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.286543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1290/2567] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:20 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:20.290891 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77cc8f-b276-4b43-be38-08b606421533 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.301764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77cc8f-b276-4b43-be38-08b606421533 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.306562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6631ab-6624-4234-84b5-3022402f8d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.307108 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6631ab-6624-4234-84b5-3022402f8d7e admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.307388 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6631ab-6624-4234-84b5-3022402f8d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.307662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6631ab-6624-4234-84b5-3022402f8d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.308427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6631ab-6624-4234-84b5-3022402f8d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.310043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6631ab-6624-4234-84b5-3022402f8d7e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.320821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1278/2568] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:20.327653 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eaf92c-146c-4ae4-92da-b9c84b5f878b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.338043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eaf92c-146c-4ae4-92da-b9c84b5f878b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.343525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036823c-0184-4e70-a58c-cec73ea1355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.344171 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036823c-0184-4e70-a58c-cec73ea1355f admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.344448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036823c-0184-4e70-a58c-cec73ea1355f admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.344717 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036823c-0184-4e70-a58c-cec73ea1355f admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.345404 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036823c-0184-4e70-a58c-cec73ea1355f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.347111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036823c-0184-4e70-a58c-cec73ea1355f admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.357857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1291/2569] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:20.362206 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6631ab-6624-4234-84b5-3022402f8d7e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.372877 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6631ab-6624-4234-84b5-3022402f8d7e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.379122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14fce8-64db-415c-b553-2edb1d2107b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.379839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14fce8-64db-415c-b553-2edb1d2107b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.380122 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14fce8-64db-415c-b553-2edb1d2107b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.380395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14fce8-64db-415c-b553-2edb1d2107b1 admin admin] PATH_INFO: `/v3/projects/e617658652af42fbbe3d6e15d33b2d5b/users/fd26a4b55027438db3cf987ae608f24f/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.396938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14fce8-64db-415c-b553-2edb1d2107b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e617658652af42fbbe3d6e15d33b2d5b, user_id=fd26a4b55027438db3cf987ae608f24f, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.399853 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14fce8-64db-415c-b553-2edb1d2107b1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.415222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1279/2570] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:20 2022] PUT /identity/v3/projects/e617658652af42fbbe3d6e15d33b2d5b/users/fd26a4b55027438db3cf987ae608f24f/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:20.454695 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036823c-0184-4e70-a58c-cec73ea1355f admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.457111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-e036823c-0184-4e70-a58c-cec73ea1355f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:20.471316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036823c-0184-4e70-a58c-cec73ea1355f admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.487515 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cff63-728d-419d-a614-4ef82672ce9a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.487809 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cff63-728d-419d-a614-4ef82672ce9a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.488099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cff63-728d-419d-a614-4ef82672ce9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.517393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-6e5cff63-728d-419d-a614-4ef82672ce9a None None] MFA Rules not processed for user `fd26a4b55027438db3cf987ae608f24f`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:20.518774 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6e5cff63-728d-419d-a614-4ef82672ce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:20.531975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.532610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.532888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.533155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4 admin admin] PATH_INFO: `/v3/projects/18456ff42cb045caaeb26bc8f23e1b34` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.534515 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18456ff42cb045caaeb26bc8f23e1b34)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.536519 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.578592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:20.588694 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1280/2571] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:20.588899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18456ff42cb045caaeb26bc8f23e1b34', 'request_id': 'req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:20.596081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18456ff42cb045caaeb26bc8f23e1b34', 'request_id': 'req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:20.596387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cff63-728d-419d-a614-4ef82672ce9a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.597819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6e5cff63-728d-419d-a614-4ef82672ce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:20.602191 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18456ff42cb045caaeb26bc8f23e1b34', 'request_id': 'req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:20.613545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4 admin admin] The token cache is being invalidate because project 18456ff42cb045caaeb26bc8f23e1b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:20.613827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:20.614498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5ed5b5cf-6f72-498c-8aba-7c941361a3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:20.616191 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1292/2572] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:20 2022] DELETE /identity/v3/projects/18456ff42cb045caaeb26bc8f23e1b34 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:20.620930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed78eb-5485-41fe-84d5-4ac6eeb86132 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.621363 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed78eb-5485-41fe-84d5-4ac6eeb86132 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.621644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed78eb-5485-41fe-84d5-4ac6eeb86132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.644692 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-2aed78eb-5485-41fe-84d5-4ac6eeb86132 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:20.646034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2aed78eb-5485-41fe-84d5-4ac6eeb86132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:20.659525 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cff63-728d-419d-a614-4ef82672ce9a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.668559 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:20.718147 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1293/2573] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:20.727025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37989bb0-9873-4b29-b910-2e7a4c5be183 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.727389 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37989bb0-9873-4b29-b910-2e7a4c5be183 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.727539 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d0d55-958b-4e1d-8ca3-621ec33ea94b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.727845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37989bb0-9873-4b29-b910-2e7a4c5be183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.728245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0d55-958b-4e1d-8ca3-621ec33ea94b service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.728529 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0d55-958b-4e1d-8ca3-621ec33ea94b service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.728963 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0d55-958b-4e1d-8ca3-621ec33ea94b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.731063 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-db8d0d55-958b-4e1d-8ca3-621ec33ea94b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:20.749059 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-37989bb0-9873-4b29-b910-2e7a4c5be183 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:20.750522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-37989bb0-9873-4b29-b910-2e7a4c5be183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:20.762212 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1294/2574] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:20.766596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37989bb0-9873-4b29-b910-2e7a4c5be183 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.776068 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37989bb0-9873-4b29-b910-2e7a4c5be183 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.780994 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e2f97-c940-4efe-aaeb-6e6e3463f588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.781593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e2f97-c940-4efe-aaeb-6e6e3463f588 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.781872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e2f97-c940-4efe-aaeb-6e6e3463f588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.782143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e2f97-c940-4efe-aaeb-6e6e3463f588 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.782782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e2f97-c940-4efe-aaeb-6e6e3463f588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:20.783076 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e2f97-c940-4efe-aaeb-6e6e3463f588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.784805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e2f97-c940-4efe-aaeb-6e6e3463f588 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.800027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1295/2575] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:20.804710 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e2f97-c940-4efe-aaeb-6e6e3463f588 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.812375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d0d55-958b-4e1d-8ca3-621ec33ea94b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.813937 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d0d55-958b-4e1d-8ca3-621ec33ea94b service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.817215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e2f97-c940-4efe-aaeb-6e6e3463f588 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.822208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f945ec-dac5-4cfc-9563-336192fd745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.822919 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f945ec-dac5-4cfc-9563-336192fd745d admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.823254 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f945ec-dac5-4cfc-9563-336192fd745d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.823593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f945ec-dac5-4cfc-9563-336192fd745d admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.824459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f945ec-dac5-4cfc-9563-336192fd745d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.824914 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1281/2576] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:20.828753 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f945ec-dac5-4cfc-9563-336192fd745d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.874802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1296/2577] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:20 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:20.876395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d0d55-958b-4e1d-8ca3-621ec33ea94b service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.888418 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d0d55-958b-4e1d-8ca3-621ec33ea94b service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.949591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ff2ce-c3cd-4736-b449-804e8a1b8669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.950406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ff2ce-c3cd-4736-b449-804e8a1b8669 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.950796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ff2ce-c3cd-4736-b449-804e8a1b8669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.951174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ff2ce-c3cd-4736-b449-804e8a1b8669 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.951995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ff2ce-c3cd-4736-b449-804e8a1b8669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:20.954113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ff2ce-c3cd-4736-b449-804e8a1b8669 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:20.975942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1282/2578] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:20 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:20.981784 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f945ec-dac5-4cfc-9563-336192fd745d admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.994292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f945ec-dac5-4cfc-9563-336192fd745d admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.999444 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9e74d-7436-46db-b829-e5d057d52456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:21.000076 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e74d-7436-46db-b829-e5d057d52456 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:21.000355 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e74d-7436-46db-b829-e5d057d52456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:21.000625 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e74d-7436-46db-b829-e5d057d52456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:21.001321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9e74d-7436-46db-b829-e5d057d52456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:21.003636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9e74d-7436-46db-b829-e5d057d52456 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:21.014905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1297/2579] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:21.019010 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ff2ce-c3cd-4736-b449-804e8a1b8669 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:21.029764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ff2ce-c3cd-4736-b449-804e8a1b8669 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:21.035027 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6c890-8272-4ea4-9142-8ae1b46ba076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:21.035743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6c890-8272-4ea4-9142-8ae1b46ba076 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:21.036020 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6c890-8272-4ea4-9142-8ae1b46ba076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:21.036320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6c890-8272-4ea4-9142-8ae1b46ba076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:21.036974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6c890-8272-4ea4-9142-8ae1b46ba076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:21.038703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6c890-8272-4ea4-9142-8ae1b46ba076 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:21.050898 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1283/2580] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:21.054843 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9e74d-7436-46db-b829-e5d057d52456 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:21.065057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9e74d-7436-46db-b829-e5d057d52456 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:21.070032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9418e68-eaed-4fe5-979a-cf9b18997bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:21.070676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9418e68-eaed-4fe5-979a-cf9b18997bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:21.070951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9418e68-eaed-4fe5-979a-cf9b18997bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:21.071224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9418e68-eaed-4fe5-979a-cf9b18997bc9 admin admin] PATH_INFO: `/v3/projects/5f9fb02947754ab6bf16a1fffe74a513/users/0eb3c93f9960433db27dcad4038ae8ca/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:21.087318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9418e68-eaed-4fe5-979a-cf9b18997bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9fb02947754ab6bf16a1fffe74a513, user_id=0eb3c93f9960433db27dcad4038ae8ca, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:21.090142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9418e68-eaed-4fe5-979a-cf9b18997bc9 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:21.105401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1298/2581] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:21 2022] PUT /identity/v3/projects/5f9fb02947754ab6bf16a1fffe74a513/users/0eb3c93f9960433db27dcad4038ae8ca/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:21.118086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7dd4f-afa5-4fdf-bbbe-8fc38d660f24 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:21.118387 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7dd4f-afa5-4fdf-bbbe-8fc38d660f24 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:21.118668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7dd4f-afa5-4fdf-bbbe-8fc38d660f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:21.159505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d0c7dd4f-afa5-4fdf-bbbe-8fc38d660f24 None None] MFA Rules not processed for user `0eb3c93f9960433db27dcad4038ae8ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:21.165415 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d0c7dd4f-afa5-4fdf-bbbe-8fc38d660f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:21.194424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:21.227444 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1284/2582] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:21.238453 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9418e68-eaed-4fe5-979a-cf9b18997bc9 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:21.240262 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c9418e68-eaed-4fe5-979a-cf9b18997bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:21.293905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:21.324400 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9418e68-eaed-4fe5-979a-cf9b18997bc9 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:21.333155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda4989-fe38-469b-8cef-3054c8ee9f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:21.333692 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda4989-fe38-469b-8cef-3054c8ee9f27 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:21.333966 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda4989-fe38-469b-8cef-3054c8ee9f27 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:21.334233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda4989-fe38-469b-8cef-3054c8ee9f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:21.343389 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda4989-fe38-469b-8cef-3054c8ee9f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:21.345050 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda4989-fe38-469b-8cef-3054c8ee9f27 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:21.354276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1299/2583] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:24.057198 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7dd4f-afa5-4fdf-bbbe-8fc38d660f24 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:24.121768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7dd4f-afa5-4fdf-bbbe-8fc38d660f24 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:24.126945 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc6c24-cebf-45a1-9b96-6c9515d578fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:24.127686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc6c24-cebf-45a1-9b96-6c9515d578fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:24.127999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc6c24-cebf-45a1-9b96-6c9515d578fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:24.128271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc6c24-cebf-45a1-9b96-6c9515d578fe admin admin] PATH_INFO: `/v3/users/0eb3c93f9960433db27dcad4038ae8ca` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:24.129499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc6c24-cebf-45a1-9b96-6c9515d578fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb3c93f9960433db27dcad4038ae8ca)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:24.131426 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc6c24-cebf-45a1-9b96-6c9515d578fe admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:24.183349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c0cc6c24-cebf-45a1-9b96-6c9515d578fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb3c93f9960433db27dcad4038ae8ca'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.195786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c0cc6c24-cebf-45a1-9b96-6c9515d578fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb3c93f9960433db27dcad4038ae8ca'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.203745 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c0cc6c24-cebf-45a1-9b96-6c9515d578fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb3c93f9960433db27dcad4038ae8ca'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.212894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c0cc6c24-cebf-45a1-9b96-6c9515d578fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb3c93f9960433db27dcad4038ae8ca'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.213510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c0cc6c24-cebf-45a1-9b96-6c9515d578fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb3c93f9960433db27dcad4038ae8ca'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.219723 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1285/2584] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:24 2022] DELETE /identity/v3/users/0eb3c93f9960433db27dcad4038ae8ca => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:24.224175 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811aa6f2-8220-48a3-9032-71ee9d2bb045 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:24.224682 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811aa6f2-8220-48a3-9032-71ee9d2bb045 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:24.224799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811aa6f2-8220-48a3-9032-71ee9d2bb045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:24.243591 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-811aa6f2-8220-48a3-9032-71ee9d2bb045 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:24.244816 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-811aa6f2-8220-48a3-9032-71ee9d2bb045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:24.306702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1300/2585] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:24.316762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc6c24-cebf-45a1-9b96-6c9515d578fe admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:24.318521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c0cc6c24-cebf-45a1-9b96-6c9515d578fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:24.378958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc6c24-cebf-45a1-9b96-6c9515d578fe admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:24.382906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39e7ff-49d2-4791-bf35-a78cf93bae4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:24.383516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39e7ff-49d2-4791-bf35-a78cf93bae4b service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:24.383828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39e7ff-49d2-4791-bf35-a78cf93bae4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:24.384107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39e7ff-49d2-4791-bf35-a78cf93bae4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:24.391254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:24.393871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39e7ff-49d2-4791-bf35-a78cf93bae4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:24.395792 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39e7ff-49d2-4791-bf35-a78cf93bae4b service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:24.408348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1286/2586] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:24.702938 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811aa6f2-8220-48a3-9032-71ee9d2bb045 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:24.704535 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-811aa6f2-8220-48a3-9032-71ee9d2bb045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:24.729097 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811aa6f2-8220-48a3-9032-71ee9d2bb045 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:24.737988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239b6af-96a9-49aa-930f-5a26a27721b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:24.738629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239b6af-96a9-49aa-930f-5a26a27721b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:24.739034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239b6af-96a9-49aa-930f-5a26a27721b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:24.739309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239b6af-96a9-49aa-930f-5a26a27721b6 admin admin] PATH_INFO: `/v3/projects/5f9fb02947754ab6bf16a1fffe74a513` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:24.740592 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239b6af-96a9-49aa-930f-5a26a27721b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f9fb02947754ab6bf16a1fffe74a513)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:24.742489 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239b6af-96a9-49aa-930f-5a26a27721b6 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:24.799508 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b239b6af-96a9-49aa-930f-5a26a27721b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9fb02947754ab6bf16a1fffe74a513', 'request_id': 'req-b239b6af-96a9-49aa-930f-5a26a27721b6'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.811218 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b239b6af-96a9-49aa-930f-5a26a27721b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9fb02947754ab6bf16a1fffe74a513', 'request_id': 'req-b239b6af-96a9-49aa-930f-5a26a27721b6'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.817530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b239b6af-96a9-49aa-930f-5a26a27721b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9fb02947754ab6bf16a1fffe74a513', 'request_id': 'req-b239b6af-96a9-49aa-930f-5a26a27721b6'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.830612 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b239b6af-96a9-49aa-930f-5a26a27721b6 admin admin] The token cache is being invalidate because project 5f9fb02947754ab6bf16a1fffe74a513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:24.830901 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b239b6af-96a9-49aa-930f-5a26a27721b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.831547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b239b6af-96a9-49aa-930f-5a26a27721b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:24.833382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1301/2587] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:24 2022] DELETE /identity/v3/projects/5f9fb02947754ab6bf16a1fffe74a513 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:24.841673 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f25ec2-f04d-4d26-99f2-47ec9de4a8fd None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:24.841967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f25ec2-f04d-4d26-99f2-47ec9de4a8fd None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:24.842245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f25ec2-f04d-4d26-99f2-47ec9de4a8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:24.865259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-63f25ec2-f04d-4d26-99f2-47ec9de4a8fd None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:24.866588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-63f25ec2-f04d-4d26-99f2-47ec9de4a8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:24.930339 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1287/2588] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:24.938459 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e4898-58a5-4b91-9dac-f9148d2fe928 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:24.938751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e4898-58a5-4b91-9dac-f9148d2fe928 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:24.939028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e4898-58a5-4b91-9dac-f9148d2fe928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:24.960300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-484e4898-58a5-4b91-9dac-f9148d2fe928 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:24.961653 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-484e4898-58a5-4b91-9dac-f9148d2fe928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:24.970389 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1302/2589] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:24.975160 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f25ec2-f04d-4d26-99f2-47ec9de4a8fd None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:24.985453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f25ec2-f04d-4d26-99f2-47ec9de4a8fd None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:24.991026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5e48f-0c77-4137-80d4-5970094beeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:24.991623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5e48f-0c77-4137-80d4-5970094beeea admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:24.992004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5e48f-0c77-4137-80d4-5970094beeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:24.992345 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5e48f-0c77-4137-80d4-5970094beeea admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:24.993049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5e48f-0c77-4137-80d4-5970094beeea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:24.993402 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5e48f-0c77-4137-80d4-5970094beeea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:24.995206 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5e48f-0c77-4137-80d4-5970094beeea admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.007538 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1288/2590] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:25.012370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e4898-58a5-4b91-9dac-f9148d2fe928 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.021924 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e4898-58a5-4b91-9dac-f9148d2fe928 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.027309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f6ae3-0461-4892-b7ae-bc3f221f2c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.027933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f6ae3-0461-4892-b7ae-bc3f221f2c8c admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.028208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f6ae3-0461-4892-b7ae-bc3f221f2c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.028463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f6ae3-0461-4892-b7ae-bc3f221f2c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.029089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f6ae3-0461-4892-b7ae-bc3f221f2c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.030965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f6ae3-0461-4892-b7ae-bc3f221f2c8c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.060898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1303/2591] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:25 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:25.065154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5e48f-0c77-4137-80d4-5970094beeea admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.077250 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5e48f-0c77-4137-80d4-5970094beeea admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.136563 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01a5e5-75dc-4238-9930-6ee0c1e67d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.137176 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01a5e5-75dc-4238-9930-6ee0c1e67d9a admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.137453 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01a5e5-75dc-4238-9930-6ee0c1e67d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.137722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01a5e5-75dc-4238-9930-6ee0c1e67d9a admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.138354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01a5e5-75dc-4238-9930-6ee0c1e67d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.140309 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01a5e5-75dc-4238-9930-6ee0c1e67d9a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.163534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1289/2592] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:25 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:25.167844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f6ae3-0461-4892-b7ae-bc3f221f2c8c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.183060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f6ae3-0461-4892-b7ae-bc3f221f2c8c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.190895 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9df8a-5f6b-47b3-8123-7037cca06e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.191497 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9df8a-5f6b-47b3-8123-7037cca06e7b admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.191796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9df8a-5f6b-47b3-8123-7037cca06e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.192058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9df8a-5f6b-47b3-8123-7037cca06e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.192713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9df8a-5f6b-47b3-8123-7037cca06e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.194280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9df8a-5f6b-47b3-8123-7037cca06e7b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.205055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1304/2593] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:25.210215 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01a5e5-75dc-4238-9930-6ee0c1e67d9a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.226487 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01a5e5-75dc-4238-9930-6ee0c1e67d9a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.234644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0f088-b117-47af-acae-7e79451d6ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.235593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0f088-b117-47af-acae-7e79451d6ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.236092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0f088-b117-47af-acae-7e79451d6ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.236555 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0f088-b117-47af-acae-7e79451d6ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.237361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0f088-b117-47af-acae-7e79451d6ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.238958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0f088-b117-47af-acae-7e79451d6ec8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.249409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1290/2594] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:25.253732 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9df8a-5f6b-47b3-8123-7037cca06e7b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.263792 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9df8a-5f6b-47b3-8123-7037cca06e7b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.268914 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb74ec7-76a7-47d2-bdd0-4714054d1be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.269554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb74ec7-76a7-47d2-bdd0-4714054d1be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.269828 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb74ec7-76a7-47d2-bdd0-4714054d1be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.270100 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb74ec7-76a7-47d2-bdd0-4714054d1be0 admin admin] PATH_INFO: `/v3/projects/ddb808245d1a481a873b470c46ff1cf5/users/fea1341228e64fc1aec77c8381ffc2d5/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.285167 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb74ec7-76a7-47d2-bdd0-4714054d1be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb808245d1a481a873b470c46ff1cf5, user_id=fea1341228e64fc1aec77c8381ffc2d5, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.287866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb74ec7-76a7-47d2-bdd0-4714054d1be0 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.298773 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:25.304955 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1305/2595] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:25 2022] PUT /identity/v3/projects/ddb808245d1a481a873b470c46ff1cf5/users/fea1341228e64fc1aec77c8381ffc2d5/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:25.316646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763157c6-8a56-446d-ac6a-0cba4f48719f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.316922 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763157c6-8a56-446d-ac6a-0cba4f48719f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.317204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763157c6-8a56-446d-ac6a-0cba4f48719f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.346328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-763157c6-8a56-446d-ac6a-0cba4f48719f None None] MFA Rules not processed for user `fea1341228e64fc1aec77c8381ffc2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:25.347622 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-763157c6-8a56-446d-ac6a-0cba4f48719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:25.398571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:25.417285 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1291/2596] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:25 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:25.422545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb74ec7-76a7-47d2-bdd0-4714054d1be0 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.485138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb74ec7-76a7-47d2-bdd0-4714054d1be0 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.490886 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b02d2-616e-4528-80d4-455cc7968eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.491485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b02d2-616e-4528-80d4-455cc7968eef admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.491791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b02d2-616e-4528-80d4-455cc7968eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.492034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b02d2-616e-4528-80d4-455cc7968eef admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.492904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b02d2-616e-4528-80d4-455cc7968eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.494576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b02d2-616e-4528-80d4-455cc7968eef admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.521310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1306/2597] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:25 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:25.525468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763157c6-8a56-446d-ac6a-0cba4f48719f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.537087 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763157c6-8a56-446d-ac6a-0cba4f48719f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.595251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4887d6-8445-4a2c-bcba-b4bae19a65f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.595799 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4887d6-8445-4a2c-bcba-b4bae19a65f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.596070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4887d6-8445-4a2c-bcba-b4bae19a65f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.596556 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4887d6-8445-4a2c-bcba-b4bae19a65f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.597435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4887d6-8445-4a2c-bcba-b4bae19a65f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.599228 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4887d6-8445-4a2c-bcba-b4bae19a65f6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.622464 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1292/2598] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:25 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:25.627339 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b02d2-616e-4528-80d4-455cc7968eef admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.644056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b02d2-616e-4528-80d4-455cc7968eef admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.650072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135426eb-4bf4-4891-9819-5d7593969db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.650846 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135426eb-4bf4-4891-9819-5d7593969db0 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.651244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135426eb-4bf4-4891-9819-5d7593969db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.651519 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135426eb-4bf4-4891-9819-5d7593969db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.652211 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135426eb-4bf4-4891-9819-5d7593969db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.653862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135426eb-4bf4-4891-9819-5d7593969db0 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.664537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1307/2599] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:25.668807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4887d6-8445-4a2c-bcba-b4bae19a65f6 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.679197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4887d6-8445-4a2c-bcba-b4bae19a65f6 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.684319 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc53d0d-b762-4afe-bd37-1af4b08915c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.684977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc53d0d-b762-4afe-bd37-1af4b08915c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.685257 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc53d0d-b762-4afe-bd37-1af4b08915c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.685528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc53d0d-b762-4afe-bd37-1af4b08915c3 admin admin] PATH_INFO: `/v3/projects/3a3efa394c1145d1b8be08f09b9f73a9/users/2aa3838804204fc89fcdf7cf0c05459b/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.700567 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc53d0d-b762-4afe-bd37-1af4b08915c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3efa394c1145d1b8be08f09b9f73a9, user_id=2aa3838804204fc89fcdf7cf0c05459b, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.703220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc53d0d-b762-4afe-bd37-1af4b08915c3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.718353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1293/2600] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:25 2022] PUT /identity/v3/projects/3a3efa394c1145d1b8be08f09b9f73a9/users/2aa3838804204fc89fcdf7cf0c05459b/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:25.722499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135426eb-4bf4-4891-9819-5d7593969db0 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.732543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135426eb-4bf4-4891-9819-5d7593969db0 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.800685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b0ce9-e828-4d58-b9ba-32df98e633f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.801281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b0ce9-e828-4d58-b9ba-32df98e633f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.801645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b0ce9-e828-4d58-b9ba-32df98e633f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.801903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b0ce9-e828-4d58-b9ba-32df98e633f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.802564 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b0ce9-e828-4d58-b9ba-32df98e633f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.804447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b0ce9-e828-4d58-b9ba-32df98e633f5 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.814958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1308/2601] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:25.819385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc53d0d-b762-4afe-bd37-1af4b08915c3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.829998 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc53d0d-b762-4afe-bd37-1af4b08915c3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:25.835027 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0aea3-e92d-45cb-ab8b-b870fd1e7da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:25.835730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0aea3-e92d-45cb-ab8b-b870fd1e7da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.836027 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0aea3-e92d-45cb-ab8b-b870fd1e7da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.836291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0aea3-e92d-45cb-ab8b-b870fd1e7da0 admin admin] PATH_INFO: `/v3/projects/3a3efa394c1145d1b8be08f09b9f73a9/users/2aa3838804204fc89fcdf7cf0c05459b/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.838249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0aea3-e92d-45cb-ab8b-b870fd1e7da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3efa394c1145d1b8be08f09b9f73a9, user_id=2aa3838804204fc89fcdf7cf0c05459b, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:25.841036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0aea3-e92d-45cb-ab8b-b870fd1e7da0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:25.854564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1294/2602] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:25 2022] PUT /identity/v3/projects/3a3efa394c1145d1b8be08f09b9f73a9/users/2aa3838804204fc89fcdf7cf0c05459b/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:25.864972 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06812973-8295-4013-9bc9-c614dd7c35f6 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:25.865259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06812973-8295-4013-9bc9-c614dd7c35f6 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:25.865525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06812973-8295-4013-9bc9-c614dd7c35f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:25.898141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-06812973-8295-4013-9bc9-c614dd7c35f6 None None] MFA Rules not processed for user `2aa3838804204fc89fcdf7cf0c05459b`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:25.900762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-06812973-8295-4013-9bc9-c614dd7c35f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:25.943179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0aea3-e92d-45cb-ab8b-b870fd1e7da0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:25.945204 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b6c0aea3-e92d-45cb-ab8b-b870fd1e7da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:25.985031 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:26.001612 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1309/2603] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:25 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:26.012626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06812973-8295-4013-9bc9-c614dd7c35f6 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:26.013984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-06812973-8295-4013-9bc9-c614dd7c35f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:26.024093 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0aea3-e92d-45cb-ab8b-b870fd1e7da0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:26.029542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fb59d-4cd7-4fa3-aa33-639d7896d4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:26.030269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb59d-4cd7-4fa3-aa33-639d7896d4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.030619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb59d-4cd7-4fa3-aa33-639d7896d4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.030961 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb59d-4cd7-4fa3-aa33-639d7896d4d1 admin admin] PATH_INFO: `/v3/users/84c52ad83f8745f59cfe829928037dba` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.032357 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fb59d-4cd7-4fa3-aa33-639d7896d4d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c52ad83f8745f59cfe829928037dba)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:26.034627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fb59d-4cd7-4fa3-aa33-639d7896d4d1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:26.075602 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06812973-8295-4013-9bc9-c614dd7c35f6 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:26.079366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf504f-e441-4c01-8bcb-c26b9774184f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:26.080015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf504f-e441-4c01-8bcb-c26b9774184f service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.080441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf504f-e441-4c01-8bcb-c26b9774184f service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.080887 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf504f-e441-4c01-8bcb-c26b9774184f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.088790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:26.090932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6b2fb59d-4cd7-4fa3-aa33-639d7896d4d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c52ad83f8745f59cfe829928037dba'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.094711 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf504f-e441-4c01-8bcb-c26b9774184f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:26.099989 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf504f-e441-4c01-8bcb-c26b9774184f service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:26.110251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1310/2604] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:26 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:26.114230 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6b2fb59d-4cd7-4fa3-aa33-639d7896d4d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c52ad83f8745f59cfe829928037dba'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.123485 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6b2fb59d-4cd7-4fa3-aa33-639d7896d4d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c52ad83f8745f59cfe829928037dba'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.132941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6b2fb59d-4cd7-4fa3-aa33-639d7896d4d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c52ad83f8745f59cfe829928037dba'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.133671 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6b2fb59d-4cd7-4fa3-aa33-639d7896d4d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c52ad83f8745f59cfe829928037dba'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.142378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1295/2605] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:25 2022] DELETE /identity/v3/users/84c52ad83f8745f59cfe829928037dba => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:26.147607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ca52-576d-4a01-98a0-95a2f7be7ce7 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.147951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ca52-576d-4a01-98a0-95a2f7be7ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.148224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ca52-576d-4a01-98a0-95a2f7be7ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.183381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-c0a3ca52-576d-4a01-98a0-95a2f7be7ce7 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:26.184699 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c0a3ca52-576d-4a01-98a0-95a2f7be7ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:26.258296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1311/2606] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:26.268003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fb59d-4cd7-4fa3-aa33-639d7896d4d1 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:26.269474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6b2fb59d-4cd7-4fa3-aa33-639d7896d4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:26.309358 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3ca52-576d-4a01-98a0-95a2f7be7ce7 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:26.310759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c0a3ca52-576d-4a01-98a0-95a2f7be7ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:26.322896 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3ca52-576d-4a01-98a0-95a2f7be7ce7 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:26.332334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da48205-8378-4680-a80c-9b2b95a5b914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:26.333000 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da48205-8378-4680-a80c-9b2b95a5b914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.333284 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da48205-8378-4680-a80c-9b2b95a5b914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.333563 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da48205-8378-4680-a80c-9b2b95a5b914 admin admin] PATH_INFO: `/v3/users/fea1341228e64fc1aec77c8381ffc2d5` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.334780 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da48205-8378-4680-a80c-9b2b95a5b914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea1341228e64fc1aec77c8381ffc2d5)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:26.335771 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fb59d-4cd7-4fa3-aa33-639d7896d4d1 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:26.336798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da48205-8378-4680-a80c-9b2b95a5b914 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:26.339782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bc15c-6026-41de-8820-7a2f35f2049d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:26.340299 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bc15c-6026-41de-8820-7a2f35f2049d service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.340582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bc15c-6026-41de-8820-7a2f35f2049d service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.340965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bc15c-6026-41de-8820-7a2f35f2049d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.351284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bc15c-6026-41de-8820-7a2f35f2049d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:26.352941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bc15c-6026-41de-8820-7a2f35f2049d service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:26.363265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1296/2607] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:26.392071 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-7da48205-8378-4680-a80c-9b2b95a5b914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea1341228e64fc1aec77c8381ffc2d5'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.407152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-7da48205-8378-4680-a80c-9b2b95a5b914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea1341228e64fc1aec77c8381ffc2d5'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.415640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-7da48205-8378-4680-a80c-9b2b95a5b914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea1341228e64fc1aec77c8381ffc2d5'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.426521 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-7da48205-8378-4680-a80c-9b2b95a5b914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea1341228e64fc1aec77c8381ffc2d5'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.427280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-7da48205-8378-4680-a80c-9b2b95a5b914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea1341228e64fc1aec77c8381ffc2d5'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.434189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1312/2608] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:26 2022] DELETE /identity/v3/users/fea1341228e64fc1aec77c8381ffc2d5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:26.438848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292a66f-12e7-4048-ac87-5c18ee0d682f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.439576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292a66f-12e7-4048-ac87-5c18ee0d682f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.440156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292a66f-12e7-4048-ac87-5c18ee0d682f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.464762 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c292a66f-12e7-4048-ac87-5c18ee0d682f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:26.466193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c292a66f-12e7-4048-ac87-5c18ee0d682f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:26.536025 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1297/2609] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:26.549289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da48205-8378-4680-a80c-9b2b95a5b914 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:26.550705 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7da48205-8378-4680-a80c-9b2b95a5b914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:26.564129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:26.622311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da48205-8378-4680-a80c-9b2b95a5b914 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:26.631197 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619dbb4-17aa-48a3-a257-a20164ea4ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:26.632234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619dbb4-17aa-48a3-a257-a20164ea4ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.632372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619dbb4-17aa-48a3-a257-a20164ea4ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.633038 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619dbb4-17aa-48a3-a257-a20164ea4ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.643538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619dbb4-17aa-48a3-a257-a20164ea4ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:26.645027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619dbb4-17aa-48a3-a257-a20164ea4ff0 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:26.656337 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1313/2610] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:26.683592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292a66f-12e7-4048-ac87-5c18ee0d682f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:26.685349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c292a66f-12e7-4048-ac87-5c18ee0d682f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:26.700756 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292a66f-12e7-4048-ac87-5c18ee0d682f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:26.710281 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:26.711175 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.711460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.711748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] PATH_INFO: `/v3/projects/ebffc71e295f4556a1a10ea25a0aa7e5` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.713173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebffc71e295f4556a1a10ea25a0aa7e5)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:26.717234 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:26.903310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebffc71e295f4556a1a10ea25a0aa7e5', 'request_id': 'req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.913062 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebffc71e295f4556a1a10ea25a0aa7e5', 'request_id': 'req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.918212 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:26.921312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebffc71e295f4556a1a10ea25a0aa7e5', 'request_id': 'req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.937988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] The token cache is being invalidate because project ebffc71e295f4556a1a10ea25a0aa7e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:26.938279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.939074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:26.940841 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1298/2611] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:26 2022] DELETE /identity/v3/projects/ebffc71e295f4556a1a10ea25a0aa7e5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:26.946089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efdbe8-0071-4aa1-bafd-de7d48b92ec6 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:26.946376 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efdbe8-0071-4aa1-bafd-de7d48b92ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:26.946651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efdbe8-0071-4aa1-bafd-de7d48b92ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:26.968368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-c3efdbe8-0071-4aa1-bafd-de7d48b92ec6 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:26.968549 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:26.969577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c3efdbe8-0071-4aa1-bafd-de7d48b92ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:26.970004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:27.034185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1314/2612] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:27.041980 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee317-abc8-4c38-b1a3-7f8f8da3ce4f None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.042263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee317-abc8-4c38-b1a3-7f8f8da3ce4f None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.042536 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee317-abc8-4c38-b1a3-7f8f8da3ce4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.042736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c565cb-50a4-44ce-b7f9-0ed197eec7e4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.047802 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.048427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.048705 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.049115 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] PATH_INFO: `/v3/projects/ddb808245d1a481a873b470c46ff1cf5` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.050503 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb808245d1a481a873b470c46ff1cf5)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.053482 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.065051 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-c70ee317-abc8-4c38-b1a3-7f8f8da3ce4f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:27.066261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c70ee317-abc8-4c38-b1a3-7f8f8da3ce4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:27.075119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1315/2613] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:27.079433 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ee317-abc8-4c38-b1a3-7f8f8da3ce4f None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.089747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ee317-abc8-4c38-b1a3-7f8f8da3ce4f None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.102260 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb808245d1a481a873b470c46ff1cf5', 'request_id': 'req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.110709 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb808245d1a481a873b470c46ff1cf5', 'request_id': 'req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.116880 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb808245d1a481a873b470c46ff1cf5', 'request_id': 'req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.128669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] The token cache is being invalidate because project ddb808245d1a481a873b470c46ff1cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:27.128955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.129619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.131190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1299/2614] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:26 2022] DELETE /identity/v3/projects/ddb808245d1a481a873b470c46ff1cf5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:27.134948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.136268 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:27.151665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cdda7-f57f-45ca-a51b-df277700b41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.152437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cdda7-f57f-45ca-a51b-df277700b41a admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.152714 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cdda7-f57f-45ca-a51b-df277700b41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.152984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cdda7-f57f-45ca-a51b-df277700b41a admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.153767 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491cdda7-f57f-45ca-a51b-df277700b41a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:27.154176 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491cdda7-f57f-45ca-a51b-df277700b41a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.156077 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491cdda7-f57f-45ca-a51b-df277700b41a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.168088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1316/2615] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:27.172659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cdda7-f57f-45ca-a51b-df277700b41a admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.174374 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-491cdda7-f57f-45ca-a51b-df277700b41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:27.189113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cdda7-f57f-45ca-a51b-df277700b41a admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.194018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff110862-22f8-44e1-a447-29961f2c9e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.194622 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff110862-22f8-44e1-a447-29961f2c9e50 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.194909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff110862-22f8-44e1-a447-29961f2c9e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.195289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff110862-22f8-44e1-a447-29961f2c9e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.195956 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff110862-22f8-44e1-a447-29961f2c9e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.198023 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff110862-22f8-44e1-a447-29961f2c9e50 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.213176 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3dbcf3-3c1b-458b-8da7-64f72e8cb68d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.220607 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f393f-ba74-4905-8ada-aed3f9548f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.221845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f393f-ba74-4905-8ada-aed3f9548f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.222346 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f393f-ba74-4905-8ada-aed3f9548f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.222872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f393f-ba74-4905-8ada-aed3f9548f13 admin admin] PATH_INFO: `/v3/users/2aa3838804204fc89fcdf7cf0c05459b` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.224838 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f393f-ba74-4905-8ada-aed3f9548f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa3838804204fc89fcdf7cf0c05459b)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.228547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f393f-ba74-4905-8ada-aed3f9548f13 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.228840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1317/2616] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:27 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:27.233199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff110862-22f8-44e1-a447-29961f2c9e50 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.252092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:27.252608 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:27.280672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-393f393f-ba74-4905-8ada-aed3f9548f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa3838804204fc89fcdf7cf0c05459b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.292943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-393f393f-ba74-4905-8ada-aed3f9548f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa3838804204fc89fcdf7cf0c05459b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.297554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff110862-22f8-44e1-a447-29961f2c9e50 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.300948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-393f393f-ba74-4905-8ada-aed3f9548f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa3838804204fc89fcdf7cf0c05459b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.302364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40402ff-9870-4eae-b5c1-5a3711181ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.303008 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40402ff-9870-4eae-b5c1-5a3711181ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.303291 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40402ff-9870-4eae-b5c1-5a3711181ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.303573 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40402ff-9870-4eae-b5c1-5a3711181ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.304271 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40402ff-9870-4eae-b5c1-5a3711181ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.306331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40402ff-9870-4eae-b5c1-5a3711181ad5 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.309522 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-393f393f-ba74-4905-8ada-aed3f9548f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa3838804204fc89fcdf7cf0c05459b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.310259 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-393f393f-ba74-4905-8ada-aed3f9548f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa3838804204fc89fcdf7cf0c05459b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.316656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1300/2617] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:27 2022] DELETE /identity/v3/users/2aa3838804204fc89fcdf7cf0c05459b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:27.331521 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1318/2618] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:27 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:27.333059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f393f-ba74-4905-8ada-aed3f9548f13 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.334528 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-393f393f-ba74-4905-8ada-aed3f9548f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:27.402164 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f393f-ba74-4905-8ada-aed3f9548f13 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.406838 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2a37d-5989-450e-9816-66bfda65e3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.407442 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2a37d-5989-450e-9816-66bfda65e3fc admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.407774 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2a37d-5989-450e-9816-66bfda65e3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.408064 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2a37d-5989-450e-9816-66bfda65e3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.408761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2a37d-5989-450e-9816-66bfda65e3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.410348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2a37d-5989-450e-9816-66bfda65e3fc admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.421192 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1301/2619] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:27.425617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40402ff-9870-4eae-b5c1-5a3711181ad5 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.435819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40402ff-9870-4eae-b5c1-5a3711181ad5 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.440582 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f24e2-f9f5-4ae4-afc6-7fc0c92ae23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.441210 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f24e2-f9f5-4ae4-afc6-7fc0c92ae23a admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.441486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f24e2-f9f5-4ae4-afc6-7fc0c92ae23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.441752 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f24e2-f9f5-4ae4-afc6-7fc0c92ae23a admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.442422 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f24e2-f9f5-4ae4-afc6-7fc0c92ae23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.444060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f24e2-f9f5-4ae4-afc6-7fc0c92ae23a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.457764 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1319/2620] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:27.459046 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2a37d-5989-450e-9816-66bfda65e3fc admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.469944 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2a37d-5989-450e-9816-66bfda65e3fc admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.475303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587a758-82b8-4078-8864-031a62e9d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.476226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587a758-82b8-4078-8864-031a62e9d58e admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.476548 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587a758-82b8-4078-8864-031a62e9d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.476769 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587a758-82b8-4078-8864-031a62e9d58e admin admin] PATH_INFO: `/v3/projects/796275c75486403ca60f400eb3e86a4a/users/270df34908ae409983d230c2ec3ccfa4/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.492663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587a758-82b8-4078-8864-031a62e9d58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=796275c75486403ca60f400eb3e86a4a, user_id=270df34908ae409983d230c2ec3ccfa4, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.495280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587a758-82b8-4078-8864-031a62e9d58e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.509352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1302/2621] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:27 2022] PUT /identity/v3/projects/796275c75486403ca60f400eb3e86a4a/users/270df34908ae409983d230c2ec3ccfa4/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:27.520999 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3ab9a-81c5-4a28-9f88-c21de88775ca None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.521456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3ab9a-81c5-4a28-9f88-c21de88775ca None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.521756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3ab9a-81c5-4a28-9f88-c21de88775ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.554827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5bb3ab9a-81c5-4a28-9f88-c21de88775ca None None] MFA Rules not processed for user `270df34908ae409983d230c2ec3ccfa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:27.556093 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5bb3ab9a-81c5-4a28-9f88-c21de88775ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:27.605417 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587a758-82b8-4078-8864-031a62e9d58e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.607600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7587a758-82b8-4078-8864-031a62e9d58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:27.637704 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1320/2622] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:27.638502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3ab9a-81c5-4a28-9f88-c21de88775ca None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.677595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587a758-82b8-4078-8864-031a62e9d58e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.682028 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f484c-a47a-494e-b4b1-430d0058906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.682646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f484c-a47a-494e-b4b1-430d0058906e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.682920 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f484c-a47a-494e-b4b1-430d0058906e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.683189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f484c-a47a-494e-b4b1-430d0058906e admin admin] PATH_INFO: `/v3/projects/3a3efa394c1145d1b8be08f09b9f73a9` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.684406 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f484c-a47a-494e-b4b1-430d0058906e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3efa394c1145d1b8be08f09b9f73a9)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.686684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f484c-a47a-494e-b4b1-430d0058906e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.698299 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:27.701687 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3ab9a-81c5-4a28-9f88-c21de88775ca None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.706551 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7b40c-6085-4d41-b0d9-7253768826c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.707162 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7b40c-6085-4d41-b0d9-7253768826c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.707439 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7b40c-6085-4d41-b0d9-7253768826c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.707728 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7b40c-6085-4d41-b0d9-7253768826c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.708377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7b40c-6085-4d41-b0d9-7253768826c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.710281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7b40c-6085-4d41-b0d9-7253768826c7 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.735593 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-159f484c-a47a-494e-b4b1-430d0058906e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3efa394c1145d1b8be08f09b9f73a9', 'request_id': 'req-159f484c-a47a-494e-b4b1-430d0058906e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.740591 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1321/2623] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:27 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:27.741643 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7b40c-6085-4d41-b0d9-7253768826c7 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.746043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-159f484c-a47a-494e-b4b1-430d0058906e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3efa394c1145d1b8be08f09b9f73a9', 'request_id': 'req-159f484c-a47a-494e-b4b1-430d0058906e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.751643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-159f484c-a47a-494e-b4b1-430d0058906e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3efa394c1145d1b8be08f09b9f73a9', 'request_id': 'req-159f484c-a47a-494e-b4b1-430d0058906e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.756043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:27.763604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-159f484c-a47a-494e-b4b1-430d0058906e admin admin] The token cache is being invalidate because project 3a3efa394c1145d1b8be08f09b9f73a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:27.764028 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-159f484c-a47a-494e-b4b1-430d0058906e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.765017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-159f484c-a47a-494e-b4b1-430d0058906e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:27.766205 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1303/2624] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:27 2022] DELETE /identity/v3/projects/3a3efa394c1145d1b8be08f09b9f73a9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:27.771171 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e6b53-9d3f-490e-aa97-6dfbddea1f31 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.771454 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e6b53-9d3f-490e-aa97-6dfbddea1f31 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.771749 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e6b53-9d3f-490e-aa97-6dfbddea1f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.792604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-bf4e6b53-9d3f-490e-aa97-6dfbddea1f31 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:27.793818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bf4e6b53-9d3f-490e-aa97-6dfbddea1f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:27.816455 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7b40c-6085-4d41-b0d9-7253768826c7 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.821233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3afa9-b7a0-4c1a-8c37-d94517201812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.821968 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3afa9-b7a0-4c1a-8c37-d94517201812 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.822261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3afa9-b7a0-4c1a-8c37-d94517201812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.822646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3afa9-b7a0-4c1a-8c37-d94517201812 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.823284 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3afa9-b7a0-4c1a-8c37-d94517201812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.825328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3afa9-b7a0-4c1a-8c37-d94517201812 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.849398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1322/2625] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:27 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:27.855835 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3afa9-b7a0-4c1a-8c37-d94517201812 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.859987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-26b3afa9-b7a0-4c1a-8c37-d94517201812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:27.865241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1304/2626] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:27.872615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40212908-5afd-444b-a410-7aea75359922 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.872974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40212908-5afd-444b-a410-7aea75359922 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.873317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40212908-5afd-444b-a410-7aea75359922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.877494 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3afa9-b7a0-4c1a-8c37-d94517201812 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.883649 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5580c-b317-4369-9e93-86072152ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.884372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5580c-b317-4369-9e93-86072152ed95 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.884658 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5580c-b317-4369-9e93-86072152ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.884973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5580c-b317-4369-9e93-86072152ed95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.887934 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5580c-b317-4369-9e93-86072152ed95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.889967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5580c-b317-4369-9e93-86072152ed95 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.896542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-40212908-5afd-444b-a410-7aea75359922 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:27.897785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-40212908-5afd-444b-a410-7aea75359922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:27.904538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1323/2627] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:27.905893 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5580c-b317-4369-9e93-86072152ed95 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.906185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1305/2628] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:27.910164 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40212908-5afd-444b-a410-7aea75359922 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.916899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5580c-b317-4369-9e93-86072152ed95 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.919070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40212908-5afd-444b-a410-7aea75359922 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.921993 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd61f48-f79b-4ee8-83c9-2c5ccb0f3ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.922668 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd61f48-f79b-4ee8-83c9-2c5ccb0f3ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.922945 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd61f48-f79b-4ee8-83c9-2c5ccb0f3ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.923213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd61f48-f79b-4ee8-83c9-2c5ccb0f3ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.923927 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116ab6d-608b-4aa9-aa24-cd2ae7211976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.924087 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd61f48-f79b-4ee8-83c9-2c5ccb0f3ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.924565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116ab6d-608b-4aa9-aa24-cd2ae7211976 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.924844 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116ab6d-608b-4aa9-aa24-cd2ae7211976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.925118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116ab6d-608b-4aa9-aa24-cd2ae7211976 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.925542 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd61f48-f79b-4ee8-83c9-2c5ccb0f3ce6 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.925758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116ab6d-608b-4aa9-aa24-cd2ae7211976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:27.926063 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116ab6d-608b-4aa9-aa24-cd2ae7211976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.927722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116ab6d-608b-4aa9-aa24-cd2ae7211976 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.938252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1324/2629] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:27.940565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd61f48-f79b-4ee8-83c9-2c5ccb0f3ce6 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.945627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1306/2630] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:27:27.946621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116ab6d-608b-4aa9-aa24-cd2ae7211976 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:27.950741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd61f48-f79b-4ee8-83c9-2c5ccb0f3ce6 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.955610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5ff11-a700-4cfc-bff2-fe245401278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.956270 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5ff11-a700-4cfc-bff2-fe245401278c admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.956545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5ff11-a700-4cfc-bff2-fe245401278c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.956818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5ff11-a700-4cfc-bff2-fe245401278c admin admin] PATH_INFO: `/v3/projects/478274c7970c44fcb5e673bbf1534a09/users/e31b7bed13d34f9d8ce5f546c60dd1f4/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.956924 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116ab6d-608b-4aa9-aa24-cd2ae7211976 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:27.962476 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaeb07a-c8bb-4cd5-b2ab-354efe3fab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:27.963189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeb07a-c8bb-4cd5-b2ab-354efe3fab7b admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:27.963578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeb07a-c8bb-4cd5-b2ab-354efe3fab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:27.963971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeb07a-c8bb-4cd5-b2ab-354efe3fab7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:27.964704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaeb07a-c8bb-4cd5-b2ab-354efe3fab7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.967197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaeb07a-c8bb-4cd5-b2ab-354efe3fab7b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.971593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5ff11-a700-4cfc-bff2-fe245401278c admin admin] RBAC: Authorizing `identity:create_grant(project_id=478274c7970c44fcb5e673bbf1534a09, user_id=e31b7bed13d34f9d8ce5f546c60dd1f4, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:27.974385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5ff11-a700-4cfc-bff2-fe245401278c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:27.989649 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1325/2631] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:27 2022] PUT /identity/v3/projects/478274c7970c44fcb5e673bbf1534a09/users/e31b7bed13d34f9d8ce5f546c60dd1f4/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:27.995368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1307/2632] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:27 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:28.000007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5ff11-a700-4cfc-bff2-fe245401278c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.000360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e9bb0-d0af-48c1-8655-375124ca01a6 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.000651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e9bb0-d0af-48c1-8655-375124ca01a6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.000924 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e9bb0-d0af-48c1-8655-375124ca01a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.029333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-eb1e9bb0-d0af-48c1-8655-375124ca01a6 None None] MFA Rules not processed for user `e31b7bed13d34f9d8ce5f546c60dd1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:28.030638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-eb1e9bb0-d0af-48c1-8655-375124ca01a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:28.064902 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5ff11-a700-4cfc-bff2-fe245401278c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.084644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:28.104515 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1308/2633] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:28.108782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e9bb0-d0af-48c1-8655-375124ca01a6 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.126083 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c7c57-b9bb-4046-8803-69e620484153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.126809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c7c57-b9bb-4046-8803-69e620484153 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.127117 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c7c57-b9bb-4046-8803-69e620484153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.127389 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c7c57-b9bb-4046-8803-69e620484153 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.128024 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c7c57-b9bb-4046-8803-69e620484153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.129930 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c7c57-b9bb-4046-8803-69e620484153 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.139021 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:28.157466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1326/2634] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:27 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:28.161807 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c7c57-b9bb-4046-8803-69e620484153 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.175037 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e9bb0-d0af-48c1-8655-375124ca01a6 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.178072 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c7c57-b9bb-4046-8803-69e620484153 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.181413 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab6824-f1eb-4950-9e52-67981757e47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.182040 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab6824-f1eb-4950-9e52-67981757e47c admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.182345 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab6824-f1eb-4950-9e52-67981757e47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.182608 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab6824-f1eb-4950-9e52-67981757e47c admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.183241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab6824-f1eb-4950-9e52-67981757e47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.183395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60939b0-064e-453d-850f-31d894b2b09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.183939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60939b0-064e-453d-850f-31d894b2b09a admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.184223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60939b0-064e-453d-850f-31d894b2b09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.184497 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60939b0-064e-453d-850f-31d894b2b09a admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.185127 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab6824-f1eb-4950-9e52-67981757e47c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.185251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60939b0-064e-453d-850f-31d894b2b09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.186761 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60939b0-064e-453d-850f-31d894b2b09a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.197505 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1327/2635] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:28.201290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60939b0-064e-453d-850f-31d894b2b09a admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.211933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60939b0-064e-453d-850f-31d894b2b09a admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.212635 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1309/2636] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:28 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:28.216792 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab6824-f1eb-4950-9e52-67981757e47c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.271336 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99ebb1-726b-4839-850b-2e1453e1b505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.271967 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99ebb1-726b-4839-850b-2e1453e1b505 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.272243 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99ebb1-726b-4839-850b-2e1453e1b505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.272547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99ebb1-726b-4839-850b-2e1453e1b505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.273210 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99ebb1-726b-4839-850b-2e1453e1b505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.274846 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99ebb1-726b-4839-850b-2e1453e1b505 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.280948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab6824-f1eb-4950-9e52-67981757e47c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.285080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1328/2637] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:28.286280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ae459-dbd2-4636-a945-5ad742e9d99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.287051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae459-dbd2-4636-a945-5ad742e9d99a admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.287333 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae459-dbd2-4636-a945-5ad742e9d99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.287643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae459-dbd2-4636-a945-5ad742e9d99a admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.288482 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ae459-dbd2-4636-a945-5ad742e9d99a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.289151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99ebb1-726b-4839-850b-2e1453e1b505 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.290377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ae459-dbd2-4636-a945-5ad742e9d99a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.299103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99ebb1-726b-4839-850b-2e1453e1b505 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.304541 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fadd02-5bec-4ad2-8918-a5f6f8908fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.305298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fadd02-5bec-4ad2-8918-a5f6f8908fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.305572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fadd02-5bec-4ad2-8918-a5f6f8908fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.305863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fadd02-5bec-4ad2-8918-a5f6f8908fe5 admin admin] PATH_INFO: `/v3/projects/4f0a3d28eb18403e9cfbb8716c85b312/users/f26d6ef63fb14ce9ade60142b8477158/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.312813 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1310/2638] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:28 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:28.317055 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ae459-dbd2-4636-a945-5ad742e9d99a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.321343 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fadd02-5bec-4ad2-8918-a5f6f8908fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0a3d28eb18403e9cfbb8716c85b312, user_id=f26d6ef63fb14ce9ade60142b8477158, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.324030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fadd02-5bec-4ad2-8918-a5f6f8908fe5 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.326941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ae459-dbd2-4636-a945-5ad742e9d99a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.332230 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4ab15-0e86-4e07-a3eb-b99cff7fcf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.332839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4ab15-0e86-4e07-a3eb-b99cff7fcf34 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.333117 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4ab15-0e86-4e07-a3eb-b99cff7fcf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.333389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4ab15-0e86-4e07-a3eb-b99cff7fcf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.334035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4ab15-0e86-4e07-a3eb-b99cff7fcf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.335619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4ab15-0e86-4e07-a3eb-b99cff7fcf34 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.337707 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1329/2639] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:28 2022] PUT /identity/v3/projects/4f0a3d28eb18403e9cfbb8716c85b312/users/f26d6ef63fb14ce9ade60142b8477158/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:28.350617 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1311/2640] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:28.350831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fe3e3-cf3d-484c-ab3c-bd79d226788c None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.350831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fe3e3-cf3d-484c-ab3c-bd79d226788c None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.350831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fe3e3-cf3d-484c-ab3c-bd79d226788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.351996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4ab15-0e86-4e07-a3eb-b99cff7fcf34 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.361778 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4ab15-0e86-4e07-a3eb-b99cff7fcf34 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.377069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-9f2fe3e3-cf3d-484c-ab3c-bd79d226788c None None] MFA Rules not processed for user `f26d6ef63fb14ce9ade60142b8477158`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:28.378310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-9f2fe3e3-cf3d-484c-ab3c-bd79d226788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:28.411306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:28.421721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f90fe-0081-4cde-9924-2356f7c69028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.422390 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f90fe-0081-4cde-9924-2356f7c69028 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.422666 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f90fe-0081-4cde-9924-2356f7c69028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.422943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f90fe-0081-4cde-9924-2356f7c69028 admin admin] PATH_INFO: `/v3/projects/a8920e6606fa43619b5af037efa19ec1/users/6aedb06a497d4ddaa5e7472061671e12/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.437694 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f90fe-0081-4cde-9924-2356f7c69028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8920e6606fa43619b5af037efa19ec1, user_id=6aedb06a497d4ddaa5e7472061671e12, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.440614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f90fe-0081-4cde-9924-2356f7c69028 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.445724 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1330/2641] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:28.450514 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fe3e3-cf3d-484c-ab3c-bd79d226788c None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.454870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1312/2642] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:28 2022] PUT /identity/v3/projects/a8920e6606fa43619b5af037efa19ec1/users/6aedb06a497d4ddaa5e7472061671e12/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:28.459032 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f90fe-0081-4cde-9924-2356f7c69028 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.464346 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fe3e3-cf3d-484c-ab3c-bd79d226788c None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.509335 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:28.527027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e23037-86ed-4fab-951c-1373d1fc041f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.527646 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e23037-86ed-4fab-951c-1373d1fc041f admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.527962 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e23037-86ed-4fab-951c-1373d1fc041f admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.528233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e23037-86ed-4fab-951c-1373d1fc041f admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.528888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e23037-86ed-4fab-951c-1373d1fc041f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.530782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e23037-86ed-4fab-951c-1373d1fc041f admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.532483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f90fe-0081-4cde-9924-2356f7c69028 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.538165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e94688-6757-47ab-8236-266f4272f552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.539061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e94688-6757-47ab-8236-266f4272f552 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.539547 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e94688-6757-47ab-8236-266f4272f552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.540297 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e94688-6757-47ab-8236-266f4272f552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.541004 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e94688-6757-47ab-8236-266f4272f552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.542792 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e94688-6757-47ab-8236-266f4272f552 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.553885 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1313/2643] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:28.558159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e94688-6757-47ab-8236-266f4272f552 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.560096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1331/2644] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:28 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:28.563845 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e23037-86ed-4fab-951c-1373d1fc041f admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.571317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e94688-6757-47ab-8236-266f4272f552 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.629258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e23037-86ed-4fab-951c-1373d1fc041f admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.633837 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ac420-8686-4ffe-9828-20ce0c9f2e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.634465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ac420-8686-4ffe-9828-20ce0c9f2e0b admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.634740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ac420-8686-4ffe-9828-20ce0c9f2e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.635003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ac420-8686-4ffe-9828-20ce0c9f2e0b admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.635106 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c4860-181b-430c-ad82-73b84828a944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.635621 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ac420-8686-4ffe-9828-20ce0c9f2e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.635849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c4860-181b-430c-ad82-73b84828a944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.636138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c4860-181b-430c-ad82-73b84828a944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.636412 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c4860-181b-430c-ad82-73b84828a944 admin admin] PATH_INFO: `/v3/projects/a8920e6606fa43619b5af037efa19ec1/users/6aedb06a497d4ddaa5e7472061671e12/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.637549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ac420-8686-4ffe-9828-20ce0c9f2e0b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.638380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c4860-181b-430c-ad82-73b84828a944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8920e6606fa43619b5af037efa19ec1, user_id=6aedb06a497d4ddaa5e7472061671e12, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.641190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c4860-181b-430c-ad82-73b84828a944 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.652203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1314/2645] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:28 2022] PUT /identity/v3/projects/a8920e6606fa43619b5af037efa19ec1/users/6aedb06a497d4ddaa5e7472061671e12/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:28.659733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1332/2646] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:28 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:28.663294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ac420-8686-4ffe-9828-20ce0c9f2e0b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.663868 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34e8e8-34c3-49e2-a6c5-be5be155c653 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.664154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34e8e8-34c3-49e2-a6c5-be5be155c653 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.664449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34e8e8-34c3-49e2-a6c5-be5be155c653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.673155 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ac420-8686-4ffe-9828-20ce0c9f2e0b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.694150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-dd34e8e8-34c3-49e2-a6c5-be5be155c653 None None] MFA Rules not processed for user `6aedb06a497d4ddaa5e7472061671e12`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:28.695295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-dd34e8e8-34c3-49e2-a6c5-be5be155c653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:28.728793 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a764f-1982-4642-ad3e-1a8b1b39d9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.729415 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a764f-1982-4642-ad3e-1a8b1b39d9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.729730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a764f-1982-4642-ad3e-1a8b1b39d9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.730003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a764f-1982-4642-ad3e-1a8b1b39d9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.730648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a764f-1982-4642-ad3e-1a8b1b39d9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.732301 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a764f-1982-4642-ad3e-1a8b1b39d9d4 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.742468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1333/2647] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:28.746473 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a764f-1982-4642-ad3e-1a8b1b39d9d4 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.749511 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:28.756778 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a764f-1982-4642-ad3e-1a8b1b39d9d4 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.761397 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e0acc-9066-495a-ab82-38bcd9acd472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.761969 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e0acc-9066-495a-ab82-38bcd9acd472 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.762248 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e0acc-9066-495a-ab82-38bcd9acd472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.762519 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e0acc-9066-495a-ab82-38bcd9acd472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.763185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e0acc-9066-495a-ab82-38bcd9acd472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.764812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e0acc-9066-495a-ab82-38bcd9acd472 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.768341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1315/2648] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:28.777882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1334/2649] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:28.779471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e0acc-9066-495a-ab82-38bcd9acd472 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.779606 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34e8e8-34c3-49e2-a6c5-be5be155c653 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.781143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-631e0acc-9066-495a-ab82-38bcd9acd472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:28.789890 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34e8e8-34c3-49e2-a6c5-be5be155c653 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.794430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6a2f9-9209-4bb3-b973-f9542af4c739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.795072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6a2f9-9209-4bb3-b973-f9542af4c739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.795713 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6a2f9-9209-4bb3-b973-f9542af4c739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.795993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6a2f9-9209-4bb3-b973-f9542af4c739 admin admin] PATH_INFO: `/v3/projects/f1dc4c3f3e5141278f7042225d8beb7f/users/1f55d3249d7f4174b5d7206ef63ad8c8/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.811901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6a2f9-9209-4bb3-b973-f9542af4c739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1dc4c3f3e5141278f7042225d8beb7f, user_id=1f55d3249d7f4174b5d7206ef63ad8c8, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.815130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6a2f9-9209-4bb3-b973-f9542af4c739 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.829354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1316/2650] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:28 2022] PUT /identity/v3/projects/f1dc4c3f3e5141278f7042225d8beb7f/users/1f55d3249d7f4174b5d7206ef63ad8c8/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:28.830816 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:28.840483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35936b2e-87b4-4693-8490-d481ad261ce5 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.840767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35936b2e-87b4-4693-8490-d481ad261ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.841038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35936b2e-87b4-4693-8490-d481ad261ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.847790 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e0acc-9066-495a-ab82-38bcd9acd472 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:28.869728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-35936b2e-87b4-4693-8490-d481ad261ce5 None None] MFA Rules not processed for user `1f55d3249d7f4174b5d7206ef63ad8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:28.870965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-35936b2e-87b4-4693-8490-d481ad261ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:28.896584 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b25351-1561-4516-a010-5c578419f1cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:28.897200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b25351-1561-4516-a010-5c578419f1cc service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:28.897479 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b25351-1561-4516-a010-5c578419f1cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:28.897746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b25351-1561-4516-a010-5c578419f1cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:28.899560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-49b25351-1561-4516-a010-5c578419f1cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:28.947374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1317/2651] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:28.951368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35936b2e-87b4-4693-8490-d481ad261ce5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:28.964441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b25351-1561-4516-a010-5c578419f1cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:28.966067 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b25351-1561-4516-a010-5c578419f1cc service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:28.977381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1335/2652] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:29.019604 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35936b2e-87b4-4693-8490-d481ad261ce5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:29.024124 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39a6d9-8787-4bfe-a7fd-54f0d5e58b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:29.024733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a6d9-8787-4bfe-a7fd-54f0d5e58b5e admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:29.025009 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a6d9-8787-4bfe-a7fd-54f0d5e58b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:29.025282 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a6d9-8787-4bfe-a7fd-54f0d5e58b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:29.025917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39a6d9-8787-4bfe-a7fd-54f0d5e58b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:29.027821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39a6d9-8787-4bfe-a7fd-54f0d5e58b5e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:29.059733 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1318/2653] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:28 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:29.060741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b25351-1561-4516-a010-5c578419f1cc service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:29.072166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b25351-1561-4516-a010-5c578419f1cc service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:29.132842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540095c6-fe94-4b24-ba93-8424b5f5ca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:29.133472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540095c6-fe94-4b24-ba93-8424b5f5ca78 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:29.133817 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540095c6-fe94-4b24-ba93-8424b5f5ca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:29.134152 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540095c6-fe94-4b24-ba93-8424b5f5ca78 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:29.134861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540095c6-fe94-4b24-ba93-8424b5f5ca78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:29.137099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540095c6-fe94-4b24-ba93-8424b5f5ca78 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:29.161640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1336/2654] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:29 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:29.166491 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39a6d9-8787-4bfe-a7fd-54f0d5e58b5e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:29.177821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39a6d9-8787-4bfe-a7fd-54f0d5e58b5e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:29.183005 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a80dcc-4eda-4b65-b6c9-d41f18bee286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:29.183908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a80dcc-4eda-4b65-b6c9-d41f18bee286 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:29.184193 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a80dcc-4eda-4b65-b6c9-d41f18bee286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:29.184565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a80dcc-4eda-4b65-b6c9-d41f18bee286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:29.185342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a80dcc-4eda-4b65-b6c9-d41f18bee286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:29.187206 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a80dcc-4eda-4b65-b6c9-d41f18bee286 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:29.204900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1319/2655] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:29.206814 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540095c6-fe94-4b24-ba93-8424b5f5ca78 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:29.220979 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540095c6-fe94-4b24-ba93-8424b5f5ca78 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:29.225637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c906c-c2d1-49e3-8974-c27c29dcfe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:29.226299 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c906c-c2d1-49e3-8974-c27c29dcfe39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:29.226574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c906c-c2d1-49e3-8974-c27c29dcfe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:29.226841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c906c-c2d1-49e3-8974-c27c29dcfe39 admin admin] PATH_INFO: `/v3/projects/f17cc0e68a4d4007b31f146109fd9565/users/ad065904c3b74d2589fa4c42c8bbbba3/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:29.246153 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c906c-c2d1-49e3-8974-c27c29dcfe39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17cc0e68a4d4007b31f146109fd9565, user_id=ad065904c3b74d2589fa4c42c8bbbba3, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:29.248861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c906c-c2d1-49e3-8974-c27c29dcfe39 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:29.265070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1337/2656] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:29 2022] PUT /identity/v3/projects/f17cc0e68a4d4007b31f146109fd9565/users/ad065904c3b74d2589fa4c42c8bbbba3/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:29.268991 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a80dcc-4eda-4b65-b6c9-d41f18bee286 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:29.279688 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a80dcc-4eda-4b65-b6c9-d41f18bee286 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:29.313676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:29.343443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ffc52-e058-43aa-b9de-2dcea223a4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:29.344123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ffc52-e058-43aa-b9de-2dcea223a4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:29.344414 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ffc52-e058-43aa-b9de-2dcea223a4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:29.344689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ffc52-e058-43aa-b9de-2dcea223a4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:29.345374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ffc52-e058-43aa-b9de-2dcea223a4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:29.347159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ffc52-e058-43aa-b9de-2dcea223a4f2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:29.358136 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1320/2657] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:29.362530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c906c-c2d1-49e3-8974-c27c29dcfe39 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:29.373614 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c906c-c2d1-49e3-8974-c27c29dcfe39 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:29.378405 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05530579-79b8-4bbf-8034-e839ecbe084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:29.379055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05530579-79b8-4bbf-8034-e839ecbe084f admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:29.379334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05530579-79b8-4bbf-8034-e839ecbe084f admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:29.379603 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05530579-79b8-4bbf-8034-e839ecbe084f admin admin] PATH_INFO: `/v3/projects/f17cc0e68a4d4007b31f146109fd9565/users/ad065904c3b74d2589fa4c42c8bbbba3/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:29.381617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05530579-79b8-4bbf-8034-e839ecbe084f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17cc0e68a4d4007b31f146109fd9565, user_id=ad065904c3b74d2589fa4c42c8bbbba3, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:29.384399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05530579-79b8-4bbf-8034-e839ecbe084f admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:29.394574 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1338/2658] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:29 2022] PUT /identity/v3/projects/f17cc0e68a4d4007b31f146109fd9565/users/ad065904c3b74d2589fa4c42c8bbbba3/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:29.404859 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428e8ea-d947-4490-a358-a466f592e262 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:29.405139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428e8ea-d947-4490-a358-a466f592e262 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:29.405408 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428e8ea-d947-4490-a358-a466f592e262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:29.435182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e428e8ea-d947-4490-a358-a466f592e262 None None] MFA Rules not processed for user `ad065904c3b74d2589fa4c42c8bbbba3`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:29.436439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e428e8ea-d947-4490-a358-a466f592e262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:29.509881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1321/2659] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:29.521087 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05530579-79b8-4bbf-8034-e839ecbe084f admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:29.526858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:29.579408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05530579-79b8-4bbf-8034-e839ecbe084f admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:29.583604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819de40-ec2b-4736-8d6a-de3d5d456aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:29.584237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819de40-ec2b-4736-8d6a-de3d5d456aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:29.584515 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819de40-ec2b-4736-8d6a-de3d5d456aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:29.584784 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819de40-ec2b-4736-8d6a-de3d5d456aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:29.594448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819de40-ec2b-4736-8d6a-de3d5d456aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:29.595949 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819de40-ec2b-4736-8d6a-de3d5d456aa5 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:29.605718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1339/2660] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:30.125103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428e8ea-d947-4490-a358-a466f592e262 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:30.141508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428e8ea-d947-4490-a358-a466f592e262 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:30.145526 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c120ad1-5fd5-48ae-b4d4-878e11be5fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:30.146169 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c120ad1-5fd5-48ae-b4d4-878e11be5fcf service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:30.146444 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c120ad1-5fd5-48ae-b4d4-878e11be5fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:30.146710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c120ad1-5fd5-48ae-b4d4-878e11be5fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:30.205549 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c120ad1-5fd5-48ae-b4d4-878e11be5fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:30.207039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c120ad1-5fd5-48ae-b4d4-878e11be5fcf service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:30.217120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1322/2661] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:30.544855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819de40-ec2b-4736-8d6a-de3d5d456aa5 service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:30.546884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6819de40-ec2b-4736-8d6a-de3d5d456aa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:30.558544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819de40-ec2b-4736-8d6a-de3d5d456aa5 service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:30.562466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aeeff-3a08-4f8b-b7d0-07a719744b1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:30.563074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aeeff-3a08-4f8b-b7d0-07a719744b1d service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:30.563341 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aeeff-3a08-4f8b-b7d0-07a719744b1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:30.563648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aeeff-3a08-4f8b-b7d0-07a719744b1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:30.620308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95aeeff-3a08-4f8b-b7d0-07a719744b1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:30.621788 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95aeeff-3a08-4f8b-b7d0-07a719744b1d service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:30.631274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1340/2662] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:31.166043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c120ad1-5fd5-48ae-b4d4-878e11be5fcf service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:31.168007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3c120ad1-5fd5-48ae-b4d4-878e11be5fcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:31.220733 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aeeff-3a08-4f8b-b7d0-07a719744b1d service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:31.224940 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:31.231690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aeeff-3a08-4f8b-b7d0-07a719744b1d service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:31.235392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727c760-c4b2-41b8-af20-b2af7d2190a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:31.236034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727c760-c4b2-41b8-af20-b2af7d2190a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:31.236344 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727c760-c4b2-41b8-af20-b2af7d2190a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:31.236616 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727c760-c4b2-41b8-af20-b2af7d2190a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:31.240693 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c120ad1-5fd5-48ae-b4d4-878e11be5fcf service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:31.245510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547370a-de77-440a-88b3-9b7ee638bb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:31.246162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547370a-de77-440a-88b3-9b7ee638bb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:31.246439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547370a-de77-440a-88b3-9b7ee638bb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:31.246699 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547370a-de77-440a-88b3-9b7ee638bb93 admin admin] PATH_INFO: `/v3/users/fd26a4b55027438db3cf987ae608f24f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:31.247966 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547370a-de77-440a-88b3-9b7ee638bb93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd26a4b55027438db3cf987ae608f24f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:31.249883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547370a-de77-440a-88b3-9b7ee638bb93 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:31.302911 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727c760-c4b2-41b8-af20-b2af7d2190a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:31.303906 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8547370a-de77-440a-88b3-9b7ee638bb93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd26a4b55027438db3cf987ae608f24f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:31.304416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727c760-c4b2-41b8-af20-b2af7d2190a3 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:31.314080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1341/2663] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:31.316363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8547370a-de77-440a-88b3-9b7ee638bb93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd26a4b55027438db3cf987ae608f24f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:31.324711 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8547370a-de77-440a-88b3-9b7ee638bb93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd26a4b55027438db3cf987ae608f24f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:31.331611 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8547370a-de77-440a-88b3-9b7ee638bb93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd26a4b55027438db3cf987ae608f24f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:31.332275 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8547370a-de77-440a-88b3-9b7ee638bb93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd26a4b55027438db3cf987ae608f24f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:31.338077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1323/2664] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:31 2022] DELETE /identity/v3/users/fd26a4b55027438db3cf987ae608f24f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:31.342795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b149a-ce10-4461-90a8-73781f02e8db None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:31.343125 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b149a-ce10-4461-90a8-73781f02e8db None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:31.343395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b149a-ce10-4461-90a8-73781f02e8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:31.362623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-543b149a-ce10-4461-90a8-73781f02e8db None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:31.363784 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-543b149a-ce10-4461-90a8-73781f02e8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:31.397507 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:31.424411 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1342/2665] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:31.434465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547370a-de77-440a-88b3-9b7ee638bb93 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:31.436045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8547370a-de77-440a-88b3-9b7ee638bb93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:31.496537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547370a-de77-440a-88b3-9b7ee638bb93 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:31.500952 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b080b-ca70-40e6-9a95-d5d2f9fc1c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:31.501608 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b080b-ca70-40e6-9a95-d5d2f9fc1c52 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:31.501901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b080b-ca70-40e6-9a95-d5d2f9fc1c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:31.502182 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b080b-ca70-40e6-9a95-d5d2f9fc1c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:31.512816 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b080b-ca70-40e6-9a95-d5d2f9fc1c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:31.514316 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b080b-ca70-40e6-9a95-d5d2f9fc1c52 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:31.524707 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1324/2666] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:31.810216 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b149a-ce10-4461-90a8-73781f02e8db None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:31.811874 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-543b149a-ce10-4461-90a8-73781f02e8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:31.834832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b149a-ce10-4461-90a8-73781f02e8db None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:31.840634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:31.841293 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:31.841569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:31.841839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] PATH_INFO: `/v3/projects/e617658652af42fbbe3d6e15d33b2d5b` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:31.843135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e617658652af42fbbe3d6e15d33b2d5b)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:31.845139 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:31.896333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e617658652af42fbbe3d6e15d33b2d5b', 'request_id': 'req-d0908253-babc-4388-aaac-4028a6b19112'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:31.909658 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e617658652af42fbbe3d6e15d33b2d5b', 'request_id': 'req-d0908253-babc-4388-aaac-4028a6b19112'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:31.916185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e617658652af42fbbe3d6e15d33b2d5b', 'request_id': 'req-d0908253-babc-4388-aaac-4028a6b19112'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:31.929748 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] The token cache is being invalidate because project e617658652af42fbbe3d6e15d33b2d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:31.930126 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:31.930932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:31.932885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1343/2667] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:31 2022] DELETE /identity/v3/projects/e617658652af42fbbe3d6e15d33b2d5b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:34.319428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b080b-ca70-40e6-9a95-d5d2f9fc1c52 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:34.321110 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-db3b080b-ca70-40e6-9a95-d5d2f9fc1c52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:34.385366 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b080b-ca70-40e6-9a95-d5d2f9fc1c52 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:34.410824 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:34.436183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175c2a0-fabe-46c3-916b-189020051649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:34.436788 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175c2a0-fabe-46c3-916b-189020051649 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:34.437070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175c2a0-fabe-46c3-916b-189020051649 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:34.437340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175c2a0-fabe-46c3-916b-189020051649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:34.439261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a175c2a0-fabe-46c3-916b-189020051649 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:34.504958 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175c2a0-fabe-46c3-916b-189020051649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:34.506321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175c2a0-fabe-46c3-916b-189020051649 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:34.515443 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1325/2668] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:35.231637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:35.233064 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:35.302209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0908253-babc-4388-aaac-4028a6b19112 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:35.307865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b7c5b-3693-4250-8e42-d52a2d43df26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:35.308491 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b7c5b-3693-4250-8e42-d52a2d43df26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:35.308736 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b7c5b-3693-4250-8e42-d52a2d43df26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:35.309095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b7c5b-3693-4250-8e42-d52a2d43df26 admin admin] PATH_INFO: `/v3/users/270df34908ae409983d230c2ec3ccfa4` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:35.310576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b7c5b-3693-4250-8e42-d52a2d43df26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=270df34908ae409983d230c2ec3ccfa4)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:35.312650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b7c5b-3693-4250-8e42-d52a2d43df26 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:35.362075 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-3f0b7c5b-3693-4250-8e42-d52a2d43df26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270df34908ae409983d230c2ec3ccfa4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:35.375231 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-3f0b7c5b-3693-4250-8e42-d52a2d43df26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270df34908ae409983d230c2ec3ccfa4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:35.376526 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:35.384366 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-3f0b7c5b-3693-4250-8e42-d52a2d43df26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270df34908ae409983d230c2ec3ccfa4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:35.392756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-3f0b7c5b-3693-4250-8e42-d52a2d43df26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270df34908ae409983d230c2ec3ccfa4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:35.393394 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-3f0b7c5b-3693-4250-8e42-d52a2d43df26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270df34908ae409983d230c2ec3ccfa4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:35.399289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1344/2669] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:35 2022] DELETE /identity/v3/users/270df34908ae409983d230c2ec3ccfa4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:35.404772 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba9744-e812-4faf-934a-cf5f80bbd90f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:35.405288 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba9744-e812-4faf-934a-cf5f80bbd90f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:35.405412 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba9744-e812-4faf-934a-cf5f80bbd90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:35.427401 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-89ba9744-e812-4faf-934a-cf5f80bbd90f None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:35.428656 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-89ba9744-e812-4faf-934a-cf5f80bbd90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:35.502211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1326/2670] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:35.509695 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b7c5b-3693-4250-8e42-d52a2d43df26 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:35.511246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3f0b7c5b-3693-4250-8e42-d52a2d43df26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:35.570649 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b7c5b-3693-4250-8e42-d52a2d43df26 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:35.574644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078c05f-b20c-43c2-a8f2-16db5e0f8b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:35.575294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c05f-b20c-43c2-a8f2-16db5e0f8b93 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:35.575567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c05f-b20c-43c2-a8f2-16db5e0f8b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:35.575869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c05f-b20c-43c2-a8f2-16db5e0f8b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:35.585259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078c05f-b20c-43c2-a8f2-16db5e0f8b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:35.586681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078c05f-b20c-43c2-a8f2-16db5e0f8b93 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:35.596571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1345/2671] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:35.879100 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba9744-e812-4faf-934a-cf5f80bbd90f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:35.880609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-89ba9744-e812-4faf-934a-cf5f80bbd90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:35.892839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba9744-e812-4faf-934a-cf5f80bbd90f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:35.897760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:35.898509 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:35.898665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:35.898905 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] PATH_INFO: `/v3/projects/796275c75486403ca60f400eb3e86a4a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:35.900123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=796275c75486403ca60f400eb3e86a4a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:35.902439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:35.953546 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796275c75486403ca60f400eb3e86a4a', 'request_id': 'req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:35.961466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796275c75486403ca60f400eb3e86a4a', 'request_id': 'req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:35.967203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796275c75486403ca60f400eb3e86a4a', 'request_id': 'req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:35.978867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] The token cache is being invalidate because project 796275c75486403ca60f400eb3e86a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:35.979159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:35.979899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:35.981429 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1327/2672] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:35 2022] DELETE /identity/v3/projects/796275c75486403ca60f400eb3e86a4a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:35.985492 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078c05f-b20c-43c2-a8f2-16db5e0f8b93 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:35.995350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078c05f-b20c-43c2-a8f2-16db5e0f8b93 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:36.054369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d26e68-e2bf-4e9b-a84e-938ce899592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:36.055005 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d26e68-e2bf-4e9b-a84e-938ce899592c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:36.055280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d26e68-e2bf-4e9b-a84e-938ce899592c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:36.055553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d26e68-e2bf-4e9b-a84e-938ce899592c admin admin] PATH_INFO: `/v3/users/e31b7bed13d34f9d8ce5f546c60dd1f4` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:36.056787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d26e68-e2bf-4e9b-a84e-938ce899592c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31b7bed13d34f9d8ce5f546c60dd1f4)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:36.058718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d26e68-e2bf-4e9b-a84e-938ce899592c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:36.109305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-20d26e68-e2bf-4e9b-a84e-938ce899592c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31b7bed13d34f9d8ce5f546c60dd1f4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.121046 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-20d26e68-e2bf-4e9b-a84e-938ce899592c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31b7bed13d34f9d8ce5f546c60dd1f4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.127918 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-20d26e68-e2bf-4e9b-a84e-938ce899592c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31b7bed13d34f9d8ce5f546c60dd1f4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.137524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-20d26e68-e2bf-4e9b-a84e-938ce899592c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31b7bed13d34f9d8ce5f546c60dd1f4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.138404 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-20d26e68-e2bf-4e9b-a84e-938ce899592c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31b7bed13d34f9d8ce5f546c60dd1f4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.144314 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1346/2673] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:35 2022] DELETE /identity/v3/users/e31b7bed13d34f9d8ce5f546c60dd1f4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:36.444017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:36.445709 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:36.460735 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24a858-3d46-4fe9-8ba2-d0d45cf917f1 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:36.464544 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:36.526754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:36.527608 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:36.527753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:36.528030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] PATH_INFO: `/v3/projects/478274c7970c44fcb5e673bbf1534a09` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:36.529438 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=478274c7970c44fcb5e673bbf1534a09)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:36.531789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:36.587432 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '478274c7970c44fcb5e673bbf1534a09', 'request_id': 'req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.595826 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '478274c7970c44fcb5e673bbf1534a09', 'request_id': 'req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.601510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '478274c7970c44fcb5e673bbf1534a09', 'request_id': 'req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.614107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] The token cache is being invalidate because project 478274c7970c44fcb5e673bbf1534a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:36.614403 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.615124 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.616720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1328/2674] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:36 2022] DELETE /identity/v3/projects/478274c7970c44fcb5e673bbf1534a09 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:36.620709 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d26e68-e2bf-4e9b-a84e-938ce899592c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:36.622067 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-20d26e68-e2bf-4e9b-a84e-938ce899592c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:36.632241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:36.639661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d26e68-e2bf-4e9b-a84e-938ce899592c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:36.662001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:36.663584 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:36.699995 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce8a32-0aae-4008-87e0-eb9e5ecca60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:36.700634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8a32-0aae-4008-87e0-eb9e5ecca60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:36.700913 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8a32-0aae-4008-87e0-eb9e5ecca60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:36.701183 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8a32-0aae-4008-87e0-eb9e5ecca60b admin admin] PATH_INFO: `/v3/users/6aedb06a497d4ddaa5e7472061671e12` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:36.702317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce8a32-0aae-4008-87e0-eb9e5ecca60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aedb06a497d4ddaa5e7472061671e12)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:36.704730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce8a32-0aae-4008-87e0-eb9e5ecca60b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:36.730141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cdd75-1a93-49a8-b02d-0b1bc978f101 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:36.734979 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15419c0e-0575-4556-8279-161302958544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:36.735627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419c0e-0575-4556-8279-161302958544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:36.736002 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419c0e-0575-4556-8279-161302958544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:36.736424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419c0e-0575-4556-8279-161302958544 admin admin] PATH_INFO: `/v3/users/f26d6ef63fb14ce9ade60142b8477158` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:36.737668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15419c0e-0575-4556-8279-161302958544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f26d6ef63fb14ce9ade60142b8477158)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:36.740240 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15419c0e-0575-4556-8279-161302958544 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:36.752355 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-edce8a32-0aae-4008-87e0-eb9e5ecca60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aedb06a497d4ddaa5e7472061671e12'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.764050 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-edce8a32-0aae-4008-87e0-eb9e5ecca60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aedb06a497d4ddaa5e7472061671e12'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.772241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-edce8a32-0aae-4008-87e0-eb9e5ecca60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aedb06a497d4ddaa5e7472061671e12'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.780111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-edce8a32-0aae-4008-87e0-eb9e5ecca60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aedb06a497d4ddaa5e7472061671e12'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.780848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-edce8a32-0aae-4008-87e0-eb9e5ecca60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aedb06a497d4ddaa5e7472061671e12'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.784139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:36.787429 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1347/2675] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:36 2022] DELETE /identity/v3/users/6aedb06a497d4ddaa5e7472061671e12 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:36.791537 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-15419c0e-0575-4556-8279-161302958544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f26d6ef63fb14ce9ade60142b8477158'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.805295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-15419c0e-0575-4556-8279-161302958544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f26d6ef63fb14ce9ade60142b8477158'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.813454 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-15419c0e-0575-4556-8279-161302958544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f26d6ef63fb14ce9ade60142b8477158'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.822393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-15419c0e-0575-4556-8279-161302958544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f26d6ef63fb14ce9ade60142b8477158'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.823017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-15419c0e-0575-4556-8279-161302958544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f26d6ef63fb14ce9ade60142b8477158'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:36.832500 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1329/2676] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:36 2022] DELETE /identity/v3/users/f26d6ef63fb14ce9ade60142b8477158 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:36.837144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aae732-a99b-44e7-aaaa-7868388e8863 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:36.837484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aae732-a99b-44e7-aaaa-7868388e8863 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:36.837888 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aae732-a99b-44e7-aaaa-7868388e8863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:36.858395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-a5aae732-a99b-44e7-aaaa-7868388e8863 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:36.859511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a5aae732-a99b-44e7-aaaa-7868388e8863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:36.921121 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1348/2677] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:36.931893 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15419c0e-0575-4556-8279-161302958544 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:36.933575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-15419c0e-0575-4556-8279-161302958544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:36.996324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15419c0e-0575-4556-8279-161302958544 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:37.000241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc9ed8-f91f-4966-91f2-72d87ad5348e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:37.000956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc9ed8-f91f-4966-91f2-72d87ad5348e service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:37.001505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc9ed8-f91f-4966-91f2-72d87ad5348e service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:37.001505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc9ed8-f91f-4966-91f2-72d87ad5348e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:37.010902 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc9ed8-f91f-4966-91f2-72d87ad5348e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:37.012372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc9ed8-f91f-4966-91f2-72d87ad5348e service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:37.022091 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1330/2678] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:37.102558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aae732-a99b-44e7-aaaa-7868388e8863 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:37.104231 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a5aae732-a99b-44e7-aaaa-7868388e8863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:37.117280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aae732-a99b-44e7-aaaa-7868388e8863 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:37.122707 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:37.123581 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:37.124081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:37.124233 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] PATH_INFO: `/v3/projects/a8920e6606fa43619b5af037efa19ec1` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:37.125799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8920e6606fa43619b5af037efa19ec1)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:37.128253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:37.154683 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:37.189300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8920e6606fa43619b5af037efa19ec1', 'request_id': 'req-c55adaba-edab-4269-81dc-5feba7f60bb4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.196965 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8920e6606fa43619b5af037efa19ec1', 'request_id': 'req-c55adaba-edab-4269-81dc-5feba7f60bb4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.203355 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8920e6606fa43619b5af037efa19ec1', 'request_id': 'req-c55adaba-edab-4269-81dc-5feba7f60bb4'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.214715 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] The token cache is being invalidate because project a8920e6606fa43619b5af037efa19ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:37.215047 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.215740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.217258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1349/2679] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:37 2022] DELETE /identity/v3/projects/a8920e6606fa43619b5af037efa19ec1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:37.382479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc9ed8-f91f-4966-91f2-72d87ad5348e service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:37.384055 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-92fc9ed8-f91f-4966-91f2-72d87ad5348e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:37.398378 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc9ed8-f91f-4966-91f2-72d87ad5348e service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:37.463734 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:37.464482 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:37.464638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:37.464915 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] PATH_INFO: `/v3/projects/4f0a3d28eb18403e9cfbb8716c85b312` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:37.466104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0a3d28eb18403e9cfbb8716c85b312)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:37.468097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:37.516856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0a3d28eb18403e9cfbb8716c85b312', 'request_id': 'req-c279981a-6894-423f-bf53-40c620900aa3'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.525413 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0a3d28eb18403e9cfbb8716c85b312', 'request_id': 'req-c279981a-6894-423f-bf53-40c620900aa3'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.529393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:37.531494 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0a3d28eb18403e9cfbb8716c85b312', 'request_id': 'req-c279981a-6894-423f-bf53-40c620900aa3'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.543878 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] The token cache is being invalidate because project 4f0a3d28eb18403e9cfbb8716c85b312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:37.544168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.545118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.546605 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1331/2680] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:37 2022] DELETE /identity/v3/projects/4f0a3d28eb18403e9cfbb8716c85b312 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:37.550593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:37.552010 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:37.565275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55adaba-edab-4269-81dc-5feba7f60bb4 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:37.629552 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7e815-ee90-4c82-9234-604ba684d5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:37.630268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7e815-ee90-4c82-9234-604ba684d5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:37.630447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7e815-ee90-4c82-9234-604ba684d5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:37.630772 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7e815-ee90-4c82-9234-604ba684d5c5 admin admin] PATH_INFO: `/v3/users/1f55d3249d7f4174b5d7206ef63ad8c8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:37.631961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7e815-ee90-4c82-9234-604ba684d5c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f55d3249d7f4174b5d7206ef63ad8c8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:37.633961 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7e815-ee90-4c82-9234-604ba684d5c5 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:37.682219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-edc7e815-ee90-4c82-9234-604ba684d5c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f55d3249d7f4174b5d7206ef63ad8c8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.694290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-edc7e815-ee90-4c82-9234-604ba684d5c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f55d3249d7f4174b5d7206ef63ad8c8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.701223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-edc7e815-ee90-4c82-9234-604ba684d5c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f55d3249d7f4174b5d7206ef63ad8c8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.709495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-edc7e815-ee90-4c82-9234-604ba684d5c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f55d3249d7f4174b5d7206ef63ad8c8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.710188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-edc7e815-ee90-4c82-9234-604ba684d5c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f55d3249d7f4174b5d7206ef63ad8c8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:37.716613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1350/2681] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:37 2022] DELETE /identity/v3/users/1f55d3249d7f4174b5d7206ef63ad8c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:37.997450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:37.998999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:38.029795 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279981a-6894-423f-bf53-40c620900aa3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:38.100075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:38.101028 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:38.101305 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:38.101574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] PATH_INFO: `/v3/projects/f1dc4c3f3e5141278f7042225d8beb7f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:38.102756 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1dc4c3f3e5141278f7042225d8beb7f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:38.105305 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:38.179215 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1dc4c3f3e5141278f7042225d8beb7f', 'request_id': 'req-2ec17b80-9be5-4580-a09c-6175126cbd99'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.190933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1dc4c3f3e5141278f7042225d8beb7f', 'request_id': 'req-2ec17b80-9be5-4580-a09c-6175126cbd99'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.197808 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1dc4c3f3e5141278f7042225d8beb7f', 'request_id': 'req-2ec17b80-9be5-4580-a09c-6175126cbd99'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.210174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] The token cache is being invalidate because project f1dc4c3f3e5141278f7042225d8beb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:38.210463 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.211187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.212973 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1332/2682] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:37 2022] DELETE /identity/v3/projects/f1dc4c3f3e5141278f7042225d8beb7f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:38.217027 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7e815-ee90-4c82-9234-604ba684d5c5 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:38.218511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-edc7e815-ee90-4c82-9234-604ba684d5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:38.231495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7e815-ee90-4c82-9234-604ba684d5c5 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:38.260847 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:38.298785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0f8a5-d00c-425e-b4d7-a4e99b2b300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:38.298785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f8a5-d00c-425e-b4d7-a4e99b2b300a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:38.298785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f8a5-d00c-425e-b4d7-a4e99b2b300a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:38.298785 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f8a5-d00c-425e-b4d7-a4e99b2b300a admin admin] PATH_INFO: `/v3/users/ad065904c3b74d2589fa4c42c8bbbba3` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:38.299174 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0f8a5-d00c-425e-b4d7-a4e99b2b300a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad065904c3b74d2589fa4c42c8bbbba3)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:38.300315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0f8a5-d00c-425e-b4d7-a4e99b2b300a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:38.350736 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-70a0f8a5-d00c-425e-b4d7-a4e99b2b300a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad065904c3b74d2589fa4c42c8bbbba3'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.362513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-70a0f8a5-d00c-425e-b4d7-a4e99b2b300a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad065904c3b74d2589fa4c42c8bbbba3'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.369749 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-70a0f8a5-d00c-425e-b4d7-a4e99b2b300a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad065904c3b74d2589fa4c42c8bbbba3'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.378040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-70a0f8a5-d00c-425e-b4d7-a4e99b2b300a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad065904c3b74d2589fa4c42c8bbbba3'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.379052 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-70a0f8a5-d00c-425e-b4d7-a4e99b2b300a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad065904c3b74d2589fa4c42c8bbbba3'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.385279 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1351/2683] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:38 2022] DELETE /identity/v3/users/ad065904c3b74d2589fa4c42c8bbbba3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:38.668187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:38.670031 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:38.687096 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec17b80-9be5-4580-a09c-6175126cbd99 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:38.744639 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730d159-fd0e-4455-8eaa-f7e94dd96476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:38.745274 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730d159-fd0e-4455-8eaa-f7e94dd96476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:38.745553 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730d159-fd0e-4455-8eaa-f7e94dd96476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:38.745828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730d159-fd0e-4455-8eaa-f7e94dd96476 admin admin] PATH_INFO: `/v3/projects/f17cc0e68a4d4007b31f146109fd9565` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:38.746923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730d159-fd0e-4455-8eaa-f7e94dd96476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17cc0e68a4d4007b31f146109fd9565)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:38.748909 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730d159-fd0e-4455-8eaa-f7e94dd96476 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:38.771532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:38.797984 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3730d159-fd0e-4455-8eaa-f7e94dd96476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17cc0e68a4d4007b31f146109fd9565', 'request_id': 'req-3730d159-fd0e-4455-8eaa-f7e94dd96476'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.807057 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3730d159-fd0e-4455-8eaa-f7e94dd96476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17cc0e68a4d4007b31f146109fd9565', 'request_id': 'req-3730d159-fd0e-4455-8eaa-f7e94dd96476'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.813019 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3730d159-fd0e-4455-8eaa-f7e94dd96476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17cc0e68a4d4007b31f146109fd9565', 'request_id': 'req-3730d159-fd0e-4455-8eaa-f7e94dd96476'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.824226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3730d159-fd0e-4455-8eaa-f7e94dd96476 admin admin] The token cache is being invalidate because project f17cc0e68a4d4007b31f146109fd9565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:38.824517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3730d159-fd0e-4455-8eaa-f7e94dd96476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.825164 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-3730d159-fd0e-4455-8eaa-f7e94dd96476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:38.826638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1333/2684] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:38 2022] DELETE /identity/v3/projects/f17cc0e68a4d4007b31f146109fd9565 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:38.834089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0543979-ffe0-4f2f-b68c-e965b8322e3b None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:38.834571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0543979-ffe0-4f2f-b68c-e965b8322e3b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:38.834691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0543979-ffe0-4f2f-b68c-e965b8322e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:38.855100 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-c0543979-ffe0-4f2f-b68c-e965b8322e3b None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:38.856367 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c0543979-ffe0-4f2f-b68c-e965b8322e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:38.925386 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1352/2685] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:38.934031 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a40b18-57c5-4eb7-ab0f-c7e05d436ed8 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:38.934318 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a40b18-57c5-4eb7-ab0f-c7e05d436ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:38.934595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a40b18-57c5-4eb7-ab0f-c7e05d436ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:38.960218 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-99a40b18-57c5-4eb7-ab0f-c7e05d436ed8 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:38.961664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-99a40b18-57c5-4eb7-ab0f-c7e05d436ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:38.973544 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1334/2686] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:38.978052 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0543979-ffe0-4f2f-b68c-e965b8322e3b None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:38.988115 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0543979-ffe0-4f2f-b68c-e965b8322e3b None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:38.994056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f46565-9d0b-4a91-a166-d860b683e66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:38.994665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f46565-9d0b-4a91-a166-d860b683e66b admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:38.994968 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f46565-9d0b-4a91-a166-d860b683e66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:38.995238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f46565-9d0b-4a91-a166-d860b683e66b admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:38.995933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f46565-9d0b-4a91-a166-d860b683e66b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:38.996236 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f46565-9d0b-4a91-a166-d860b683e66b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:38.997873 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f46565-9d0b-4a91-a166-d860b683e66b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:39.010131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1353/2687] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:27:39.015131 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a40b18-57c5-4eb7-ab0f-c7e05d436ed8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:39.029430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a40b18-57c5-4eb7-ab0f-c7e05d436ed8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:39.036236 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5e928-629b-46fb-8efc-c43cc8abb949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:39.036826 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5e928-629b-46fb-8efc-c43cc8abb949 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:39.037097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5e928-629b-46fb-8efc-c43cc8abb949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:39.037363 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5e928-629b-46fb-8efc-c43cc8abb949 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:39.037985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5e928-629b-46fb-8efc-c43cc8abb949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:39.039885 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5e928-629b-46fb-8efc-c43cc8abb949 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:39.070373 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1335/2688] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:39 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:39.076374 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f46565-9d0b-4a91-a166-d860b683e66b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:39.093185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f46565-9d0b-4a91-a166-d860b683e66b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:39.125582 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:39.156645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863113a0-3728-4655-919b-b9f6fb4096b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:39.157276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863113a0-3728-4655-919b-b9f6fb4096b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:39.157550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863113a0-3728-4655-919b-b9f6fb4096b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:39.157815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863113a0-3728-4655-919b-b9f6fb4096b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:39.158460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863113a0-3728-4655-919b-b9f6fb4096b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:39.160421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863113a0-3728-4655-919b-b9f6fb4096b9 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:39.184237 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1354/2689] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:39 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:39.189575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5e928-629b-46fb-8efc-c43cc8abb949 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:39.200070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5e928-629b-46fb-8efc-c43cc8abb949 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:39.204870 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2da829-ed89-47af-ae4d-3fcdb8c2034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:39.205750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2da829-ed89-47af-ae4d-3fcdb8c2034b admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:39.205750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2da829-ed89-47af-ae4d-3fcdb8c2034b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:39.206034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2da829-ed89-47af-ae4d-3fcdb8c2034b admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:39.206689 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2da829-ed89-47af-ae4d-3fcdb8c2034b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:39.208324 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2da829-ed89-47af-ae4d-3fcdb8c2034b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:39.219209 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1336/2690] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:39.223054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863113a0-3728-4655-919b-b9f6fb4096b9 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:39.233255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863113a0-3728-4655-919b-b9f6fb4096b9 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:39.238760 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132314e8-f583-4b4f-8db3-28b1704b867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:39.239359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132314e8-f583-4b4f-8db3-28b1704b867e admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:39.239636 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132314e8-f583-4b4f-8db3-28b1704b867e admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:39.239935 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132314e8-f583-4b4f-8db3-28b1704b867e admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:39.240577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132314e8-f583-4b4f-8db3-28b1704b867e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:39.242182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132314e8-f583-4b4f-8db3-28b1704b867e admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:39.252948 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1355/2691] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:39.257305 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2da829-ed89-47af-ae4d-3fcdb8c2034b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:39.267531 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2da829-ed89-47af-ae4d-3fcdb8c2034b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:39.272704 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b51c2b-89c8-4414-a289-af5272877fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:39.273360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51c2b-89c8-4414-a289-af5272877fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:39.273641 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51c2b-89c8-4414-a289-af5272877fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:39.273915 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51c2b-89c8-4414-a289-af5272877fd2 admin admin] PATH_INFO: `/v3/projects/95fe77bec88744a09692af9cf2f61dce/users/d55a090989b74708bcff35312768ea82/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:39.288438 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b51c2b-89c8-4414-a289-af5272877fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95fe77bec88744a09692af9cf2f61dce, user_id=d55a090989b74708bcff35312768ea82, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:39.291068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b51c2b-89c8-4414-a289-af5272877fd2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:39.306450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1337/2692] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:39 2022] PUT /identity/v3/projects/95fe77bec88744a09692af9cf2f61dce/users/d55a090989b74708bcff35312768ea82/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:27:39.326848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58622aba-7563-43b4-a3a8-14ed1063c7bd None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:39.327190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58622aba-7563-43b4-a3a8-14ed1063c7bd None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:39.327567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58622aba-7563-43b4-a3a8-14ed1063c7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:39.364352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-58622aba-7563-43b4-a3a8-14ed1063c7bd None None] MFA Rules not processed for user `d55a090989b74708bcff35312768ea82`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:39.365562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-58622aba-7563-43b4-a3a8-14ed1063c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:39.432624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1356/2693] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:39.448747 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b51c2b-89c8-4414-a289-af5272877fd2 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:39.451134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e8b51c2b-89c8-4414-a289-af5272877fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:39.515186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b51c2b-89c8-4414-a289-af5272877fd2 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:39.519035 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fdc50-4881-41b0-a4e6-93a98109ccd7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f886be277ef84ec28a290380980c6f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:39.519640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fdc50-4881-41b0-a4e6-93a98109ccd7 service glance] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:39.519943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fdc50-4881-41b0-a4e6-93a98109ccd7 service glance] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:39.520211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fdc50-4881-41b0-a4e6-93a98109ccd7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:39.528488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fdc50-4881-41b0-a4e6-93a98109ccd7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:39.529905 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fdc50-4881-41b0-a4e6-93a98109ccd7 service glance] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:39.539145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1338/2694] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:45.084570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58622aba-7563-43b4-a3a8-14ed1063c7bd None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:45.086203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-58622aba-7563-43b4-a3a8-14ed1063c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:45.147112 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58622aba-7563-43b4-a3a8-14ed1063c7bd None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:45.150803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523454d2-0ea4-45bc-ac68-78e97304a5f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:45.151408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523454d2-0ea4-45bc-ac68-78e97304a5f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:45.151719 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523454d2-0ea4-45bc-ac68-78e97304a5f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:45.151995 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523454d2-0ea4-45bc-ac68-78e97304a5f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:45.154042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-523454d2-0ea4-45bc-ac68-78e97304a5f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:45.212264 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:45.225258 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523454d2-0ea4-45bc-ac68-78e97304a5f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:45.226644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523454d2-0ea4-45bc-ac68-78e97304a5f3 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:45.236865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1357/2695] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:48.868321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fdc50-4881-41b0-a4e6-93a98109ccd7 service glance] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:48.870180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e75fdc50-4881-41b0-a4e6-93a98109ccd7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:48.885788 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fdc50-4881-41b0-a4e6-93a98109ccd7 service glance] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:48.891327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7f21f-8a0e-4a56-9ae5-f5f51a9b4cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:48.892036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7f21f-8a0e-4a56-9ae5-f5f51a9b4cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:48.892327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7f21f-8a0e-4a56-9ae5-f5f51a9b4cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:48.892609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7f21f-8a0e-4a56-9ae5-f5f51a9b4cf8 admin admin] PATH_INFO: `/v3/users/f73759f32c794f20bbab3a9887c9d37c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:48.893794 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7f21f-8a0e-4a56-9ae5-f5f51a9b4cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f73759f32c794f20bbab3a9887c9d37c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:48.895900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7f21f-8a0e-4a56-9ae5-f5f51a9b4cf8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:48.944694 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:48.947744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-24f7f21f-8a0e-4a56-9ae5-f5f51a9b4cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f73759f32c794f20bbab3a9887c9d37c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:48.962282 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-24f7f21f-8a0e-4a56-9ae5-f5f51a9b4cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f73759f32c794f20bbab3a9887c9d37c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:48.969279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-24f7f21f-8a0e-4a56-9ae5-f5f51a9b4cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f73759f32c794f20bbab3a9887c9d37c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:48.980562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-24f7f21f-8a0e-4a56-9ae5-f5f51a9b4cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f73759f32c794f20bbab3a9887c9d37c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:48.981380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-24f7f21f-8a0e-4a56-9ae5-f5f51a9b4cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f73759f32c794f20bbab3a9887c9d37c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:48.987935 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1339/2696] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:48 2022] DELETE /identity/v3/users/f73759f32c794f20bbab3a9887c9d37c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:49.173407 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523454d2-0ea4-45bc-ac68-78e97304a5f3 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:49.184834 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523454d2-0ea4-45bc-ac68-78e97304a5f3 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:49.244323 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:49.244890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.245159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.245426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8 admin admin] PATH_INFO: `/v3/projects/e7ba4e79b364426d834f7cd34d84cd17` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.246544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ba4e79b364426d834f7cd34d84cd17)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:49.248493 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:49.296396 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ba4e79b364426d834f7cd34d84cd17', 'request_id': 'req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:49.305758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ba4e79b364426d834f7cd34d84cd17', 'request_id': 'req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:49.311362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ba4e79b364426d834f7cd34d84cd17', 'request_id': 'req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:49.322919 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8 admin admin] The token cache is being invalidate because project e7ba4e79b364426d834f7cd34d84cd17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:49.323359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:49.324239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-a71c0bc9-fb6e-48b7-b7be-b1fe296b7ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:49.325921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1358/2697] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:49 2022] DELETE /identity/v3/projects/e7ba4e79b364426d834f7cd34d84cd17 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:49.331398 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342d175-4263-47f3-80ba-7fe4209fdbd6 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.331677 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342d175-4263-47f3-80ba-7fe4209fdbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.332078 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342d175-4263-47f3-80ba-7fe4209fdbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.353083 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2342d175-4263-47f3-80ba-7fe4209fdbd6 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:49.354290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2342d175-4263-47f3-80ba-7fe4209fdbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:49.415766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1340/2698] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:49.424485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a7006-b061-47e1-bc68-145f1d424bac None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.424833 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a7006-b061-47e1-bc68-145f1d424bac None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.425049 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a7006-b061-47e1-bc68-145f1d424bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.451921 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-425a7006-b061-47e1-bc68-145f1d424bac None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:49.453239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-425a7006-b061-47e1-bc68-145f1d424bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:49.462547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1359/2699] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:49.467036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342d175-4263-47f3-80ba-7fe4209fdbd6 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:49.477815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342d175-4263-47f3-80ba-7fe4209fdbd6 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:49.483287 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172e7ac-2015-4b76-9ce4-b4cb7e8dbd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:49.483932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e7ac-2015-4b76-9ce4-b4cb7e8dbd5e admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.484214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e7ac-2015-4b76-9ce4-b4cb7e8dbd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.484514 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e7ac-2015-4b76-9ce4-b4cb7e8dbd5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.485169 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172e7ac-2015-4b76-9ce4-b4cb7e8dbd5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:49.485469 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172e7ac-2015-4b76-9ce4-b4cb7e8dbd5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:49.487094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172e7ac-2015-4b76-9ce4-b4cb7e8dbd5e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:49.499338 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1341/2700] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:49.509411 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a7006-b061-47e1-bc68-145f1d424bac None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:49.519293 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a7006-b061-47e1-bc68-145f1d424bac None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:49.524196 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1c99-c73c-4b62-b759-aaa13599496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:49.524819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1c99-c73c-4b62-b759-aaa13599496a admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.525091 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1c99-c73c-4b62-b759-aaa13599496a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.525354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1c99-c73c-4b62-b759-aaa13599496a admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.526002 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1c99-c73c-4b62-b759-aaa13599496a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:49.527928 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1c99-c73c-4b62-b759-aaa13599496a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:49.565882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1360/2701] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:49 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:49.570370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172e7ac-2015-4b76-9ce4-b4cb7e8dbd5e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:49.580386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172e7ac-2015-4b76-9ce4-b4cb7e8dbd5e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:49.638018 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09b92f-61a3-439a-a0da-d21373f5276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:49.638637 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09b92f-61a3-439a-a0da-d21373f5276b admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.638917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09b92f-61a3-439a-a0da-d21373f5276b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.639196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09b92f-61a3-439a-a0da-d21373f5276b admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.639849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09b92f-61a3-439a-a0da-d21373f5276b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:49.641805 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09b92f-61a3-439a-a0da-d21373f5276b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:49.666050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1342/2702] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:49 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:49.672007 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1c99-c73c-4b62-b759-aaa13599496a admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:49.682631 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1c99-c73c-4b62-b759-aaa13599496a admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:49.687675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf42282-bac7-439a-b653-4f2fc60eaf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:49.688315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf42282-bac7-439a-b653-4f2fc60eaf61 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.688589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf42282-bac7-439a-b653-4f2fc60eaf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.688868 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf42282-bac7-439a-b653-4f2fc60eaf61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.689545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf42282-bac7-439a-b653-4f2fc60eaf61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:49.691148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf42282-bac7-439a-b653-4f2fc60eaf61 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:49.705702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1361/2703] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:49.710132 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09b92f-61a3-439a-a0da-d21373f5276b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:49.720893 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09b92f-61a3-439a-a0da-d21373f5276b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:49.726683 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62c4f7-37f3-4943-9fa4-973af71778dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:49.727407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62c4f7-37f3-4943-9fa4-973af71778dd admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.727682 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62c4f7-37f3-4943-9fa4-973af71778dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.727980 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62c4f7-37f3-4943-9fa4-973af71778dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.728701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62c4f7-37f3-4943-9fa4-973af71778dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:49.730386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62c4f7-37f3-4943-9fa4-973af71778dd admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:49.746086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1343/2704] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:49.747040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf42282-bac7-439a-b653-4f2fc60eaf61 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:49.757460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf42282-bac7-439a-b653-4f2fc60eaf61 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:49.762448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14656e81-10ed-491d-94e5-aad98a8a60b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:49.763088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14656e81-10ed-491d-94e5-aad98a8a60b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.763365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14656e81-10ed-491d-94e5-aad98a8a60b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.763635 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14656e81-10ed-491d-94e5-aad98a8a60b5 admin admin] PATH_INFO: `/v3/projects/ab2c51766b6e4ad2811d99432b8da45e/users/34cae2889a3049afbbfec74e46214d80/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.779816 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14656e81-10ed-491d-94e5-aad98a8a60b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2c51766b6e4ad2811d99432b8da45e, user_id=34cae2889a3049afbbfec74e46214d80, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:49.782774 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14656e81-10ed-491d-94e5-aad98a8a60b5 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:49.798015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1362/2705] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:49 2022] PUT /identity/v3/projects/ab2c51766b6e4ad2811d99432b8da45e/users/34cae2889a3049afbbfec74e46214d80/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:49.810093 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f9e9-7877-4230-997d-cfba97bc7d9a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.810422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f9e9-7877-4230-997d-cfba97bc7d9a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.810772 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f9e9-7877-4230-997d-cfba97bc7d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.838489 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1911f9e9-7877-4230-997d-cfba97bc7d9a None None] MFA Rules not processed for user `34cae2889a3049afbbfec74e46214d80`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:49.840078 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1911f9e9-7877-4230-997d-cfba97bc7d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:49.853106 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:49.919754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1344/2706] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:49.932413 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14656e81-10ed-491d-94e5-aad98a8a60b5 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:49.934365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-14656e81-10ed-491d-94e5-aad98a8a60b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:49.955898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:49.995737 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14656e81-10ed-491d-94e5-aad98a8a60b5 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:49.999613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dafafb-bbbd-4d7b-b9f7-a06fdfda52cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:50.000263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dafafb-bbbd-4d7b-b9f7-a06fdfda52cb service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:50.000526 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dafafb-bbbd-4d7b-b9f7-a06fdfda52cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:50.000795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dafafb-bbbd-4d7b-b9f7-a06fdfda52cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:50.009522 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dafafb-bbbd-4d7b-b9f7-a06fdfda52cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:50.010937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dafafb-bbbd-4d7b-b9f7-a06fdfda52cb service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:50.019746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1363/2707] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:58.560306 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911f9e9-7877-4230-997d-cfba97bc7d9a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:58.633077 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911f9e9-7877-4230-997d-cfba97bc7d9a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:58.637818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b05cc-b5c5-46c7-9553-bfd4bcbaca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:58.638431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b05cc-b5c5-46c7-9553-bfd4bcbaca94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:58.638716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b05cc-b5c5-46c7-9553-bfd4bcbaca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:58.638984 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b05cc-b5c5-46c7-9553-bfd4bcbaca94 admin admin] PATH_INFO: `/v3/users/34cae2889a3049afbbfec74e46214d80` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:58.640150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b05cc-b5c5-46c7-9553-bfd4bcbaca94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34cae2889a3049afbbfec74e46214d80)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:58.642069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b05cc-b5c5-46c7-9553-bfd4bcbaca94 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:58.693615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5f0b05cc-b5c5-46c7-9553-bfd4bcbaca94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34cae2889a3049afbbfec74e46214d80'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.711993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5f0b05cc-b5c5-46c7-9553-bfd4bcbaca94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34cae2889a3049afbbfec74e46214d80'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.719820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5f0b05cc-b5c5-46c7-9553-bfd4bcbaca94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34cae2889a3049afbbfec74e46214d80'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.729457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5f0b05cc-b5c5-46c7-9553-bfd4bcbaca94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34cae2889a3049afbbfec74e46214d80'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.730183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5f0b05cc-b5c5-46c7-9553-bfd4bcbaca94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34cae2889a3049afbbfec74e46214d80'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:58.736449 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1345/2708] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:58 2022] DELETE /identity/v3/users/34cae2889a3049afbbfec74e46214d80 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:58.741908 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cdf17-d457-463f-9a4b-b41ba02e8907 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:58.742436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cdf17-d457-463f-9a4b-b41ba02e8907 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:58.742565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cdf17-d457-463f-9a4b-b41ba02e8907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:58.762474 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-040cdf17-d457-463f-9a4b-b41ba02e8907 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:58.763678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-040cdf17-d457-463f-9a4b-b41ba02e8907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:58.825507 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1364/2709] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:58.837615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b05cc-b5c5-46c7-9553-bfd4bcbaca94 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:58.839219 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5f0b05cc-b5c5-46c7-9553-bfd4bcbaca94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:58.883630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:58.911148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b05cc-b5c5-46c7-9553-bfd4bcbaca94 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:58.916567 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0a127-5441-43f3-b317-76e7ca39f1d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:58.917170 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0a127-5441-43f3-b317-76e7ca39f1d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:58.917424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0a127-5441-43f3-b317-76e7ca39f1d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:58.917698 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0a127-5441-43f3-b317-76e7ca39f1d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:58.927954 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0a127-5441-43f3-b317-76e7ca39f1d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:58.929422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0a127-5441-43f3-b317-76e7ca39f1d6 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:58.939095 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1346/2710] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:59.217306 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cdf17-d457-463f-9a4b-b41ba02e8907 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.219192 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-040cdf17-d457-463f-9a4b-b41ba02e8907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:59.238865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cdf17-d457-463f-9a4b-b41ba02e8907 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.247606 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71b664-be10-4a4c-878d-569ccd3f4a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.248490 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71b664-be10-4a4c-878d-569ccd3f4a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.248951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71b664-be10-4a4c-878d-569ccd3f4a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.249372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71b664-be10-4a4c-878d-569ccd3f4a72 admin admin] PATH_INFO: `/v3/projects/ab2c51766b6e4ad2811d99432b8da45e` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.250839 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71b664-be10-4a4c-878d-569ccd3f4a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab2c51766b6e4ad2811d99432b8da45e)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.253028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71b664-be10-4a4c-878d-569ccd3f4a72 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.308178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ca71b664-be10-4a4c-878d-569ccd3f4a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab2c51766b6e4ad2811d99432b8da45e', 'request_id': 'req-ca71b664-be10-4a4c-878d-569ccd3f4a72'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:59.317457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ca71b664-be10-4a4c-878d-569ccd3f4a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab2c51766b6e4ad2811d99432b8da45e', 'request_id': 'req-ca71b664-be10-4a4c-878d-569ccd3f4a72'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:59.324053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ca71b664-be10-4a4c-878d-569ccd3f4a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab2c51766b6e4ad2811d99432b8da45e', 'request_id': 'req-ca71b664-be10-4a4c-878d-569ccd3f4a72'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:59.335597 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ca71b664-be10-4a4c-878d-569ccd3f4a72 admin admin] The token cache is being invalidate because project ab2c51766b6e4ad2811d99432b8da45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:59.335912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ca71b664-be10-4a4c-878d-569ccd3f4a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:59.336572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ca71b664-be10-4a4c-878d-569ccd3f4a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:59.338371 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1365/2711] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:59 2022] DELETE /identity/v3/projects/ab2c51766b6e4ad2811d99432b8da45e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:59.343207 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf95b6b-aa1b-4c01-8f39-9a5b87cef112 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.343517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf95b6b-aa1b-4c01-8f39-9a5b87cef112 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.343996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf95b6b-aa1b-4c01-8f39-9a5b87cef112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.366624 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-caf95b6b-aa1b-4c01-8f39-9a5b87cef112 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:59.367923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-caf95b6b-aa1b-4c01-8f39-9a5b87cef112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:59.429180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1347/2712] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:59.437594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2215cf7-9c69-430c-853b-9875042de5bb None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.437989 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2215cf7-9c69-430c-853b-9875042de5bb None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.438324 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2215cf7-9c69-430c-853b-9875042de5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.459754 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-f2215cf7-9c69-430c-853b-9875042de5bb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:59.461365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f2215cf7-9c69-430c-853b-9875042de5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:59.470485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1366/2713] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:59.474908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf95b6b-aa1b-4c01-8f39-9a5b87cef112 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.484829 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf95b6b-aa1b-4c01-8f39-9a5b87cef112 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.489626 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e999f-8c83-439f-b3a9-9851d0f8366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.490226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e999f-8c83-439f-b3a9-9851d0f8366f admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.490505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e999f-8c83-439f-b3a9-9851d0f8366f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.490777 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e999f-8c83-439f-b3a9-9851d0f8366f admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.491421 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e999f-8c83-439f-b3a9-9851d0f8366f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:59.491746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e999f-8c83-439f-b3a9-9851d0f8366f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.493410 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e999f-8c83-439f-b3a9-9851d0f8366f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.505651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1348/2714] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:59.510409 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2215cf7-9c69-430c-853b-9875042de5bb None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.520092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2215cf7-9c69-430c-853b-9875042de5bb None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.525028 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe609667-16ed-4bad-ac71-ac1492705f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.525629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe609667-16ed-4bad-ac71-ac1492705f86 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.525910 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe609667-16ed-4bad-ac71-ac1492705f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.526286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe609667-16ed-4bad-ac71-ac1492705f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.526986 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe609667-16ed-4bad-ac71-ac1492705f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.530290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe609667-16ed-4bad-ac71-ac1492705f86 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.561265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1367/2715] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:59 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:59.565737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e999f-8c83-439f-b3a9-9851d0f8366f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.577365 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e999f-8c83-439f-b3a9-9851d0f8366f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.634782 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdbb8c-cf24-42c3-90a5-f0a4e84bc022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.635386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdbb8c-cf24-42c3-90a5-f0a4e84bc022 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.635664 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdbb8c-cf24-42c3-90a5-f0a4e84bc022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.635965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdbb8c-cf24-42c3-90a5-f0a4e84bc022 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.636599 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdbb8c-cf24-42c3-90a5-f0a4e84bc022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.638508 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdbb8c-cf24-42c3-90a5-f0a4e84bc022 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.665767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1349/2716] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:59 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:59.670408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe609667-16ed-4bad-ac71-ac1492705f86 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.681055 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe609667-16ed-4bad-ac71-ac1492705f86 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.686003 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddcd47-aead-44ab-baa4-0c426c76e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.686594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddcd47-aead-44ab-baa4-0c426c76e052 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.686874 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddcd47-aead-44ab-baa4-0c426c76e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.687143 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddcd47-aead-44ab-baa4-0c426c76e052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.687825 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddcd47-aead-44ab-baa4-0c426c76e052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.689457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddcd47-aead-44ab-baa4-0c426c76e052 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.699502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1368/2717] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:59.703504 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdbb8c-cf24-42c3-90a5-f0a4e84bc022 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.713987 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdbb8c-cf24-42c3-90a5-f0a4e84bc022 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.718784 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1df04-3e2d-48c6-8306-4e5764eae322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.719386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1df04-3e2d-48c6-8306-4e5764eae322 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.719667 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1df04-3e2d-48c6-8306-4e5764eae322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.719976 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1df04-3e2d-48c6-8306-4e5764eae322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.720627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1df04-3e2d-48c6-8306-4e5764eae322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.722596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1df04-3e2d-48c6-8306-4e5764eae322 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.733321 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1350/2718] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:59.737696 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddcd47-aead-44ab-baa4-0c426c76e052 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.744002 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:59.748182 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddcd47-aead-44ab-baa4-0c426c76e052 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.755029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae598be-bc6e-4940-ad51-e39714bb8a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.755925 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae598be-bc6e-4940-ad51-e39714bb8a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.756203 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae598be-bc6e-4940-ad51-e39714bb8a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.756474 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae598be-bc6e-4940-ad51-e39714bb8a1e admin admin] PATH_INFO: `/v3/projects/be75d3b08bef4ab4b2f4d0bd362cc7d5/users/047bd6898b8e442bba722cf1009c5a20/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.772678 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae598be-bc6e-4940-ad51-e39714bb8a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be75d3b08bef4ab4b2f4d0bd362cc7d5, user_id=047bd6898b8e442bba722cf1009c5a20, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.775392 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae598be-bc6e-4940-ad51-e39714bb8a1e admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:59.791960 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1369/2719] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:59 2022] PUT /identity/v3/projects/be75d3b08bef4ab4b2f4d0bd362cc7d5/users/047bd6898b8e442bba722cf1009c5a20/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:59.804369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ada7de-c1b2-4084-8ad4-cc51cead6551 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.804651 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ada7de-c1b2-4084-8ad4-cc51cead6551 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.804945 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ada7de-c1b2-4084-8ad4-cc51cead6551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.832767 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-32ada7de-c1b2-4084-8ad4-cc51cead6551 None None] MFA Rules not processed for user `047bd6898b8e442bba722cf1009c5a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:59.833986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-32ada7de-c1b2-4084-8ad4-cc51cead6551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:59.869729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:59.914171 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1351/2720] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:27:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:59.919487 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae598be-bc6e-4940-ad51-e39714bb8a1e admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:59.984544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae598be-bc6e-4940-ad51-e39714bb8a1e admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:59.989745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b4565-e90d-4cf2-b81d-8ccb3bc9d422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:59.990342 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b4565-e90d-4cf2-b81d-8ccb3bc9d422 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:59.990616 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b4565-e90d-4cf2-b81d-8ccb3bc9d422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:59.990879 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b4565-e90d-4cf2-b81d-8ccb3bc9d422 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:59.991534 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b4565-e90d-4cf2-b81d-8ccb3bc9d422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:59.993525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b4565-e90d-4cf2-b81d-8ccb3bc9d422 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:00.021796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1370/2721] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:59 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:00.026335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ada7de-c1b2-4084-8ad4-cc51cead6551 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:00.037320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ada7de-c1b2-4084-8ad4-cc51cead6551 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:00.096304 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da696fab-7659-493b-a841-b500c93207c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:00.096908 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696fab-7659-493b-a841-b500c93207c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.097181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696fab-7659-493b-a841-b500c93207c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.097446 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696fab-7659-493b-a841-b500c93207c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.098067 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da696fab-7659-493b-a841-b500c93207c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:00.100000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da696fab-7659-493b-a841-b500c93207c9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:00.122934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1352/2722] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:00 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:00.127096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b4565-e90d-4cf2-b81d-8ccb3bc9d422 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:00.137613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b4565-e90d-4cf2-b81d-8ccb3bc9d422 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:00.142701 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8306b-13a1-498b-8107-76c1e463d38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:00.143497 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8306b-13a1-498b-8107-76c1e463d38c admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.143884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8306b-13a1-498b-8107-76c1e463d38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.144131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8306b-13a1-498b-8107-76c1e463d38c admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.144827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8306b-13a1-498b-8107-76c1e463d38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:00.146432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8306b-13a1-498b-8107-76c1e463d38c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:00.158081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1371/2723] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:00.162515 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da696fab-7659-493b-a841-b500c93207c9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:00.173569 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da696fab-7659-493b-a841-b500c93207c9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:00.178506 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68553b-932e-4cd8-ae2e-62271cb29de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:00.179172 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68553b-932e-4cd8-ae2e-62271cb29de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.179433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68553b-932e-4cd8-ae2e-62271cb29de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.179737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68553b-932e-4cd8-ae2e-62271cb29de3 admin admin] PATH_INFO: `/v3/projects/f34f303608b64dcf8482ecf3e7286309/users/008bb0ec03154c37bc4137bedbdd5953/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.195383 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68553b-932e-4cd8-ae2e-62271cb29de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34f303608b64dcf8482ecf3e7286309, user_id=008bb0ec03154c37bc4137bedbdd5953, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:00.198088 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68553b-932e-4cd8-ae2e-62271cb29de3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:00.213917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1353/2724] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:00 2022] PUT /identity/v3/projects/f34f303608b64dcf8482ecf3e7286309/users/008bb0ec03154c37bc4137bedbdd5953/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:00.219080 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8306b-13a1-498b-8107-76c1e463d38c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:00.229625 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8306b-13a1-498b-8107-76c1e463d38c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:00.290418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7eaba2-1c47-410d-b538-4c58d68f5069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:00.290945 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eaba2-1c47-410d-b538-4c58d68f5069 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.291219 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eaba2-1c47-410d-b538-4c58d68f5069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.291496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eaba2-1c47-410d-b538-4c58d68f5069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.292178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7eaba2-1c47-410d-b538-4c58d68f5069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:00.294133 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7eaba2-1c47-410d-b538-4c58d68f5069 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:00.303885 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1372/2725] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:00.308438 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68553b-932e-4cd8-ae2e-62271cb29de3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:00.319154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68553b-932e-4cd8-ae2e-62271cb29de3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:00.324718 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4eace-e095-4cc9-90ba-3474acb487b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:00.325352 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4eace-e095-4cc9-90ba-3474acb487b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.325629 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4eace-e095-4cc9-90ba-3474acb487b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.325900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4eace-e095-4cc9-90ba-3474acb487b2 admin admin] PATH_INFO: `/v3/projects/f34f303608b64dcf8482ecf3e7286309/users/008bb0ec03154c37bc4137bedbdd5953/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.328060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4eace-e095-4cc9-90ba-3474acb487b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34f303608b64dcf8482ecf3e7286309, user_id=008bb0ec03154c37bc4137bedbdd5953, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:00.330786 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4eace-e095-4cc9-90ba-3474acb487b2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:00.341534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1354/2726] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:00 2022] PUT /identity/v3/projects/f34f303608b64dcf8482ecf3e7286309/users/008bb0ec03154c37bc4137bedbdd5953/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:00.351912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e735c9c-66a6-48e3-8a60-b86ba6ad92fd None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.352250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e735c9c-66a6-48e3-8a60-b86ba6ad92fd None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.352538 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e735c9c-66a6-48e3-8a60-b86ba6ad92fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.387176 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5e735c9c-66a6-48e3-8a60-b86ba6ad92fd None None] MFA Rules not processed for user `008bb0ec03154c37bc4137bedbdd5953`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:00.388453 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5e735c9c-66a6-48e3-8a60-b86ba6ad92fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:00.437294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:00.469825 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1373/2727] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:00.483038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4eace-e095-4cc9-90ba-3474acb487b2 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:00.484846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b6e4eace-e095-4cc9-90ba-3474acb487b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:00.542075 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4eace-e095-4cc9-90ba-3474acb487b2 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:00.546300 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b53c1a-3ce1-4627-b997-dd56b2d14574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:00.546900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b53c1a-3ce1-4627-b997-dd56b2d14574 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.547179 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b53c1a-3ce1-4627-b997-dd56b2d14574 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.547444 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b53c1a-3ce1-4627-b997-dd56b2d14574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.556726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b53c1a-3ce1-4627-b997-dd56b2d14574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:00.558151 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b53c1a-3ce1-4627-b997-dd56b2d14574 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:00.567440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1355/2728] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:00.652941 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e735c9c-66a6-48e3-8a60-b86ba6ad92fd None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:00.663672 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e735c9c-66a6-48e3-8a60-b86ba6ad92fd None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:00.668524 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396e6f7-8c58-4613-9289-de5dea20d882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:00.669195 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e6f7-8c58-4613-9289-de5dea20d882 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.669484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e6f7-8c58-4613-9289-de5dea20d882 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.669716 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e6f7-8c58-4613-9289-de5dea20d882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.730970 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396e6f7-8c58-4613-9289-de5dea20d882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:00.732550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396e6f7-8c58-4613-9289-de5dea20d882 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:00.742025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1374/2729] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:02.669792 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b53c1a-3ce1-4627-b997-dd56b2d14574 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.671431 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-82b53c1a-3ce1-4627-b997-dd56b2d14574 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:02.705984 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:02.741581 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b53c1a-3ce1-4627-b997-dd56b2d14574 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:02.746545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32531fa6-afa6-4b25-901e-3c8feb726536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:02.747167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32531fa6-afa6-4b25-901e-3c8feb726536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.747439 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32531fa6-afa6-4b25-901e-3c8feb726536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.747715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32531fa6-afa6-4b25-901e-3c8feb726536 admin admin] PATH_INFO: `/v3/users/d55a090989b74708bcff35312768ea82` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.748836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32531fa6-afa6-4b25-901e-3c8feb726536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55a090989b74708bcff35312768ea82)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:02.750867 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32531fa6-afa6-4b25-901e-3c8feb726536 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:02.803017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-32531fa6-afa6-4b25-901e-3c8feb726536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55a090989b74708bcff35312768ea82'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:02.816183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-32531fa6-afa6-4b25-901e-3c8feb726536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55a090989b74708bcff35312768ea82'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:02.823298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-32531fa6-afa6-4b25-901e-3c8feb726536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55a090989b74708bcff35312768ea82'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:02.831749 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-32531fa6-afa6-4b25-901e-3c8feb726536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55a090989b74708bcff35312768ea82'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:02.832370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-32531fa6-afa6-4b25-901e-3c8feb726536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55a090989b74708bcff35312768ea82'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:02.838419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1356/2730] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:02 2022] DELETE /identity/v3/users/d55a090989b74708bcff35312768ea82 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:02.843137 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0737443-c255-4bf8-b65e-9c892ead2b86 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.843633 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0737443-c255-4bf8-b65e-9c892ead2b86 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.843755 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0737443-c255-4bf8-b65e-9c892ead2b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.862991 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-b0737443-c255-4bf8-b65e-9c892ead2b86 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:02.864221 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b0737443-c255-4bf8-b65e-9c892ead2b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:02.926375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1375/2731] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:02.936327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32531fa6-afa6-4b25-901e-3c8feb726536 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.937824 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-32531fa6-afa6-4b25-901e-3c8feb726536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:02.994804 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32531fa6-afa6-4b25-901e-3c8feb726536 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:02.998826 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0bc32-738c-4296-a2df-27da4d562559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:02.999427 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0bc32-738c-4296-a2df-27da4d562559 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.999722 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0bc32-738c-4296-a2df-27da4d562559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.999990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0bc32-738c-4296-a2df-27da4d562559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:03.009772 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0bc32-738c-4296-a2df-27da4d562559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:03.012032 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0bc32-738c-4296-a2df-27da4d562559 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:03.026950 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1357/2732] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:28:03.307747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0737443-c255-4bf8-b65e-9c892ead2b86 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:03.309473 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b0737443-c255-4bf8-b65e-9c892ead2b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:03.323081 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0737443-c255-4bf8-b65e-9c892ead2b86 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:03.329503 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:03.330159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:03.330438 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:03.330709 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2 admin admin] PATH_INFO: `/v3/projects/95fe77bec88744a09692af9cf2f61dce` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:03.331869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95fe77bec88744a09692af9cf2f61dce)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:03.333791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:03.386486 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95fe77bec88744a09692af9cf2f61dce', 'request_id': 'req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:03.395547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95fe77bec88744a09692af9cf2f61dce', 'request_id': 'req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:03.401868 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95fe77bec88744a09692af9cf2f61dce', 'request_id': 'req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:03.410887 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:03.416308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2 admin admin] The token cache is being invalidate because project 95fe77bec88744a09692af9cf2f61dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:03.416657 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:03.417759 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-79328573-a327-40ca-b6d4-8e1a7c8bb7d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:03.420443 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1376/2733] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:03 2022] DELETE /identity/v3/projects/95fe77bec88744a09692af9cf2f61dce => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:03.424999 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0aa403-e1fe-4238-9698-bdb217e2e780 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:03.425291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0aa403-e1fe-4238-9698-bdb217e2e780 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:03.425570 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0aa403-e1fe-4238-9698-bdb217e2e780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:03.445328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4b0aa403-e1fe-4238-9698-bdb217e2e780 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:03.446460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4b0aa403-e1fe-4238-9698-bdb217e2e780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:03.497608 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:03.529686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1358/2734] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:03.538871 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c185040-8ce6-4462-b317-db100fd38485 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:03.539224 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c185040-8ce6-4462-b317-db100fd38485 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:03.539501 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c185040-8ce6-4462-b317-db100fd38485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:03.564979 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5c185040-8ce6-4462-b317-db100fd38485 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:03.566017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5c185040-8ce6-4462-b317-db100fd38485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:03.574586 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1377/2735] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:03.579594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0aa403-e1fe-4238-9698-bdb217e2e780 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:03.594286 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0aa403-e1fe-4238-9698-bdb217e2e780 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:03.604051 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfcc8e-06c5-4ef4-a7f5-b122557bd90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:03.605028 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfcc8e-06c5-4ef4-a7f5-b122557bd90f admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:03.605340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfcc8e-06c5-4ef4-a7f5-b122557bd90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:03.605775 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfcc8e-06c5-4ef4-a7f5-b122557bd90f admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:03.606715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfcc8e-06c5-4ef4-a7f5-b122557bd90f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:03.607061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfcc8e-06c5-4ef4-a7f5-b122557bd90f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:03.608706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfcc8e-06c5-4ef4-a7f5-b122557bd90f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:03.622720 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1359/2736] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:28:03.629857 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c185040-8ce6-4462-b317-db100fd38485 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:03.643038 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c185040-8ce6-4462-b317-db100fd38485 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:03.650025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d7d45-3a46-4373-9c88-d4ac36c906be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:03.650809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d7d45-3a46-4373-9c88-d4ac36c906be admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:03.651141 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d7d45-3a46-4373-9c88-d4ac36c906be admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:03.651442 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d7d45-3a46-4373-9c88-d4ac36c906be admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:03.652468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d7d45-3a46-4373-9c88-d4ac36c906be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:03.654902 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d7d45-3a46-4373-9c88-d4ac36c906be admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:03.684362 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1378/2737] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:03 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:03.688934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfcc8e-06c5-4ef4-a7f5-b122557bd90f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:03.699126 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfcc8e-06c5-4ef4-a7f5-b122557bd90f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:03.757994 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519ccfb-8314-46a5-a9bc-0326c9d1bad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:03.758627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519ccfb-8314-46a5-a9bc-0326c9d1bad0 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:03.758904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519ccfb-8314-46a5-a9bc-0326c9d1bad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:03.759197 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519ccfb-8314-46a5-a9bc-0326c9d1bad0 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:03.759862 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519ccfb-8314-46a5-a9bc-0326c9d1bad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:03.761768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519ccfb-8314-46a5-a9bc-0326c9d1bad0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:03.785422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1360/2738] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:03 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:03.789637 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d7d45-3a46-4373-9c88-d4ac36c906be admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:03.801557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d7d45-3a46-4373-9c88-d4ac36c906be admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:03.807001 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f1067-5f92-483a-85bd-3dabdf14adbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:03.807768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f1067-5f92-483a-85bd-3dabdf14adbb admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:03.808069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f1067-5f92-483a-85bd-3dabdf14adbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:03.808331 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f1067-5f92-483a-85bd-3dabdf14adbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:03.809047 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f1067-5f92-483a-85bd-3dabdf14adbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:03.810899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f1067-5f92-483a-85bd-3dabdf14adbb admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:03.821173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1379/2739] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:03.825232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519ccfb-8314-46a5-a9bc-0326c9d1bad0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:03.835284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519ccfb-8314-46a5-a9bc-0326c9d1bad0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:03.840375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72181595-d82d-435d-9973-aca0def731ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:03.840953 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72181595-d82d-435d-9973-aca0def731ef admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:03.841303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72181595-d82d-435d-9973-aca0def731ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:03.841576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72181595-d82d-435d-9973-aca0def731ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:03.842223 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72181595-d82d-435d-9973-aca0def731ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:03.843845 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72181595-d82d-435d-9973-aca0def731ef admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:03.854819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1361/2740] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:03.859053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f1067-5f92-483a-85bd-3dabdf14adbb admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:03.869274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f1067-5f92-483a-85bd-3dabdf14adbb admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:03.874453 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef124485-4ac3-458e-9bce-d7c48d9ce96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:03.875088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef124485-4ac3-458e-9bce-d7c48d9ce96b admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:03.875364 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef124485-4ac3-458e-9bce-d7c48d9ce96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:03.875634 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef124485-4ac3-458e-9bce-d7c48d9ce96b admin admin] PATH_INFO: `/v3/projects/f2ba57e0319d45c4b7f172b47157a5a6/users/447d97b46249439fa9c469afa6ae4072/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:03.890630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef124485-4ac3-458e-9bce-d7c48d9ce96b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ba57e0319d45c4b7f172b47157a5a6, user_id=447d97b46249439fa9c469afa6ae4072, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:03.893416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef124485-4ac3-458e-9bce-d7c48d9ce96b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:03.910223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1380/2741] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:03 2022] PUT /identity/v3/projects/f2ba57e0319d45c4b7f172b47157a5a6/users/447d97b46249439fa9c469afa6ae4072/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:03.923139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d410e-54e3-49eb-b505-ebd31c6e8e40 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:03.923490 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d410e-54e3-49eb-b505-ebd31c6e8e40 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:03.923941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d410e-54e3-49eb-b505-ebd31c6e8e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:03.956392 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-538d410e-54e3-49eb-b505-ebd31c6e8e40 None None] MFA Rules not processed for user `447d97b46249439fa9c469afa6ae4072`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:03.957516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-538d410e-54e3-49eb-b505-ebd31c6e8e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:04.022621 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1362/2742] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:04.034308 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef124485-4ac3-458e-9bce-d7c48d9ce96b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:04.036398 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ef124485-4ac3-458e-9bce-d7c48d9ce96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:04.096758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef124485-4ac3-458e-9bce-d7c48d9ce96b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:04.100908 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825a158-d1d1-4cb5-ba82-2df5e173d020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:04.101512 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825a158-d1d1-4cb5-ba82-2df5e173d020 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:04.101791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825a158-d1d1-4cb5-ba82-2df5e173d020 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:04.102074 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825a158-d1d1-4cb5-ba82-2df5e173d020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:04.110745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825a158-d1d1-4cb5-ba82-2df5e173d020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:04.112216 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825a158-d1d1-4cb5-ba82-2df5e173d020 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:04.121204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1381/2743] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:05.506419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619387b1-ebd9-4ee5-a5fd-2e580f030104 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:05.507039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619387b1-ebd9-4ee5-a5fd-2e580f030104 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:05.507039 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619387b1-ebd9-4ee5-a5fd-2e580f030104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:05.526993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-619387b1-ebd9-4ee5-a5fd-2e580f030104 None None] MFA Rules not processed for user `447d97b46249439fa9c469afa6ae4072`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:05.528214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-619387b1-ebd9-4ee5-a5fd-2e580f030104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:05.535408 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1363/2744] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:14.117531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:15.521728 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:20.590461 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9d542-b87a-49fc-81c1-5b5decb23930 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:20.591015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9d542-b87a-49fc-81c1-5b5decb23930 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:20.591184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9d542-b87a-49fc-81c1-5b5decb23930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:20.614166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-0ec9d542-b87a-49fc-81c1-5b5decb23930 None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:20.615367 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-0ec9d542-b87a-49fc-81c1-5b5decb23930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:20.676309 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1382/2745] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:28:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:20.723833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619387b1-ebd9-4ee5-a5fd-2e580f030104 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:20.725303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-619387b1-ebd9-4ee5-a5fd-2e580f030104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:20.795466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619387b1-ebd9-4ee5-a5fd-2e580f030104 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:20.803119 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62575f11-15c1-4810-b6bb-68a5a07c35e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:20.803761 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62575f11-15c1-4810-b6bb-68a5a07c35e7 service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:20.804040 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62575f11-15c1-4810-b6bb-68a5a07c35e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:20.804311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62575f11-15c1-4810-b6bb-68a5a07c35e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:20.812921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62575f11-15c1-4810-b6bb-68a5a07c35e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:20.814588 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62575f11-15c1-4810-b6bb-68a5a07c35e7 service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:20.823584 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1364/2746] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:28:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:28:21.367387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf8d39-9d2c-49fe-a007-bfb71022b998 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:21.367673 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf8d39-9d2c-49fe-a007-bfb71022b998 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:21.367990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf8d39-9d2c-49fe-a007-bfb71022b998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:21.387042 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-9cbf8d39-9d2c-49fe-a007-bfb71022b998 None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:21.388256 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-9cbf8d39-9d2c-49fe-a007-bfb71022b998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:21.395525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1383/2747] 10.222.0.50 () {58 vars in 967 bytes} [Wed Aug 31 00:28:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:21.408072 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62575f11-15c1-4810-b6bb-68a5a07c35e7 service swift] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:21.419640 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62575f11-15c1-4810-b6bb-68a5a07c35e7 service swift] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:21.425357 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd14f16-0dff-415a-8ad8-b6fcbc8a45e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:21.425957 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd14f16-0dff-415a-8ad8-b6fcbc8a45e3 service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:21.426237 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd14f16-0dff-415a-8ad8-b6fcbc8a45e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:21.426510 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd14f16-0dff-415a-8ad8-b6fcbc8a45e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:21.435546 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd14f16-0dff-415a-8ad8-b6fcbc8a45e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:21.437131 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd14f16-0dff-415a-8ad8-b6fcbc8a45e3 service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:21.445708 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1365/2748] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:28:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:28:21.678629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e945e2-39bd-4c38-a361-6c33d8ec285f None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:21.679134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e945e2-39bd-4c38-a361-6c33d8ec285f None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:21.679134 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e945e2-39bd-4c38-a361-6c33d8ec285f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:21.702359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-52e945e2-39bd-4c38-a361-6c33d8ec285f None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:21.703510 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-52e945e2-39bd-4c38-a361-6c33d8ec285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:21.711578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1384/2749] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:28:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:21.723760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd14f16-0dff-415a-8ad8-b6fcbc8a45e3 service swift] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:21.734686 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd14f16-0dff-415a-8ad8-b6fcbc8a45e3 service swift] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:21.740095 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85cbd7-b6de-4cb0-baf0-085fb171c598 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:21.740679 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85cbd7-b6de-4cb0-baf0-085fb171c598 service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:21.740970 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85cbd7-b6de-4cb0-baf0-085fb171c598 service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:21.741261 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85cbd7-b6de-4cb0-baf0-085fb171c598 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:21.749277 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85cbd7-b6de-4cb0-baf0-085fb171c598 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:21.750837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85cbd7-b6de-4cb0-baf0-085fb171c598 service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:21.758895 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1366/2750] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:28:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:28:22.115718 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368f76d-d987-4fa0-87e2-a69363153fbe None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:22.116065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368f76d-d987-4fa0-87e2-a69363153fbe None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:22.116405 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368f76d-d987-4fa0-87e2-a69363153fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:22.136483 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-6368f76d-d987-4fa0-87e2-a69363153fbe None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:22.137796 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-6368f76d-d987-4fa0-87e2-a69363153fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:22.145801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1385/2751] 10.222.0.50 () {58 vars in 967 bytes} [Wed Aug 31 00:28:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:22.158328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85cbd7-b6de-4cb0-baf0-085fb171c598 service swift] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:22.170163 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85cbd7-b6de-4cb0-baf0-085fb171c598 service swift] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:22.175582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a62cd-7a9d-4af4-8daa-d00b6933ba05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:22.176220 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a62cd-7a9d-4af4-8daa-d00b6933ba05 service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:22.176505 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a62cd-7a9d-4af4-8daa-d00b6933ba05 service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:22.176777 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a62cd-7a9d-4af4-8daa-d00b6933ba05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:22.186153 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a62cd-7a9d-4af4-8daa-d00b6933ba05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:22.187846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a62cd-7a9d-4af4-8daa-d00b6933ba05 service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:22.196080 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1367/2752] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:28:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:28:24.344545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368f76d-d987-4fa0-87e2-a69363153fbe None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:24.424247 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368f76d-d987-4fa0-87e2-a69363153fbe None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:24.429131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c4053-3148-4771-abb1-8a7a806e1602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:24.429751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4053-3148-4771-abb1-8a7a806e1602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:24.430021 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4053-3148-4771-abb1-8a7a806e1602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:24.430283 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4053-3148-4771-abb1-8a7a806e1602 admin admin] PATH_INFO: `/v3/users/447d97b46249439fa9c469afa6ae4072` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:24.431447 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c4053-3148-4771-abb1-8a7a806e1602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=447d97b46249439fa9c469afa6ae4072)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:24.433465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c4053-3148-4771-abb1-8a7a806e1602 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:24.484616 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9b2c4053-3148-4771-abb1-8a7a806e1602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '447d97b46249439fa9c469afa6ae4072'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:24.497270 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9b2c4053-3148-4771-abb1-8a7a806e1602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '447d97b46249439fa9c469afa6ae4072'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:24.504722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9b2c4053-3148-4771-abb1-8a7a806e1602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '447d97b46249439fa9c469afa6ae4072'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:24.513794 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9b2c4053-3148-4771-abb1-8a7a806e1602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '447d97b46249439fa9c469afa6ae4072'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:24.514590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-9b2c4053-3148-4771-abb1-8a7a806e1602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '447d97b46249439fa9c469afa6ae4072'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:24.521802 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1386/2753] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:24 2022] DELETE /identity/v3/users/447d97b46249439fa9c469afa6ae4072 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:24.526475 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d9594-f299-43aa-85fe-59b2cb4630f2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:24.526956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d9594-f299-43aa-85fe-59b2cb4630f2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:24.527069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d9594-f299-43aa-85fe-59b2cb4630f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:24.548516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c54d9594-f299-43aa-85fe-59b2cb4630f2 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:24.549719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c54d9594-f299-43aa-85fe-59b2cb4630f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:24.609195 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1368/2754] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:24.619120 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c4053-3148-4771-abb1-8a7a806e1602 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:24.620631 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-9b2c4053-3148-4771-abb1-8a7a806e1602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:24.629144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:24.687882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c4053-3148-4771-abb1-8a7a806e1602 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:24.691789 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a76d6d-ff67-4b9c-8767-290669f43142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:24.692409 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a76d6d-ff67-4b9c-8767-290669f43142 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:24.692740 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a76d6d-ff67-4b9c-8767-290669f43142 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:24.692996 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a76d6d-ff67-4b9c-8767-290669f43142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:24.703021 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a76d6d-ff67-4b9c-8767-290669f43142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:24.704583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a76d6d-ff67-4b9c-8767-290669f43142 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:24.714444 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1387/2755] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:24.901235 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d9594-f299-43aa-85fe-59b2cb4630f2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:24.902827 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c54d9594-f299-43aa-85fe-59b2cb4630f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:24.915495 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d9594-f299-43aa-85fe-59b2cb4630f2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:24.920847 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca37d1d-3bad-4c0a-9404-36e89d448aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:24.921486 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca37d1d-3bad-4c0a-9404-36e89d448aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:24.921939 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca37d1d-3bad-4c0a-9404-36e89d448aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:24.922216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca37d1d-3bad-4c0a-9404-36e89d448aca admin admin] PATH_INFO: `/v3/projects/f2ba57e0319d45c4b7f172b47157a5a6` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:24.923336 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca37d1d-3bad-4c0a-9404-36e89d448aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ba57e0319d45c4b7f172b47157a5a6)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:24.925270 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca37d1d-3bad-4c0a-9404-36e89d448aca admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:24.971029 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:24.974134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7ca37d1d-3bad-4c0a-9404-36e89d448aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ba57e0319d45c4b7f172b47157a5a6', 'request_id': 'req-7ca37d1d-3bad-4c0a-9404-36e89d448aca'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:24.983007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7ca37d1d-3bad-4c0a-9404-36e89d448aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ba57e0319d45c4b7f172b47157a5a6', 'request_id': 'req-7ca37d1d-3bad-4c0a-9404-36e89d448aca'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:24.988553 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7ca37d1d-3bad-4c0a-9404-36e89d448aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ba57e0319d45c4b7f172b47157a5a6', 'request_id': 'req-7ca37d1d-3bad-4c0a-9404-36e89d448aca'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:24.999556 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7ca37d1d-3bad-4c0a-9404-36e89d448aca admin admin] The token cache is being invalidate because project f2ba57e0319d45c4b7f172b47157a5a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:24.999887 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7ca37d1d-3bad-4c0a-9404-36e89d448aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:25.000511 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7ca37d1d-3bad-4c0a-9404-36e89d448aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:25.002003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1369/2756] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:24 2022] DELETE /identity/v3/projects/f2ba57e0319d45c4b7f172b47157a5a6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:25.007489 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7768f0b-0ae5-461a-8dad-c87150e6f8cb None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:25.007809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7768f0b-0ae5-461a-8dad-c87150e6f8cb None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:25.008082 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7768f0b-0ae5-461a-8dad-c87150e6f8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:25.028629 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-b7768f0b-0ae5-461a-8dad-c87150e6f8cb None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:25.029848 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b7768f0b-0ae5-461a-8dad-c87150e6f8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:25.090648 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1388/2757] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:25.098890 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe1c8a-c9aa-42c8-96b2-5f74c50c675d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:25.099332 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe1c8a-c9aa-42c8-96b2-5f74c50c675d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:25.099644 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe1c8a-c9aa-42c8-96b2-5f74c50c675d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:25.119826 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7dbe1c8a-c9aa-42c8-96b2-5f74c50c675d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:25.121033 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7dbe1c8a-c9aa-42c8-96b2-5f74c50c675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:25.128978 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1370/2758] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:25.133370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7768f0b-0ae5-461a-8dad-c87150e6f8cb None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:25.143644 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7768f0b-0ae5-461a-8dad-c87150e6f8cb None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:25.148954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2eebb-2a59-4e19-a774-25c6f59d7cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:25.149589 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2eebb-2a59-4e19-a774-25c6f59d7cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:25.149838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2eebb-2a59-4e19-a774-25c6f59d7cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:25.150109 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2eebb-2a59-4e19-a774-25c6f59d7cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:25.150763 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2eebb-2a59-4e19-a774-25c6f59d7cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:25.151068 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2eebb-2a59-4e19-a774-25c6f59d7cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:25.152745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2eebb-2a59-4e19-a774-25c6f59d7cfb admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:25.165305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1389/2759] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:28:25.170189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe1c8a-c9aa-42c8-96b2-5f74c50c675d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:25.179382 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe1c8a-c9aa-42c8-96b2-5f74c50c675d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:25.184461 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7279c2c-ba7d-4d75-a472-e6b89de7c7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:25.185061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7279c2c-ba7d-4d75-a472-e6b89de7c7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:25.185340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7279c2c-ba7d-4d75-a472-e6b89de7c7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:25.185612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7279c2c-ba7d-4d75-a472-e6b89de7c7e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:25.186265 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7279c2c-ba7d-4d75-a472-e6b89de7c7e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:25.188263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7279c2c-ba7d-4d75-a472-e6b89de7c7e3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:25.224282 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1371/2760] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:25 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:25.228702 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2eebb-2a59-4e19-a774-25c6f59d7cfb admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:25.238883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2eebb-2a59-4e19-a774-25c6f59d7cfb admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:25.296957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605cafa-ae1c-46de-8ae5-1b79e8f4e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:25.297569 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605cafa-ae1c-46de-8ae5-1b79e8f4e7bc admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:25.297835 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605cafa-ae1c-46de-8ae5-1b79e8f4e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:25.298099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605cafa-ae1c-46de-8ae5-1b79e8f4e7bc admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:25.298730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605cafa-ae1c-46de-8ae5-1b79e8f4e7bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:25.300700 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605cafa-ae1c-46de-8ae5-1b79e8f4e7bc admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:25.324669 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1390/2761] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:25 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:25.328902 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7279c2c-ba7d-4d75-a472-e6b89de7c7e3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:25.339738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7279c2c-ba7d-4d75-a472-e6b89de7c7e3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:25.344692 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788261a8-2bc0-4eec-ba97-3b46b7d9d505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:25.345291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788261a8-2bc0-4eec-ba97-3b46b7d9d505 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:25.345596 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788261a8-2bc0-4eec-ba97-3b46b7d9d505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:25.345854 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788261a8-2bc0-4eec-ba97-3b46b7d9d505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:25.346489 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788261a8-2bc0-4eec-ba97-3b46b7d9d505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:25.348129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788261a8-2bc0-4eec-ba97-3b46b7d9d505 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:25.358131 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1372/2762] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:25.362328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605cafa-ae1c-46de-8ae5-1b79e8f4e7bc admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:25.372883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605cafa-ae1c-46de-8ae5-1b79e8f4e7bc admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:25.378832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c2fdb-da02-4fa4-8f38-046cdb64f189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:25.379424 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c2fdb-da02-4fa4-8f38-046cdb64f189 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:25.379727 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c2fdb-da02-4fa4-8f38-046cdb64f189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:25.380011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c2fdb-da02-4fa4-8f38-046cdb64f189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:25.380691 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c2fdb-da02-4fa4-8f38-046cdb64f189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:25.382289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c2fdb-da02-4fa4-8f38-046cdb64f189 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:25.393607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1391/2763] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:25.397963 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788261a8-2bc0-4eec-ba97-3b46b7d9d505 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:25.408998 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788261a8-2bc0-4eec-ba97-3b46b7d9d505 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:25.414715 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d800140-f2e5-4424-aa0a-bc87b30a33e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:25.415358 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d800140-f2e5-4424-aa0a-bc87b30a33e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:25.415638 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d800140-f2e5-4424-aa0a-bc87b30a33e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:25.415949 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d800140-f2e5-4424-aa0a-bc87b30a33e4 admin admin] PATH_INFO: `/v3/projects/1c95ccd777c74d1d87aceb07b13c3947/users/6b1c626bcfc8445eab2006fb4b69c4ff/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:25.432292 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d800140-f2e5-4424-aa0a-bc87b30a33e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c95ccd777c74d1d87aceb07b13c3947, user_id=6b1c626bcfc8445eab2006fb4b69c4ff, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:25.434919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d800140-f2e5-4424-aa0a-bc87b30a33e4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:25.451326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1373/2764] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:25 2022] PUT /identity/v3/projects/1c95ccd777c74d1d87aceb07b13c3947/users/6b1c626bcfc8445eab2006fb4b69c4ff/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:25.458480 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f860f-ea0a-4bd4-92e3-f7ffa331e565 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:25.458862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f860f-ea0a-4bd4-92e3-f7ffa331e565 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:25.459253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f860f-ea0a-4bd4-92e3-f7ffa331e565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:25.482645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-902f860f-ea0a-4bd4-92e3-f7ffa331e565 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:25.483878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-902f860f-ea0a-4bd4-92e3-f7ffa331e565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:25.493361 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:25.552528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1392/2765] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:25.562662 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d800140-f2e5-4424-aa0a-bc87b30a33e4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:25.564642 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9d800140-f2e5-4424-aa0a-bc87b30a33e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:25.625708 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d800140-f2e5-4424-aa0a-bc87b30a33e4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:25.629564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeee25-6dae-468b-b8ea-55fdfe66fb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:25.630167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeee25-6dae-468b-b8ea-55fdfe66fb0e service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:25.630445 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeee25-6dae-468b-b8ea-55fdfe66fb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:25.630714 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeee25-6dae-468b-b8ea-55fdfe66fb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:25.639822 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aeee25-6dae-468b-b8ea-55fdfe66fb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:25.641237 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aeee25-6dae-468b-b8ea-55fdfe66fb0e service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:25.651436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1374/2766] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:29.739450 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f58cc-b090-47f4-867e-408cfa49e29f None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:29.740092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f58cc-b090-47f4-867e-408cfa49e29f None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:29.740092 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f58cc-b090-47f4-867e-408cfa49e29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:29.769527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-db4f58cc-b090-47f4-867e-408cfa49e29f None None] MFA Rules not processed for user `6b1c626bcfc8445eab2006fb4b69c4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:29.771036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-db4f58cc-b090-47f4-867e-408cfa49e29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:29.845620 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1393/2767] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:29.851165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeee25-6dae-468b-b8ea-55fdfe66fb0e service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:29.861465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeee25-6dae-468b-b8ea-55fdfe66fb0e service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:29.866803 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4232205-4766-4ef7-b46d-21e6b5da94bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:29.867557 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232205-4766-4ef7-b46d-21e6b5da94bd admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:29.868167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232205-4766-4ef7-b46d-21e6b5da94bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:29.868434 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232205-4766-4ef7-b46d-21e6b5da94bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:29.869106 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4232205-4766-4ef7-b46d-21e6b5da94bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:29.870990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4232205-4766-4ef7-b46d-21e6b5da94bd admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:29.900848 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1375/2768] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:29 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:29.905135 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f58cc-b090-47f4-867e-408cfa49e29f None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:29.916096 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f58cc-b090-47f4-867e-408cfa49e29f None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:29.975140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43f155-f3c6-48df-b90f-289992b3f81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:29.975791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43f155-f3c6-48df-b90f-289992b3f81c admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:29.976087 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43f155-f3c6-48df-b90f-289992b3f81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:29.976329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43f155-f3c6-48df-b90f-289992b3f81c admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:29.977013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43f155-f3c6-48df-b90f-289992b3f81c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:29.978935 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43f155-f3c6-48df-b90f-289992b3f81c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:30.003113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1394/2769] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:29 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:30.007112 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4232205-4766-4ef7-b46d-21e6b5da94bd admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:30.018108 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4232205-4766-4ef7-b46d-21e6b5da94bd admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:30.023411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba032b8a-1a2a-4668-93d0-c4e5facf0ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:30.024099 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba032b8a-1a2a-4668-93d0-c4e5facf0ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:30.024380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba032b8a-1a2a-4668-93d0-c4e5facf0ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:30.024669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba032b8a-1a2a-4668-93d0-c4e5facf0ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:30.025311 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba032b8a-1a2a-4668-93d0-c4e5facf0ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:30.026948 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba032b8a-1a2a-4668-93d0-c4e5facf0ee4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:30.038097 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1376/2770] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:30.042881 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43f155-f3c6-48df-b90f-289992b3f81c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:30.053665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43f155-f3c6-48df-b90f-289992b3f81c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:30.058567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b518d-0823-4f94-8666-0cd97abafae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:30.059235 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b518d-0823-4f94-8666-0cd97abafae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:30.059544 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b518d-0823-4f94-8666-0cd97abafae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:30.059863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b518d-0823-4f94-8666-0cd97abafae4 admin admin] PATH_INFO: `/v3/projects/def669225b2d4cb3b12c155051d5a56f/users/dc00c318cb874621ab3c18d039d0d0eb/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:30.076220 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b518d-0823-4f94-8666-0cd97abafae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def669225b2d4cb3b12c155051d5a56f, user_id=dc00c318cb874621ab3c18d039d0d0eb, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:30.078939 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b518d-0823-4f94-8666-0cd97abafae4 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:30.098676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1395/2771] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:30 2022] PUT /identity/v3/projects/def669225b2d4cb3b12c155051d5a56f/users/dc00c318cb874621ab3c18d039d0d0eb/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:30.102894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba032b8a-1a2a-4668-93d0-c4e5facf0ee4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:30.116546 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba032b8a-1a2a-4668-93d0-c4e5facf0ee4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:30.162659 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:30.183996 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03828b3-4d6e-45f9-8c3d-e7fda34474b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:30.184609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03828b3-4d6e-45f9-8c3d-e7fda34474b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:30.184896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03828b3-4d6e-45f9-8c3d-e7fda34474b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:30.185168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03828b3-4d6e-45f9-8c3d-e7fda34474b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:30.185904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03828b3-4d6e-45f9-8c3d-e7fda34474b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:30.187570 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03828b3-4d6e-45f9-8c3d-e7fda34474b4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:30.198104 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1377/2772] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:28:30.202395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b518d-0823-4f94-8666-0cd97abafae4 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:30.213295 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b518d-0823-4f94-8666-0cd97abafae4 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:30.218867 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a266c-13a0-42f3-b1f5-0dab05cd55dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:30.219485 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a266c-13a0-42f3-b1f5-0dab05cd55dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:30.219842 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a266c-13a0-42f3-b1f5-0dab05cd55dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:30.220083 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a266c-13a0-42f3-b1f5-0dab05cd55dc admin admin] PATH_INFO: `/v3/projects/def669225b2d4cb3b12c155051d5a56f/users/dc00c318cb874621ab3c18d039d0d0eb/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:30.222095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a266c-13a0-42f3-b1f5-0dab05cd55dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=def669225b2d4cb3b12c155051d5a56f, user_id=dc00c318cb874621ab3c18d039d0d0eb, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:30.226602 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a266c-13a0-42f3-b1f5-0dab05cd55dc admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:30.228190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:30.237694 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1396/2773] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:30 2022] PUT /identity/v3/projects/def669225b2d4cb3b12c155051d5a56f/users/dc00c318cb874621ab3c18d039d0d0eb/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:30.459254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03828b3-4d6e-45f9-8c3d-e7fda34474b4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:30.461082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e03828b3-4d6e-45f9-8c3d-e7fda34474b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:30.474303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03828b3-4d6e-45f9-8c3d-e7fda34474b4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:30.535123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259b305-f9fc-4f8c-a1b4-51139a1e4b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:30.535901 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259b305-f9fc-4f8c-a1b4-51139a1e4b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:30.536188 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259b305-f9fc-4f8c-a1b4-51139a1e4b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:30.536466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259b305-f9fc-4f8c-a1b4-51139a1e4b3f admin admin] PATH_INFO: `/v3/users/047bd6898b8e442bba722cf1009c5a20` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:30.537738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259b305-f9fc-4f8c-a1b4-51139a1e4b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=047bd6898b8e442bba722cf1009c5a20)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:30.539743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259b305-f9fc-4f8c-a1b4-51139a1e4b3f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:30.597190 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c259b305-f9fc-4f8c-a1b4-51139a1e4b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047bd6898b8e442bba722cf1009c5a20'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:30.610151 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c259b305-f9fc-4f8c-a1b4-51139a1e4b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047bd6898b8e442bba722cf1009c5a20'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:30.617540 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c259b305-f9fc-4f8c-a1b4-51139a1e4b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047bd6898b8e442bba722cf1009c5a20'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:30.626106 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c259b305-f9fc-4f8c-a1b4-51139a1e4b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047bd6898b8e442bba722cf1009c5a20'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:30.626731 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c259b305-f9fc-4f8c-a1b4-51139a1e4b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047bd6898b8e442bba722cf1009c5a20'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:30.633145 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1378/2774] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:30 2022] DELETE /identity/v3/users/047bd6898b8e442bba722cf1009c5a20 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:30.637954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a377c7-9fcd-4db1-a3a0-7c5034e6cb1e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:30.638239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a377c7-9fcd-4db1-a3a0-7c5034e6cb1e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:30.638511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a377c7-9fcd-4db1-a3a0-7c5034e6cb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:30.660582 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-49a377c7-9fcd-4db1-a3a0-7c5034e6cb1e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:30.661832 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-49a377c7-9fcd-4db1-a3a0-7c5034e6cb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:30.738810 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1397/2775] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:30.749059 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259b305-f9fc-4f8c-a1b4-51139a1e4b3f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:30.750587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c259b305-f9fc-4f8c-a1b4-51139a1e4b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:30.839235 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259b305-f9fc-4f8c-a1b4-51139a1e4b3f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:30.843200 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a838f-08af-483c-9528-198c18ba7068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:30.843865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a838f-08af-483c-9528-198c18ba7068 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:30.844301 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a838f-08af-483c-9528-198c18ba7068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:30.844556 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a838f-08af-483c-9528-198c18ba7068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:30.855211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a838f-08af-483c-9528-198c18ba7068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:30.856725 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a838f-08af-483c-9528-198c18ba7068 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:30.863327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:30.870280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1379/2776] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:31.323952 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a377c7-9fcd-4db1-a3a0-7c5034e6cb1e None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:31.327087 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-49a377c7-9fcd-4db1-a3a0-7c5034e6cb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:31.346095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a377c7-9fcd-4db1-a3a0-7c5034e6cb1e None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:31.351304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:31.359494 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:31.360089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:31.360899 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] PATH_INFO: `/v3/projects/be75d3b08bef4ab4b2f4d0bd362cc7d5` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:31.362268 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be75d3b08bef4ab4b2f4d0bd362cc7d5)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:31.364738 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:31.440199 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be75d3b08bef4ab4b2f4d0bd362cc7d5', 'request_id': 'req-80b06ed8-4314-48be-bb45-fc8a83f15639'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:31.455572 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be75d3b08bef4ab4b2f4d0bd362cc7d5', 'request_id': 'req-80b06ed8-4314-48be-bb45-fc8a83f15639'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:31.465698 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be75d3b08bef4ab4b2f4d0bd362cc7d5', 'request_id': 'req-80b06ed8-4314-48be-bb45-fc8a83f15639'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:31.478688 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] The token cache is being invalidate because project be75d3b08bef4ab4b2f4d0bd362cc7d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:31.478981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:31.480002 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:31.482025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1398/2777] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:31 2022] DELETE /identity/v3/projects/be75d3b08bef4ab4b2f4d0bd362cc7d5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:31.485971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a838f-08af-483c-9528-198c18ba7068 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:31.496380 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a838f-08af-483c-9528-198c18ba7068 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:31.564411 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7399a-5465-467a-ba81-b382d3c108ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:31.564965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7399a-5465-467a-ba81-b382d3c108ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:31.565244 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7399a-5465-467a-ba81-b382d3c108ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:31.565730 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7399a-5465-467a-ba81-b382d3c108ef admin admin] PATH_INFO: `/v3/users/008bb0ec03154c37bc4137bedbdd5953` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:31.567076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7399a-5465-467a-ba81-b382d3c108ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=008bb0ec03154c37bc4137bedbdd5953)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:31.569082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7399a-5465-467a-ba81-b382d3c108ef admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:31.628423 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bec7399a-5465-467a-ba81-b382d3c108ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008bb0ec03154c37bc4137bedbdd5953'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:31.643091 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bec7399a-5465-467a-ba81-b382d3c108ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008bb0ec03154c37bc4137bedbdd5953'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:31.652168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bec7399a-5465-467a-ba81-b382d3c108ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008bb0ec03154c37bc4137bedbdd5953'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:31.660873 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bec7399a-5465-467a-ba81-b382d3c108ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008bb0ec03154c37bc4137bedbdd5953'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:31.661657 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bec7399a-5465-467a-ba81-b382d3c108ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008bb0ec03154c37bc4137bedbdd5953'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:31.669332 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1380/2778] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:31 2022] DELETE /identity/v3/users/008bb0ec03154c37bc4137bedbdd5953 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:31.982261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:31.984396 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:32.002036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b06ed8-4314-48be-bb45-fc8a83f15639 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:32.080917 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee11aa-8db9-4899-9446-37e0ff39724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:32.081891 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee11aa-8db9-4899-9446-37e0ff39724f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:32.082170 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee11aa-8db9-4899-9446-37e0ff39724f admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:32.082503 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee11aa-8db9-4899-9446-37e0ff39724f admin admin] PATH_INFO: `/v3/projects/f34f303608b64dcf8482ecf3e7286309` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:32.083623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee11aa-8db9-4899-9446-37e0ff39724f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34f303608b64dcf8482ecf3e7286309)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:32.085604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee11aa-8db9-4899-9446-37e0ff39724f admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:32.112830 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:32.151858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e5ee11aa-8db9-4899-9446-37e0ff39724f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34f303608b64dcf8482ecf3e7286309', 'request_id': 'req-e5ee11aa-8db9-4899-9446-37e0ff39724f'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:32.169146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e5ee11aa-8db9-4899-9446-37e0ff39724f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34f303608b64dcf8482ecf3e7286309', 'request_id': 'req-e5ee11aa-8db9-4899-9446-37e0ff39724f'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:32.178190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e5ee11aa-8db9-4899-9446-37e0ff39724f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34f303608b64dcf8482ecf3e7286309', 'request_id': 'req-e5ee11aa-8db9-4899-9446-37e0ff39724f'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:32.194466 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e5ee11aa-8db9-4899-9446-37e0ff39724f admin admin] The token cache is being invalidate because project f34f303608b64dcf8482ecf3e7286309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:32.195140 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e5ee11aa-8db9-4899-9446-37e0ff39724f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:32.196069 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-e5ee11aa-8db9-4899-9446-37e0ff39724f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:32.198585 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1399/2779] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:31 2022] DELETE /identity/v3/projects/f34f303608b64dcf8482ecf3e7286309 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:32.204272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191669b-36d4-4b7f-82e5-5594e7bb75c0 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:32.204800 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191669b-36d4-4b7f-82e5-5594e7bb75c0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:32.204800 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191669b-36d4-4b7f-82e5-5594e7bb75c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:32.229900 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9191669b-36d4-4b7f-82e5-5594e7bb75c0 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:32.231369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9191669b-36d4-4b7f-82e5-5594e7bb75c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:32.294951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1381/2780] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:32.304381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c6a0f-a566-498f-89d7-dc2e997b4cc1 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:32.304663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c6a0f-a566-498f-89d7-dc2e997b4cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:32.304937 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c6a0f-a566-498f-89d7-dc2e997b4cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:32.328844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-284c6a0f-a566-498f-89d7-dc2e997b4cc1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:32.330056 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-284c6a0f-a566-498f-89d7-dc2e997b4cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:32.341525 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1400/2781] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:32.343879 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191669b-36d4-4b7f-82e5-5594e7bb75c0 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:32.358631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191669b-36d4-4b7f-82e5-5594e7bb75c0 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:32.365635 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd71ee-4589-47a8-8d74-5a2e31c0ca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:32.366264 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd71ee-4589-47a8-8d74-5a2e31c0ca12 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:32.366590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd71ee-4589-47a8-8d74-5a2e31c0ca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:32.366862 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd71ee-4589-47a8-8d74-5a2e31c0ca12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:32.367514 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd71ee-4589-47a8-8d74-5a2e31c0ca12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:32.368034 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd71ee-4589-47a8-8d74-5a2e31c0ca12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:32.369849 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd71ee-4589-47a8-8d74-5a2e31c0ca12 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:32.382816 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1382/2782] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:28:32.387956 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c6a0f-a566-498f-89d7-dc2e997b4cc1 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:32.400863 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c6a0f-a566-498f-89d7-dc2e997b4cc1 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:32.411294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a1926-5e72-4b53-9939-5b8922bd85b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:32.411950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a1926-5e72-4b53-9939-5b8922bd85b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:32.412227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a1926-5e72-4b53-9939-5b8922bd85b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:32.412722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a1926-5e72-4b53-9939-5b8922bd85b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:32.413553 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a1926-5e72-4b53-9939-5b8922bd85b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:32.415481 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a1926-5e72-4b53-9939-5b8922bd85b7 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:32.453823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1401/2783] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:32 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:32.455020 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd71ee-4589-47a8-8d74-5a2e31c0ca12 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:32.461935 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:32.468768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd71ee-4589-47a8-8d74-5a2e31c0ca12 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:32.537612 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650ee71-f5ec-4d29-b952-22d79f4799f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:32.538430 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ee71-f5ec-4d29-b952-22d79f4799f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:32.539124 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ee71-f5ec-4d29-b952-22d79f4799f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:32.539467 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ee71-f5ec-4d29-b952-22d79f4799f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:32.540142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650ee71-f5ec-4d29-b952-22d79f4799f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:32.542628 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650ee71-f5ec-4d29-b952-22d79f4799f6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:32.571888 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1383/2784] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:32 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:32.573514 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a1926-5e72-4b53-9939-5b8922bd85b7 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:32.585127 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a1926-5e72-4b53-9939-5b8922bd85b7 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:32.590465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e880b-2e9d-4113-ba87-ce1f0508dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:32.591142 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e880b-2e9d-4113-ba87-ce1f0508dc24 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:32.591435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e880b-2e9d-4113-ba87-ce1f0508dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:32.591818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e880b-2e9d-4113-ba87-ce1f0508dc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:32.592669 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e880b-2e9d-4113-ba87-ce1f0508dc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:32.594340 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e880b-2e9d-4113-ba87-ce1f0508dc24 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:32.604726 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1402/2785] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:32.608934 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650ee71-f5ec-4d29-b952-22d79f4799f6 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:32.619861 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650ee71-f5ec-4d29-b952-22d79f4799f6 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:32.629103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b43b9-fe06-442c-97bd-395dc12f06f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:32.630082 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b43b9-fe06-442c-97bd-395dc12f06f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:32.630522 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b43b9-fe06-442c-97bd-395dc12f06f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:32.630992 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b43b9-fe06-442c-97bd-395dc12f06f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:32.631846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b43b9-fe06-442c-97bd-395dc12f06f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:32.633897 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b43b9-fe06-442c-97bd-395dc12f06f1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:32.649620 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1384/2786] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:28:32.654390 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e880b-2e9d-4113-ba87-ce1f0508dc24 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:32.675591 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e880b-2e9d-4113-ba87-ce1f0508dc24 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:32.680610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45180d29-9914-4187-932f-4ee61e061836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:32.681527 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180d29-9914-4187-932f-4ee61e061836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:32.682427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180d29-9914-4187-932f-4ee61e061836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:32.682560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180d29-9914-4187-932f-4ee61e061836 admin admin] PATH_INFO: `/v3/projects/4d0ab85fe4d5405086c4df3405ea3211/users/928a7da37a6940d0a66ceac2b3853805/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:32.710933 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45180d29-9914-4187-932f-4ee61e061836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0ab85fe4d5405086c4df3405ea3211, user_id=928a7da37a6940d0a66ceac2b3853805, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:32.714247 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45180d29-9914-4187-932f-4ee61e061836 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:32.744296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1403/2787] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:32 2022] PUT /identity/v3/projects/4d0ab85fe4d5405086c4df3405ea3211/users/928a7da37a6940d0a66ceac2b3853805/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:28:32.745812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30b3e-3665-4608-998a-ffcf9f32bb8d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:32.746095 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30b3e-3665-4608-998a-ffcf9f32bb8d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:32.746360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30b3e-3665-4608-998a-ffcf9f32bb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:32.789043 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-80a30b3e-3665-4608-998a-ffcf9f32bb8d None None] MFA Rules not processed for user `928a7da37a6940d0a66ceac2b3853805`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:32.790279 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-80a30b3e-3665-4608-998a-ffcf9f32bb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:32.903161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45180d29-9914-4187-932f-4ee61e061836 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:32.905575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1385/2788] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:32.983803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45180d29-9914-4187-932f-4ee61e061836 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:32.988988 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842969b-946a-4aac-878c-eba9b33d8738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:32.989833 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842969b-946a-4aac-878c-eba9b33d8738 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:32.989974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842969b-946a-4aac-878c-eba9b33d8738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:32.990173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842969b-946a-4aac-878c-eba9b33d8738 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:32.994060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842969b-946a-4aac-878c-eba9b33d8738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:32.994060 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842969b-946a-4aac-878c-eba9b33d8738 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:33.033903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1404/2789] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:32 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:33.034763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a30b3e-3665-4608-998a-ffcf9f32bb8d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:33.049199 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a30b3e-3665-4608-998a-ffcf9f32bb8d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:33.116226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d5961-41b9-4744-8a1d-5b5bd19d0656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:33.116857 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d5961-41b9-4744-8a1d-5b5bd19d0656 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:33.117137 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d5961-41b9-4744-8a1d-5b5bd19d0656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:33.117938 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d5961-41b9-4744-8a1d-5b5bd19d0656 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:33.118865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d5961-41b9-4744-8a1d-5b5bd19d0656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:33.121819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d5961-41b9-4744-8a1d-5b5bd19d0656 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:33.156244 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1386/2790] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:33 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:33.160099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842969b-946a-4aac-878c-eba9b33d8738 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:33.173234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842969b-946a-4aac-878c-eba9b33d8738 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:33.178230 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94134e-17f2-48cb-95a5-bfb698082a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:33.179065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94134e-17f2-48cb-95a5-bfb698082a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:33.179412 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94134e-17f2-48cb-95a5-bfb698082a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:33.179840 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94134e-17f2-48cb-95a5-bfb698082a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:33.180554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94134e-17f2-48cb-95a5-bfb698082a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:33.182243 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94134e-17f2-48cb-95a5-bfb698082a76 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:33.197764 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1405/2791] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:33.202633 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d5961-41b9-4744-8a1d-5b5bd19d0656 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:33.209605 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:33.215674 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d5961-41b9-4744-8a1d-5b5bd19d0656 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:33.240527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722298c3-695d-4e8e-b597-6d74820f30b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:33.242070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722298c3-695d-4e8e-b597-6d74820f30b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:33.242653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722298c3-695d-4e8e-b597-6d74820f30b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:33.243167 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722298c3-695d-4e8e-b597-6d74820f30b6 admin admin] PATH_INFO: `/v3/projects/9178fdaf3ffe40879eac86d5e1c00ad0/users/a87245603d3244408519a588a920c9d9/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:33.263269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722298c3-695d-4e8e-b597-6d74820f30b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9178fdaf3ffe40879eac86d5e1c00ad0, user_id=a87245603d3244408519a588a920c9d9, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:33.269419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722298c3-695d-4e8e-b597-6d74820f30b6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:33.290232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1387/2792] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:33 2022] PUT /identity/v3/projects/9178fdaf3ffe40879eac86d5e1c00ad0/users/a87245603d3244408519a588a920c9d9/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:33.295560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94134e-17f2-48cb-95a5-bfb698082a76 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:33.313105 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94134e-17f2-48cb-95a5-bfb698082a76 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:33.359563 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:33.449697 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1ac05-2da0-44c5-8c25-1aba4d502d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:33.450656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1ac05-2da0-44c5-8c25-1aba4d502d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:33.450935 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1ac05-2da0-44c5-8c25-1aba4d502d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:33.451238 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1ac05-2da0-44c5-8c25-1aba4d502d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:33.452054 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1ac05-2da0-44c5-8c25-1aba4d502d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:33.454711 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1ac05-2da0-44c5-8c25-1aba4d502d5e admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:33.499474 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1406/2793] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:28:33.504373 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722298c3-695d-4e8e-b597-6d74820f30b6 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:33.527988 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722298c3-695d-4e8e-b597-6d74820f30b6 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:33.533364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb9b8d-60a4-456f-ac47-95a252023da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:33.534293 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb9b8d-60a4-456f-ac47-95a252023da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:33.534760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb9b8d-60a4-456f-ac47-95a252023da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:33.535186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb9b8d-60a4-456f-ac47-95a252023da0 admin admin] PATH_INFO: `/v3/projects/9178fdaf3ffe40879eac86d5e1c00ad0/users/a87245603d3244408519a588a920c9d9/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:33.538053 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb9b8d-60a4-456f-ac47-95a252023da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9178fdaf3ffe40879eac86d5e1c00ad0, user_id=a87245603d3244408519a588a920c9d9, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:33.541068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb9b8d-60a4-456f-ac47-95a252023da0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:33.570232 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1388/2794] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:33 2022] PUT /identity/v3/projects/9178fdaf3ffe40879eac86d5e1c00ad0/users/a87245603d3244408519a588a920c9d9/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:33.585703 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdff95-203c-4981-b606-8051e0c0454a None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:33.585990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdff95-203c-4981-b606-8051e0c0454a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:33.586266 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdff95-203c-4981-b606-8051e0c0454a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:33.646756 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-aacdff95-203c-4981-b606-8051e0c0454a None None] MFA Rules not processed for user `a87245603d3244408519a588a920c9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:33.648291 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-aacdff95-203c-4981-b606-8051e0c0454a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:33.784819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1407/2795] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:33.797347 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb9b8d-60a4-456f-ac47-95a252023da0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:33.799237 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f1fb9b8d-60a4-456f-ac47-95a252023da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:33.926317 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb9b8d-60a4-456f-ac47-95a252023da0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:33.934290 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589122d-f980-41bc-87bd-a94566d2b4ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:33.935041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589122d-f980-41bc-87bd-a94566d2b4ab service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:33.935860 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589122d-f980-41bc-87bd-a94566d2b4ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:33.936385 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589122d-f980-41bc-87bd-a94566d2b4ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:34.036989 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589122d-f980-41bc-87bd-a94566d2b4ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:34.038713 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589122d-f980-41bc-87bd-a94566d2b4ab service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:34.058186 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1389/2796] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:35.569762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe63ef7-f164-43a3-a72c-83926cbbea5b None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:35.570289 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe63ef7-f164-43a3-a72c-83926cbbea5b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:35.570374 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe63ef7-f164-43a3-a72c-83926cbbea5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:35.600739 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-3fe63ef7-f164-43a3-a72c-83926cbbea5b None None] MFA Rules not processed for user `dc00c318cb874621ab3c18d039d0d0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:35.602368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3fe63ef7-f164-43a3-a72c-83926cbbea5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:35.690584 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1408/2797] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:35.701618 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589122d-f980-41bc-87bd-a94566d2b4ab service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:35.704211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f589122d-f980-41bc-87bd-a94566d2b4ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:35.710470 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe63ef7-f164-43a3-a72c-83926cbbea5b None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:35.719810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589122d-f980-41bc-87bd-a94566d2b4ab service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:35.720746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3fe63ef7-f164-43a3-a72c-83926cbbea5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:35.724936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb7b4b-e045-4a14-88b9-e2f1d1d4778c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:35.726454 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb7b4b-e045-4a14-88b9-e2f1d1d4778c service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:35.727184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb7b4b-e045-4a14-88b9-e2f1d1d4778c service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:35.727943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb7b4b-e045-4a14-88b9-e2f1d1d4778c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:35.738703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb7b4b-e045-4a14-88b9-e2f1d1d4778c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:35.740416 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb7b4b-e045-4a14-88b9-e2f1d1d4778c service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:35.753176 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1390/2798] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:35.773627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:35.834801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe63ef7-f164-43a3-a72c-83926cbbea5b None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:35.841745 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0461361-0ce3-47bd-8480-6b73495ff903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:35.842550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0461361-0ce3-47bd-8480-6b73495ff903 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:35.842893 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0461361-0ce3-47bd-8480-6b73495ff903 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:35.843187 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0461361-0ce3-47bd-8480-6b73495ff903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:35.845136 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c0461361-0ce3-47bd-8480-6b73495ff903 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:35.922278 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0461361-0ce3-47bd-8480-6b73495ff903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:35.924009 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0461361-0ce3-47bd-8480-6b73495ff903 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:35.940849 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1409/2799] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:36.970275 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc14ef6-5c8a-418f-837d-81e935c5df7c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:36.970775 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc14ef6-5c8a-418f-837d-81e935c5df7c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:36.970905 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc14ef6-5c8a-418f-837d-81e935c5df7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:36.992450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-8cc14ef6-5c8a-418f-837d-81e935c5df7c None None] MFA Rules not processed for user `6b1c626bcfc8445eab2006fb4b69c4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:36.994330 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8cc14ef6-5c8a-418f-837d-81e935c5df7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:37.002208 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1391/2800] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:39.661999 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0461361-0ce3-47bd-8480-6b73495ff903 service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:39.725661 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0461361-0ce3-47bd-8480-6b73495ff903 service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:39.730352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac9fe5-2e32-40be-8b88-64962a8ccdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:39.730984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac9fe5-2e32-40be-8b88-64962a8ccdc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:39.731259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac9fe5-2e32-40be-8b88-64962a8ccdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:39.731528 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac9fe5-2e32-40be-8b88-64962a8ccdc5 admin admin] PATH_INFO: `/v3/users/928a7da37a6940d0a66ceac2b3853805` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:39.732741 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac9fe5-2e32-40be-8b88-64962a8ccdc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=928a7da37a6940d0a66ceac2b3853805)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:39.734698 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac9fe5-2e32-40be-8b88-64962a8ccdc5 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:39.784858 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-27ac9fe5-2e32-40be-8b88-64962a8ccdc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928a7da37a6940d0a66ceac2b3853805'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:39.799066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-27ac9fe5-2e32-40be-8b88-64962a8ccdc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928a7da37a6940d0a66ceac2b3853805'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:39.800242 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:39.807855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-27ac9fe5-2e32-40be-8b88-64962a8ccdc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928a7da37a6940d0a66ceac2b3853805'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:39.817604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-27ac9fe5-2e32-40be-8b88-64962a8ccdc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928a7da37a6940d0a66ceac2b3853805'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:39.818210 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-27ac9fe5-2e32-40be-8b88-64962a8ccdc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928a7da37a6940d0a66ceac2b3853805'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:39.824263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1410/2801] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:39 2022] DELETE /identity/v3/users/928a7da37a6940d0a66ceac2b3853805 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:39.829036 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade672b-8d1b-42e8-a782-e241abf5178b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:39.829578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade672b-8d1b-42e8-a782-e241abf5178b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:39.829578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade672b-8d1b-42e8-a782-e241abf5178b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:39.849243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9ade672b-8d1b-42e8-a782-e241abf5178b None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:39.850424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9ade672b-8d1b-42e8-a782-e241abf5178b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:39.905138 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:39.914522 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1392/2802] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:39.925121 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac9fe5-2e32-40be-8b88-64962a8ccdc5 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:39.926641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-27ac9fe5-2e32-40be-8b88-64962a8ccdc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:40.005675 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac9fe5-2e32-40be-8b88-64962a8ccdc5 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:40.009627 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589125a-3349-4f91-992d-bba0a852b0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:40.010240 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589125a-3349-4f91-992d-bba0a852b0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:40.010515 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589125a-3349-4f91-992d-bba0a852b0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:40.010787 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589125a-3349-4f91-992d-bba0a852b0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:40.021148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589125a-3349-4f91-992d-bba0a852b0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:40.023472 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589125a-3349-4f91-992d-bba0a852b0c6 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:40.035208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1411/2803] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:40.344208 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade672b-8d1b-42e8-a782-e241abf5178b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:40.345729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9ade672b-8d1b-42e8-a782-e241abf5178b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:40.359863 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade672b-8d1b-42e8-a782-e241abf5178b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:40.365070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:40.365828 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:40.366189 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:40.366476 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] PATH_INFO: `/v3/projects/4d0ab85fe4d5405086c4df3405ea3211` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:40.367716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0ab85fe4d5405086c4df3405ea3211)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:40.369723 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:40.421708 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0ab85fe4d5405086c4df3405ea3211', 'request_id': 'req-333a690d-7939-4c12-a771-5c677e1b8494'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.430294 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0ab85fe4d5405086c4df3405ea3211', 'request_id': 'req-333a690d-7939-4c12-a771-5c677e1b8494'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.436249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0ab85fe4d5405086c4df3405ea3211', 'request_id': 'req-333a690d-7939-4c12-a771-5c677e1b8494'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.447600 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] The token cache is being invalidate because project 4d0ab85fe4d5405086c4df3405ea3211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:40.447920 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.448575 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.450060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1393/2804] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:40 2022] DELETE /identity/v3/projects/4d0ab85fe4d5405086c4df3405ea3211 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:40.454716 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589125a-3349-4f91-992d-bba0a852b0c6 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:40.464812 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589125a-3349-4f91-992d-bba0a852b0c6 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:40.527814 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2ca94-9e99-4990-8175-566a83263d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:40.528468 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2ca94-9e99-4990-8175-566a83263d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:40.528746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2ca94-9e99-4990-8175-566a83263d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:40.529057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2ca94-9e99-4990-8175-566a83263d69 admin admin] PATH_INFO: `/v3/users/a87245603d3244408519a588a920c9d9` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:40.530205 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2ca94-9e99-4990-8175-566a83263d69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a87245603d3244408519a588a920c9d9)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:40.532184 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2ca94-9e99-4990-8175-566a83263d69 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:40.582642 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-04d2ca94-9e99-4990-8175-566a83263d69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a87245603d3244408519a588a920c9d9'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.594913 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-04d2ca94-9e99-4990-8175-566a83263d69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a87245603d3244408519a588a920c9d9'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.608681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-04d2ca94-9e99-4990-8175-566a83263d69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a87245603d3244408519a588a920c9d9'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.616591 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-04d2ca94-9e99-4990-8175-566a83263d69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a87245603d3244408519a588a920c9d9'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.617409 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-04d2ca94-9e99-4990-8175-566a83263d69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a87245603d3244408519a588a920c9d9'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.627408 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1412/2805] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:40 2022] DELETE /identity/v3/users/a87245603d3244408519a588a920c9d9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:40.911771 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:40.914070 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:40.930180 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a690d-7939-4c12-a771-5c677e1b8494 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:40.990519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87c648-1413-45ea-b7c7-2a30fd36b87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:40.991146 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c648-1413-45ea-b7c7-2a30fd36b87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:40.991428 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c648-1413-45ea-b7c7-2a30fd36b87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:40.991746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c648-1413-45ea-b7c7-2a30fd36b87f admin admin] PATH_INFO: `/v3/projects/9178fdaf3ffe40879eac86d5e1c00ad0` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:40.992969 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87c648-1413-45ea-b7c7-2a30fd36b87f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9178fdaf3ffe40879eac86d5e1c00ad0)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:40.994852 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87c648-1413-45ea-b7c7-2a30fd36b87f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:41.044947 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf87c648-1413-45ea-b7c7-2a30fd36b87f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9178fdaf3ffe40879eac86d5e1c00ad0', 'request_id': 'req-cf87c648-1413-45ea-b7c7-2a30fd36b87f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:41.053370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf87c648-1413-45ea-b7c7-2a30fd36b87f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9178fdaf3ffe40879eac86d5e1c00ad0', 'request_id': 'req-cf87c648-1413-45ea-b7c7-2a30fd36b87f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:41.059894 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf87c648-1413-45ea-b7c7-2a30fd36b87f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9178fdaf3ffe40879eac86d5e1c00ad0', 'request_id': 'req-cf87c648-1413-45ea-b7c7-2a30fd36b87f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:41.071905 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf87c648-1413-45ea-b7c7-2a30fd36b87f admin admin] The token cache is being invalidate because project 9178fdaf3ffe40879eac86d5e1c00ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:41.072200 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf87c648-1413-45ea-b7c7-2a30fd36b87f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:41.072917 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf87c648-1413-45ea-b7c7-2a30fd36b87f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:41.074749 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1394/2806] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:40 2022] DELETE /identity/v3/projects/9178fdaf3ffe40879eac86d5e1c00ad0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:41.079547 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319d0f-d577-482b-9b6f-10229050bc2a None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.080160 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319d0f-d577-482b-9b6f-10229050bc2a None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.080265 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319d0f-d577-482b-9b6f-10229050bc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.089298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:41.102674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-15319d0f-d577-482b-9b6f-10229050bc2a None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:41.103855 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-15319d0f-d577-482b-9b6f-10229050bc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:41.169232 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1413/2807] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:41.177149 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301aef1-ee02-478e-8c32-25ff3b3d0c58 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.177435 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301aef1-ee02-478e-8c32-25ff3b3d0c58 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.177706 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301aef1-ee02-478e-8c32-25ff3b3d0c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.202550 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a301aef1-ee02-478e-8c32-25ff3b3d0c58 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:41.203827 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a301aef1-ee02-478e-8c32-25ff3b3d0c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:41.212622 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1395/2808] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:41.217201 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15319d0f-d577-482b-9b6f-10229050bc2a None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:41.227276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15319d0f-d577-482b-9b6f-10229050bc2a None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:41.232499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc57312-5be0-4ff4-b562-717a6f0f529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:41.233120 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc57312-5be0-4ff4-b562-717a6f0f529f admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.233395 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc57312-5be0-4ff4-b562-717a6f0f529f admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.233666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc57312-5be0-4ff4-b562-717a6f0f529f admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.234318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc57312-5be0-4ff4-b562-717a6f0f529f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:41.234624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc57312-5be0-4ff4-b562-717a6f0f529f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:41.236272 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc57312-5be0-4ff4-b562-717a6f0f529f admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:41.247744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1414/2809] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:28:41.251927 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301aef1-ee02-478e-8c32-25ff3b3d0c58 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:41.262228 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301aef1-ee02-478e-8c32-25ff3b3d0c58 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:41.267412 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cefc91-9fd7-4aa2-9a23-da31eea709a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:41.270472 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefc91-9fd7-4aa2-9a23-da31eea709a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.270755 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefc91-9fd7-4aa2-9a23-da31eea709a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.271078 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefc91-9fd7-4aa2-9a23-da31eea709a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.271655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cefc91-9fd7-4aa2-9a23-da31eea709a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:41.273639 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cefc91-9fd7-4aa2-9a23-da31eea709a7 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:41.278524 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:41.306517 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1396/2810] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:41 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:41.311421 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc57312-5be0-4ff4-b562-717a6f0f529f admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:41.322588 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc57312-5be0-4ff4-b562-717a6f0f529f admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:41.386583 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18be494-1027-40c1-940f-afbdf2aef14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:41.387261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18be494-1027-40c1-940f-afbdf2aef14a admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.387560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18be494-1027-40c1-940f-afbdf2aef14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.387942 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18be494-1027-40c1-940f-afbdf2aef14a admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.388791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18be494-1027-40c1-940f-afbdf2aef14a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:41.391082 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18be494-1027-40c1-940f-afbdf2aef14a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:41.416463 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1415/2811] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:41 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:41.420789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cefc91-9fd7-4aa2-9a23-da31eea709a7 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:41.431345 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cefc91-9fd7-4aa2-9a23-da31eea709a7 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:41.437130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a5055-5d1a-46ac-a4ec-3cba6ee83e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:41.437763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a5055-5d1a-46ac-a4ec-3cba6ee83e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.438048 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a5055-5d1a-46ac-a4ec-3cba6ee83e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.438490 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a5055-5d1a-46ac-a4ec-3cba6ee83e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.439147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a5055-5d1a-46ac-a4ec-3cba6ee83e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:41.440814 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a5055-5d1a-46ac-a4ec-3cba6ee83e15 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:41.451875 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1397/2812] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:41.457018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18be494-1027-40c1-940f-afbdf2aef14a admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:41.468892 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18be494-1027-40c1-940f-afbdf2aef14a admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:41.473616 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ef9d0-f72a-407d-9e93-57b60d274e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:41.474227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ef9d0-f72a-407d-9e93-57b60d274e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.474509 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ef9d0-f72a-407d-9e93-57b60d274e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.474799 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ef9d0-f72a-407d-9e93-57b60d274e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.475427 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ef9d0-f72a-407d-9e93-57b60d274e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:41.477089 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ef9d0-f72a-407d-9e93-57b60d274e46 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:41.488294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1416/2813] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:28:41.492687 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a5055-5d1a-46ac-a4ec-3cba6ee83e15 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:41.503672 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a5055-5d1a-46ac-a4ec-3cba6ee83e15 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:41.508592 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096a14e-fbcf-4d98-85a4-36907b318d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:41.509332 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096a14e-fbcf-4d98-85a4-36907b318d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.509676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096a14e-fbcf-4d98-85a4-36907b318d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.510020 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096a14e-fbcf-4d98-85a4-36907b318d29 admin admin] PATH_INFO: `/v3/projects/c7d8d8384f2c4ddca2f622fec434b5a2/users/4c5d4f3a33654c519a58c1a908575ab8/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.527074 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096a14e-fbcf-4d98-85a4-36907b318d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d8d8384f2c4ddca2f622fec434b5a2, user_id=4c5d4f3a33654c519a58c1a908575ab8, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:41.529831 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096a14e-fbcf-4d98-85a4-36907b318d29 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:41.545466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1398/2814] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:41 2022] PUT /identity/v3/projects/c7d8d8384f2c4ddca2f622fec434b5a2/users/4c5d4f3a33654c519a58c1a908575ab8/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:28:41.555990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ac7a7-ff6d-4f8d-952b-c5d845a6493b None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.556271 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ac7a7-ff6d-4f8d-952b-c5d845a6493b None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.556541 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ac7a7-ff6d-4f8d-952b-c5d845a6493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.588321 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-a86ac7a7-ff6d-4f8d-952b-c5d845a6493b None None] MFA Rules not processed for user `4c5d4f3a33654c519a58c1a908575ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:41.589550 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a86ac7a7-ff6d-4f8d-952b-c5d845a6493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:41.668464 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:41.672890 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1417/2815] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:41.677194 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096a14e-fbcf-4d98-85a4-36907b318d29 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:41.743643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096a14e-fbcf-4d98-85a4-36907b318d29 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:41.749323 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a473ec-33c3-45ba-b362-e18c240cb03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:41.750128 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a473ec-33c3-45ba-b362-e18c240cb03b admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.750883 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a473ec-33c3-45ba-b362-e18c240cb03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.751150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a473ec-33c3-45ba-b362-e18c240cb03b admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.751834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a473ec-33c3-45ba-b362-e18c240cb03b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:41.753750 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a473ec-33c3-45ba-b362-e18c240cb03b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:41.784308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1399/2816] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:41 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:41.788537 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ac7a7-ff6d-4f8d-952b-c5d845a6493b None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:41.799595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ac7a7-ff6d-4f8d-952b-c5d845a6493b None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:41.860570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa706a6f-b7ee-457a-be26-2ca8176fb48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:41.861173 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa706a6f-b7ee-457a-be26-2ca8176fb48d admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.861450 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa706a6f-b7ee-457a-be26-2ca8176fb48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.861721 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa706a6f-b7ee-457a-be26-2ca8176fb48d admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.862368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa706a6f-b7ee-457a-be26-2ca8176fb48d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:41.864320 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa706a6f-b7ee-457a-be26-2ca8176fb48d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:41.890350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1418/2817] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:41 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:41.894623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a473ec-33c3-45ba-b362-e18c240cb03b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:41.905217 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a473ec-33c3-45ba-b362-e18c240cb03b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:41.910047 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8e953-7e34-460e-8186-5474ce0b7a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:41.910620 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8e953-7e34-460e-8186-5474ce0b7a73 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.910905 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8e953-7e34-460e-8186-5474ce0b7a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.911187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8e953-7e34-460e-8186-5474ce0b7a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.911851 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8e953-7e34-460e-8186-5474ce0b7a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:41.913516 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8e953-7e34-460e-8186-5474ce0b7a73 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:41.925119 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1400/2818] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:28:41.929578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa706a6f-b7ee-457a-be26-2ca8176fb48d admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:41.939665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa706a6f-b7ee-457a-be26-2ca8176fb48d admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:41.944543 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffc21b-1894-4fce-a85d-0eb336f50b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:41.945215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffc21b-1894-4fce-a85d-0eb336f50b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.945532 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffc21b-1894-4fce-a85d-0eb336f50b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.945809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffc21b-1894-4fce-a85d-0eb336f50b44 admin admin] PATH_INFO: `/v3/projects/7e08ec77fbb54a2089cb201dba671f30/users/d12fac91e65b4261ae4af934b461667a/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.962596 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffc21b-1894-4fce-a85d-0eb336f50b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e08ec77fbb54a2089cb201dba671f30, user_id=d12fac91e65b4261ae4af934b461667a, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:41.965307 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffc21b-1894-4fce-a85d-0eb336f50b44 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:41.981791 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1419/2819] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:41 2022] PUT /identity/v3/projects/7e08ec77fbb54a2089cb201dba671f30/users/d12fac91e65b4261ae4af934b461667a/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:41.985839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8e953-7e34-460e-8186-5474ce0b7a73 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:41.996275 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8e953-7e34-460e-8186-5474ce0b7a73 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:42.076708 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757da4e-b810-4d30-bd7a-e0dbe1acda65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:42.077320 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757da4e-b810-4d30-bd7a-e0dbe1acda65 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:42.077619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757da4e-b810-4d30-bd7a-e0dbe1acda65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:42.077884 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757da4e-b810-4d30-bd7a-e0dbe1acda65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:42.078523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757da4e-b810-4d30-bd7a-e0dbe1acda65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:42.080272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757da4e-b810-4d30-bd7a-e0dbe1acda65 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:42.090447 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1401/2820] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:42.095603 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffc21b-1894-4fce-a85d-0eb336f50b44 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:42.106586 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffc21b-1894-4fce-a85d-0eb336f50b44 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:42.112611 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45134d15-bfa0-4b10-88a6-6d63a4abb097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:42.113281 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45134d15-bfa0-4b10-88a6-6d63a4abb097 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:42.113561 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45134d15-bfa0-4b10-88a6-6d63a4abb097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:42.113831 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45134d15-bfa0-4b10-88a6-6d63a4abb097 admin admin] PATH_INFO: `/v3/projects/7e08ec77fbb54a2089cb201dba671f30/users/d12fac91e65b4261ae4af934b461667a/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:42.116068 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45134d15-bfa0-4b10-88a6-6d63a4abb097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e08ec77fbb54a2089cb201dba671f30, user_id=d12fac91e65b4261ae4af934b461667a, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:42.118712 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45134d15-bfa0-4b10-88a6-6d63a4abb097 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:42.129841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1420/2821] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:42 2022] PUT /identity/v3/projects/7e08ec77fbb54a2089cb201dba671f30/users/d12fac91e65b4261ae4af934b461667a/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:42.141736 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bce7-59f5-424e-85b5-afe901ad0611 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:42.142027 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bce7-59f5-424e-85b5-afe901ad0611 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:42.142308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bce7-59f5-424e-85b5-afe901ad0611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:42.172552 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b5a3bce7-59f5-424e-85b5-afe901ad0611 None None] MFA Rules not processed for user `d12fac91e65b4261ae4af934b461667a`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:42.173807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b5a3bce7-59f5-424e-85b5-afe901ad0611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:42.183312 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:42.250518 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1402/2822] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:42.262151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45134d15-bfa0-4b10-88a6-6d63a4abb097 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:42.264325 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-45134d15-bfa0-4b10-88a6-6d63a4abb097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:42.325603 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45134d15-bfa0-4b10-88a6-6d63a4abb097 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:42.329878 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d74a8-b7b7-48d5-91e4-7fb8d819557d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:42.330478 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d74a8-b7b7-48d5-91e4-7fb8d819557d service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:42.330751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d74a8-b7b7-48d5-91e4-7fb8d819557d service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:42.331017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d74a8-b7b7-48d5-91e4-7fb8d819557d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:42.340099 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d74a8-b7b7-48d5-91e4-7fb8d819557d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:42.341798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d74a8-b7b7-48d5-91e4-7fb8d819557d service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:42.352587 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1421/2823] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:42.422303 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bce7-59f5-424e-85b5-afe901ad0611 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:42.489749 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bce7-59f5-424e-85b5-afe901ad0611 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:42.495027 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d69181-de1e-4a33-9a2b-e0e6710ace58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:42.495676 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69181-de1e-4a33-9a2b-e0e6710ace58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:42.495991 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69181-de1e-4a33-9a2b-e0e6710ace58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:42.496269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69181-de1e-4a33-9a2b-e0e6710ace58 admin admin] PATH_INFO: `/v3/users/4c5d4f3a33654c519a58c1a908575ab8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:42.497433 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d69181-de1e-4a33-9a2b-e0e6710ace58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5d4f3a33654c519a58c1a908575ab8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:42.499399 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d69181-de1e-4a33-9a2b-e0e6710ace58 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:42.549086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-54d69181-de1e-4a33-9a2b-e0e6710ace58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5d4f3a33654c519a58c1a908575ab8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:42.563666 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-54d69181-de1e-4a33-9a2b-e0e6710ace58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5d4f3a33654c519a58c1a908575ab8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:42.570678 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-54d69181-de1e-4a33-9a2b-e0e6710ace58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5d4f3a33654c519a58c1a908575ab8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:42.580173 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-54d69181-de1e-4a33-9a2b-e0e6710ace58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5d4f3a33654c519a58c1a908575ab8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:42.580823 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-54d69181-de1e-4a33-9a2b-e0e6710ace58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5d4f3a33654c519a58c1a908575ab8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:42.586658 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1403/2824] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:42 2022] DELETE /identity/v3/users/4c5d4f3a33654c519a58c1a908575ab8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:42.591327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126c333-fa06-4bc0-8700-03ad82e549c4 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:42.591610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126c333-fa06-4bc0-8700-03ad82e549c4 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:42.591919 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126c333-fa06-4bc0-8700-03ad82e549c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:42.614210 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-2126c333-fa06-4bc0-8700-03ad82e549c4 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:42.616079 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2126c333-fa06-4bc0-8700-03ad82e549c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:42.672057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:42.684747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1422/2825] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:42.694987 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d69181-de1e-4a33-9a2b-e0e6710ace58 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:42.696519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-54d69181-de1e-4a33-9a2b-e0e6710ace58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:42.729244 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:42.761438 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d69181-de1e-4a33-9a2b-e0e6710ace58 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:42.765266 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d677c37-9f79-4e25-a1dd-5494b8412e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:42.765875 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d677c37-9f79-4e25-a1dd-5494b8412e5b service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:42.766267 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d677c37-9f79-4e25-a1dd-5494b8412e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:42.766542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d677c37-9f79-4e25-a1dd-5494b8412e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:42.776964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d677c37-9f79-4e25-a1dd-5494b8412e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:42.778369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d677c37-9f79-4e25-a1dd-5494b8412e5b service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:42.789263 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1404/2826] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:43.068805 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126c333-fa06-4bc0-8700-03ad82e549c4 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:43.070423 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2126c333-fa06-4bc0-8700-03ad82e549c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:43.082898 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126c333-fa06-4bc0-8700-03ad82e549c4 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:43.087723 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:43.088492 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.088772 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.089046 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] PATH_INFO: `/v3/projects/c7d8d8384f2c4ddca2f622fec434b5a2` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.090156 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d8d8384f2c4ddca2f622fec434b5a2)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:43.092202 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:43.142280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d8d8384f2c4ddca2f622fec434b5a2', 'request_id': 'req-db82a824-c69b-4947-895d-bc00b8397404'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.151257 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d8d8384f2c4ddca2f622fec434b5a2', 'request_id': 'req-db82a824-c69b-4947-895d-bc00b8397404'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.157213 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d8d8384f2c4ddca2f622fec434b5a2', 'request_id': 'req-db82a824-c69b-4947-895d-bc00b8397404'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.170621 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] The token cache is being invalidate because project c7d8d8384f2c4ddca2f622fec434b5a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:43.170912 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.171624 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.173215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1423/2827] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:43 2022] DELETE /identity/v3/projects/c7d8d8384f2c4ddca2f622fec434b5a2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:43.177276 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d677c37-9f79-4e25-a1dd-5494b8412e5b service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:43.187228 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d677c37-9f79-4e25-a1dd-5494b8412e5b service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:43.245893 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d50d6e-8b1f-410d-bffc-c90975ff30db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:43.246531 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d50d6e-8b1f-410d-bffc-c90975ff30db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.246815 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d50d6e-8b1f-410d-bffc-c90975ff30db admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.247092 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d50d6e-8b1f-410d-bffc-c90975ff30db admin admin] PATH_INFO: `/v3/users/d12fac91e65b4261ae4af934b461667a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.248353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d50d6e-8b1f-410d-bffc-c90975ff30db admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12fac91e65b4261ae4af934b461667a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:43.250272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d50d6e-8b1f-410d-bffc-c90975ff30db admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:43.301701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f2d50d6e-8b1f-410d-bffc-c90975ff30db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12fac91e65b4261ae4af934b461667a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.313795 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f2d50d6e-8b1f-410d-bffc-c90975ff30db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12fac91e65b4261ae4af934b461667a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.320695 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f2d50d6e-8b1f-410d-bffc-c90975ff30db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12fac91e65b4261ae4af934b461667a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.329050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f2d50d6e-8b1f-410d-bffc-c90975ff30db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12fac91e65b4261ae4af934b461667a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.329912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f2d50d6e-8b1f-410d-bffc-c90975ff30db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12fac91e65b4261ae4af934b461667a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.338768 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1405/2828] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:43 2022] DELETE /identity/v3/users/d12fac91e65b4261ae4af934b461667a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:43.634103 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:43.635909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:43.650909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82a824-c69b-4947-895d-bc00b8397404 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:43.710476 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:43.711017 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.711292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.711560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd admin admin] PATH_INFO: `/v3/projects/7e08ec77fbb54a2089cb201dba671f30` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.712704 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e08ec77fbb54a2089cb201dba671f30)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:43.714600 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:43.761261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e08ec77fbb54a2089cb201dba671f30', 'request_id': 'req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.769449 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e08ec77fbb54a2089cb201dba671f30', 'request_id': 'req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.775159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e08ec77fbb54a2089cb201dba671f30', 'request_id': 'req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.786137 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd admin admin] The token cache is being invalidate because project 7e08ec77fbb54a2089cb201dba671f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:43.786426 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.787098 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-c847a7bf-4c9b-4357-b048-7464ec7bf3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.788594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1424/2829] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:43 2022] DELETE /identity/v3/projects/7e08ec77fbb54a2089cb201dba671f30 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:43.793839 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0701022-2457-47fc-a87d-4abec71d5c50 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.794229 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0701022-2457-47fc-a87d-4abec71d5c50 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.794437 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0701022-2457-47fc-a87d-4abec71d5c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.816038 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b0701022-2457-47fc-a87d-4abec71d5c50 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:43.817628 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b0701022-2457-47fc-a87d-4abec71d5c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:43.863253 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:43.883811 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1406/2830] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:43.891751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab76a33-895a-47b7-b673-8c654e2f2678 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.892063 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab76a33-895a-47b7-b673-8c654e2f2678 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.892334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab76a33-895a-47b7-b673-8c654e2f2678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.913040 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-3ab76a33-895a-47b7-b673-8c654e2f2678 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:43.914259 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-3ab76a33-895a-47b7-b673-8c654e2f2678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:43.923747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1425/2831] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:43.928432 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0701022-2457-47fc-a87d-4abec71d5c50 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:43.940544 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0701022-2457-47fc-a87d-4abec71d5c50 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:43.945521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348ff86-0d66-4860-be2f-d4d6dadae36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:43.946142 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348ff86-0d66-4860-be2f-d4d6dadae36b admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.946423 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348ff86-0d66-4860-be2f-d4d6dadae36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.946700 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348ff86-0d66-4860-be2f-d4d6dadae36b admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.947360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348ff86-0d66-4860-be2f-d4d6dadae36b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:43.947670 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348ff86-0d66-4860-be2f-d4d6dadae36b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:43.949326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348ff86-0d66-4860-be2f-d4d6dadae36b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:43.961920 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1407/2832] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:28:43.966736 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab76a33-895a-47b7-b673-8c654e2f2678 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:43.971292 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:43.978272 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab76a33-895a-47b7-b673-8c654e2f2678 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:43.984623 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41242558-aceb-4518-bbb4-1bcc83d72e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:43.985329 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41242558-aceb-4518-bbb4-1bcc83d72e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.985602 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41242558-aceb-4518-bbb4-1bcc83d72e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.985870 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41242558-aceb-4518-bbb4-1bcc83d72e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.986495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41242558-aceb-4518-bbb4-1bcc83d72e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:43.988473 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41242558-aceb-4518-bbb4-1bcc83d72e15 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.023101 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1426/2833] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:43 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:44.027594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348ff86-0d66-4860-be2f-d4d6dadae36b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.038162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348ff86-0d66-4860-be2f-d4d6dadae36b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.103771 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2366dbc-5d4e-4942-95a0-48da9b480f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.104377 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2366dbc-5d4e-4942-95a0-48da9b480f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.104653 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2366dbc-5d4e-4942-95a0-48da9b480f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.104922 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2366dbc-5d4e-4942-95a0-48da9b480f2b admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.105542 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2366dbc-5d4e-4942-95a0-48da9b480f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.107497 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2366dbc-5d4e-4942-95a0-48da9b480f2b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.136748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1408/2834] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:44 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:44.142416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41242558-aceb-4518-bbb4-1bcc83d72e15 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.152779 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41242558-aceb-4518-bbb4-1bcc83d72e15 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.158732 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15569d4b-4091-424d-9658-cab62484a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.159302 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15569d4b-4091-424d-9658-cab62484a0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.159607 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15569d4b-4091-424d-9658-cab62484a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.160328 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15569d4b-4091-424d-9658-cab62484a0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.160976 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15569d4b-4091-424d-9658-cab62484a0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.162577 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15569d4b-4091-424d-9658-cab62484a0c3 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.174294 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1427/2835] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:44.178404 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2366dbc-5d4e-4942-95a0-48da9b480f2b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.192821 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2366dbc-5d4e-4942-95a0-48da9b480f2b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.199361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817b6a6-8e4f-4afe-bd97-e5b98dcab3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.200154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817b6a6-8e4f-4afe-bd97-e5b98dcab3de admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.200440 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817b6a6-8e4f-4afe-bd97-e5b98dcab3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.200780 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817b6a6-8e4f-4afe-bd97-e5b98dcab3de admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.201503 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817b6a6-8e4f-4afe-bd97-e5b98dcab3de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.203146 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817b6a6-8e4f-4afe-bd97-e5b98dcab3de admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.214576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1409/2836] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:44.219058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15569d4b-4091-424d-9658-cab62484a0c3 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.229781 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15569d4b-4091-424d-9658-cab62484a0c3 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.235604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371a448-d4b2-4721-aeb2-709bfabeb278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.236298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a448-d4b2-4721-aeb2-709bfabeb278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.236579 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a448-d4b2-4721-aeb2-709bfabeb278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.236852 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a448-d4b2-4721-aeb2-709bfabeb278 admin admin] PATH_INFO: `/v3/projects/0446c5459be04d9b85998af5c716266b/users/5de63c4b4ec14994b18eb7c89cfcfba2/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.253626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371a448-d4b2-4721-aeb2-709bfabeb278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0446c5459be04d9b85998af5c716266b, user_id=5de63c4b4ec14994b18eb7c89cfcfba2, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.256445 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371a448-d4b2-4721-aeb2-709bfabeb278 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.272071 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1428/2837] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:44 2022] PUT /identity/v3/projects/0446c5459be04d9b85998af5c716266b/users/5de63c4b4ec14994b18eb7c89cfcfba2/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:44.282582 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b844b7-42c8-4b00-a7cc-52b2b357fb1e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.282872 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b844b7-42c8-4b00-a7cc-52b2b357fb1e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.283123 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b844b7-42c8-4b00-a7cc-52b2b357fb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.310895 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-67b844b7-42c8-4b00-a7cc-52b2b357fb1e None None] MFA Rules not processed for user `5de63c4b4ec14994b18eb7c89cfcfba2`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:44.312349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-67b844b7-42c8-4b00-a7cc-52b2b357fb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:44.378556 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1410/2838] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:44.383474 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371a448-d4b2-4721-aeb2-709bfabeb278 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.455018 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371a448-d4b2-4721-aeb2-709bfabeb278 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.460286 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146d08d-e980-4c21-a657-9b9b54616a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.461188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146d08d-e980-4c21-a657-9b9b54616a5c admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.461626 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146d08d-e980-4c21-a657-9b9b54616a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.462066 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146d08d-e980-4c21-a657-9b9b54616a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.463044 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146d08d-e980-4c21-a657-9b9b54616a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.465496 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146d08d-e980-4c21-a657-9b9b54616a5c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.499310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1429/2839] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:44 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:44.503655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b844b7-42c8-4b00-a7cc-52b2b357fb1e None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.514498 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b844b7-42c8-4b00-a7cc-52b2b357fb1e None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.559090 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:44.575837 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b7445-dd47-46a6-a5cb-adc42039c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.576451 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b7445-dd47-46a6-a5cb-adc42039c834 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.576719 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b7445-dd47-46a6-a5cb-adc42039c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.576992 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b7445-dd47-46a6-a5cb-adc42039c834 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.577622 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b7445-dd47-46a6-a5cb-adc42039c834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.579538 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b7445-dd47-46a6-a5cb-adc42039c834 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.603567 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1411/2840] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:44 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:44.607869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146d08d-e980-4c21-a657-9b9b54616a5c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.618820 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146d08d-e980-4c21-a657-9b9b54616a5c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.624488 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc11b2-4f69-45d8-9084-622dc79fced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.625088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc11b2-4f69-45d8-9084-622dc79fced8 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.625372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc11b2-4f69-45d8-9084-622dc79fced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.625638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc11b2-4f69-45d8-9084-622dc79fced8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.626282 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc11b2-4f69-45d8-9084-622dc79fced8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.627954 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc11b2-4f69-45d8-9084-622dc79fced8 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.639326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1430/2841] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:44.643483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b7445-dd47-46a6-a5cb-adc42039c834 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.655776 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b7445-dd47-46a6-a5cb-adc42039c834 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.660741 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fc77d-bad8-4c40-9469-b3fc200d6be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.661421 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fc77d-bad8-4c40-9469-b3fc200d6be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.661731 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fc77d-bad8-4c40-9469-b3fc200d6be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.662008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fc77d-bad8-4c40-9469-b3fc200d6be9 admin admin] PATH_INFO: `/v3/projects/8f77c7ee6e1b49e7988612ed8c27058f/users/e09597e356d440dfa00cf1b0deac1222/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.677840 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fc77d-bad8-4c40-9469-b3fc200d6be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f77c7ee6e1b49e7988612ed8c27058f, user_id=e09597e356d440dfa00cf1b0deac1222, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.680566 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fc77d-bad8-4c40-9469-b3fc200d6be9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.694418 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1412/2842] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:44 2022] PUT /identity/v3/projects/8f77c7ee6e1b49e7988612ed8c27058f/users/e09597e356d440dfa00cf1b0deac1222/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:44.698435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc11b2-4f69-45d8-9084-622dc79fced8 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.708818 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc11b2-4f69-45d8-9084-622dc79fced8 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.770370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda903d-3d58-4c4b-8c22-0c71f01380e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.771365 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda903d-3d58-4c4b-8c22-0c71f01380e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.771907 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda903d-3d58-4c4b-8c22-0c71f01380e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.772405 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda903d-3d58-4c4b-8c22-0c71f01380e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.773480 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda903d-3d58-4c4b-8c22-0c71f01380e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.775194 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda903d-3d58-4c4b-8c22-0c71f01380e9 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.790951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1431/2843] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:44.794684 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fc77d-bad8-4c40-9469-b3fc200d6be9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.805634 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fc77d-bad8-4c40-9469-b3fc200d6be9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.811026 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbd915-735e-4eed-9c4a-24e507934fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.811804 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd915-735e-4eed-9c4a-24e507934fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.812203 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd915-735e-4eed-9c4a-24e507934fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.812710 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbd915-735e-4eed-9c4a-24e507934fc2 admin admin] PATH_INFO: `/v3/projects/8f77c7ee6e1b49e7988612ed8c27058f/users/e09597e356d440dfa00cf1b0deac1222/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.815587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbd915-735e-4eed-9c4a-24e507934fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f77c7ee6e1b49e7988612ed8c27058f, user_id=e09597e356d440dfa00cf1b0deac1222, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.818463 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbd915-735e-4eed-9c4a-24e507934fc2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.831483 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1413/2844] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:44 2022] PUT /identity/v3/projects/8f77c7ee6e1b49e7988612ed8c27058f/users/e09597e356d440dfa00cf1b0deac1222/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:44.844300 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc68e9d-5380-47c9-903c-0664d673e801 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.844674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc68e9d-5380-47c9-903c-0664d673e801 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.845088 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc68e9d-5380-47c9-903c-0664d673e801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.876407 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-5dc68e9d-5380-47c9-903c-0664d673e801 None None] MFA Rules not processed for user `e09597e356d440dfa00cf1b0deac1222`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:44.877605 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5dc68e9d-5380-47c9-903c-0664d673e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:44.881927 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:44.956728 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1432/2845] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:44.969683 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbd915-735e-4eed-9c4a-24e507934fc2 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.971726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-94dbd915-735e-4eed-9c4a-24e507934fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:45.034645 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbd915-735e-4eed-9c4a-24e507934fc2 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:45.038922 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb80445-5367-4ec6-80a6-7d0f92de58f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:45.039526 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb80445-5367-4ec6-80a6-7d0f92de58f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.039836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb80445-5367-4ec6-80a6-7d0f92de58f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.040107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb80445-5367-4ec6-80a6-7d0f92de58f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.050109 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb80445-5367-4ec6-80a6-7d0f92de58f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:45.051603 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb80445-5367-4ec6-80a6-7d0f92de58f4 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:45.062587 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1414/2846] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:45.409208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc68e9d-5380-47c9-903c-0664d673e801 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:45.418762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc68e9d-5380-47c9-903c-0664d673e801 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:45.424000 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090964cf-4e02-4def-a2e2-7c08ad6f0212 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e09597e356d440dfa00cf1b0deac1222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f77c7ee6e1b49e7988612ed8c27058f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:45.424651 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090964cf-4e02-4def-a2e2-7c08ad6f0212 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.424936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090964cf-4e02-4def-a2e2-7c08ad6f0212 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.425215 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090964cf-4e02-4def-a2e2-7c08ad6f0212 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.425926 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090964cf-4e02-4def-a2e2-7c08ad6f0212 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:45.426236 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090964cf-4e02-4def-a2e2-7c08ad6f0212 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:45.427893 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090964cf-4e02-4def-a2e2-7c08ad6f0212 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:45.440102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1433/2847] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:28:45.444506 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb80445-5367-4ec6-80a6-7d0f92de58f4 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:45.454832 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb80445-5367-4ec6-80a6-7d0f92de58f4 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:45.461191 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92452a8f-6894-460e-a1be-12262e07dda1 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e09597e356d440dfa00cf1b0deac1222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f77c7ee6e1b49e7988612ed8c27058f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:45.461866 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452a8f-6894-460e-a1be-12262e07dda1 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.462136 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452a8f-6894-460e-a1be-12262e07dda1 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.462409 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452a8f-6894-460e-a1be-12262e07dda1 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.463053 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92452a8f-6894-460e-a1be-12262e07dda1 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:45.465008 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92452a8f-6894-460e-a1be-12262e07dda1 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:45.495716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1415/2848] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:45 2022] POST /identity/v3/projects => generated 355 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:45.500188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090964cf-4e02-4def-a2e2-7c08ad6f0212 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:45.510499 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090964cf-4e02-4def-a2e2-7c08ad6f0212 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:45.576214 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d5f62-a69a-49d3-889f-9a9b37a18605 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e09597e356d440dfa00cf1b0deac1222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f77c7ee6e1b49e7988612ed8c27058f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:45.576827 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d5f62-a69a-49d3-889f-9a9b37a18605 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.577109 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d5f62-a69a-49d3-889f-9a9b37a18605 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.577385 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d5f62-a69a-49d3-889f-9a9b37a18605 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.578033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d5f62-a69a-49d3-889f-9a9b37a18605 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:45.578370 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d5f62-a69a-49d3-889f-9a9b37a18605 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:45.580010 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d5f62-a69a-49d3-889f-9a9b37a18605 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:45.592123 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1434/2849] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:28:45.629726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92452a8f-6894-460e-a1be-12262e07dda1 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:45.640827 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92452a8f-6894-460e-a1be-12262e07dda1 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:45.647129 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cdd5a-67fe-439d-93a4-a064917fb87b tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e09597e356d440dfa00cf1b0deac1222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f77c7ee6e1b49e7988612ed8c27058f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:45.647787 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cdd5a-67fe-439d-93a4-a064917fb87b tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.648078 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cdd5a-67fe-439d-93a4-a064917fb87b tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.648350 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cdd5a-67fe-439d-93a4-a064917fb87b tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] PATH_INFO: `/v3/projects/4dcd8ccc0e0b4c7cbce436387bcd3a47` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.649663 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cdd5a-67fe-439d-93a4-a064917fb87b tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4dcd8ccc0e0b4c7cbce436387bcd3a47)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:45.651577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cdd5a-67fe-439d-93a4-a064917fb87b tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:45.704088 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-193cdd5a-67fe-439d-93a4-a064917fb87b tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dcd8ccc0e0b4c7cbce436387bcd3a47', 'request_id': 'req-193cdd5a-67fe-439d-93a4-a064917fb87b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:45.712744 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-193cdd5a-67fe-439d-93a4-a064917fb87b tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dcd8ccc0e0b4c7cbce436387bcd3a47', 'request_id': 'req-193cdd5a-67fe-439d-93a4-a064917fb87b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:45.718942 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-193cdd5a-67fe-439d-93a4-a064917fb87b tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dcd8ccc0e0b4c7cbce436387bcd3a47', 'request_id': 'req-193cdd5a-67fe-439d-93a4-a064917fb87b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:45.727982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:45.732420 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-193cdd5a-67fe-439d-93a4-a064917fb87b tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] The token cache is being invalidate because project 4dcd8ccc0e0b4c7cbce436387bcd3a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:45.732726 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-193cdd5a-67fe-439d-93a4-a064917fb87b tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:45.734053 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-193cdd5a-67fe-439d-93a4-a064917fb87b tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:45.739211 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1416/2850] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:45 2022] DELETE /identity/v3/projects/4dcd8ccc0e0b4c7cbce436387bcd3a47 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:45.934511 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d5f62-a69a-49d3-889f-9a9b37a18605 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:45.936304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-dc4d5f62-a69a-49d3-889f-9a9b37a18605 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:46.008111 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d5f62-a69a-49d3-889f-9a9b37a18605 tempest-VolumeQuotaClassesTest-1457144359 tempest-VolumeQuotaClassesTest-1457144359-project-admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:46.033164 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=100 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:46.066794 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ed942-d000-40e6-93a8-baf5138e0f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:46.067425 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ed942-d000-40e6-93a8-baf5138e0f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:46.067676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ed942-d000-40e6-93a8-baf5138e0f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:46.068015 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ed942-d000-40e6-93a8-baf5138e0f79 admin admin] PATH_INFO: `/v3/users/5de63c4b4ec14994b18eb7c89cfcfba2` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:46.069192 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ed942-d000-40e6-93a8-baf5138e0f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de63c4b4ec14994b18eb7c89cfcfba2)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:46.071113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ed942-d000-40e6-93a8-baf5138e0f79 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:46.123649 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-dd6ed942-d000-40e6-93a8-baf5138e0f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de63c4b4ec14994b18eb7c89cfcfba2'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.136905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-dd6ed942-d000-40e6-93a8-baf5138e0f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de63c4b4ec14994b18eb7c89cfcfba2'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.144456 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-dd6ed942-d000-40e6-93a8-baf5138e0f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de63c4b4ec14994b18eb7c89cfcfba2'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.153437 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-dd6ed942-d000-40e6-93a8-baf5138e0f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de63c4b4ec14994b18eb7c89cfcfba2'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.154208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-dd6ed942-d000-40e6-93a8-baf5138e0f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de63c4b4ec14994b18eb7c89cfcfba2'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.160244 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1435/2851] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:45 2022] DELETE /identity/v3/users/5de63c4b4ec14994b18eb7c89cfcfba2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:46.165833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedd7fa-3381-4912-8356-e987db9a122c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:46.166125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedd7fa-3381-4912-8356-e987db9a122c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:46.166389 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedd7fa-3381-4912-8356-e987db9a122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:46.189933 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ecedd7fa-3381-4912-8356-e987db9a122c None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:46.191155 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ecedd7fa-3381-4912-8356-e987db9a122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:46.251732 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1417/2852] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:46.261418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ed942-d000-40e6-93a8-baf5138e0f79 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:46.263064 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-dd6ed942-d000-40e6-93a8-baf5138e0f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:46.328964 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ed942-d000-40e6-93a8-baf5138e0f79 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:46.333681 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7aee84-f922-49df-86f3-9f33d9de22d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:46.334302 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aee84-f922-49df-86f3-9f33d9de22d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:46.334581 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aee84-f922-49df-86f3-9f33d9de22d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:46.334851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aee84-f922-49df-86f3-9f33d9de22d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:46.345576 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7aee84-f922-49df-86f3-9f33d9de22d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:46.347230 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7aee84-f922-49df-86f3-9f33d9de22d7 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:46.356903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1436/2853] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:46.661541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedd7fa-3381-4912-8356-e987db9a122c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:46.663159 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ecedd7fa-3381-4912-8356-e987db9a122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:46.676936 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedd7fa-3381-4912-8356-e987db9a122c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:46.683012 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:46.683796 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:46.684148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:46.684489 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] PATH_INFO: `/v3/projects/0446c5459be04d9b85998af5c716266b` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:46.685789 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0446c5459be04d9b85998af5c716266b)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:46.687818 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:46.739224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0446c5459be04d9b85998af5c716266b', 'request_id': 'req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.747766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0446c5459be04d9b85998af5c716266b', 'request_id': 'req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.753254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0446c5459be04d9b85998af5c716266b', 'request_id': 'req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.764896 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] The token cache is being invalidate because project 0446c5459be04d9b85998af5c716266b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:46.765217 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.766000 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.767747 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1418/2854] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:46 2022] DELETE /identity/v3/projects/0446c5459be04d9b85998af5c716266b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:46.772227 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7aee84-f922-49df-86f3-9f33d9de22d7 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:46.782241 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7aee84-f922-49df-86f3-9f33d9de22d7 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:46.832557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:46.845727 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfbdb4-b958-42ca-a323-29803aaa03e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:46.846732 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfbdb4-b958-42ca-a323-29803aaa03e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:46.848190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfbdb4-b958-42ca-a323-29803aaa03e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:46.848683 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfbdb4-b958-42ca-a323-29803aaa03e0 admin admin] PATH_INFO: `/v3/users/e09597e356d440dfa00cf1b0deac1222` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:46.850784 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfbdb4-b958-42ca-a323-29803aaa03e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09597e356d440dfa00cf1b0deac1222)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:46.852884 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfbdb4-b958-42ca-a323-29803aaa03e0 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:46.910065 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-eebfbdb4-b958-42ca-a323-29803aaa03e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09597e356d440dfa00cf1b0deac1222'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.922881 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-eebfbdb4-b958-42ca-a323-29803aaa03e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09597e356d440dfa00cf1b0deac1222'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.930638 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-eebfbdb4-b958-42ca-a323-29803aaa03e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09597e356d440dfa00cf1b0deac1222'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.939270 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-eebfbdb4-b958-42ca-a323-29803aaa03e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09597e356d440dfa00cf1b0deac1222'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.939936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-eebfbdb4-b958-42ca-a323-29803aaa03e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09597e356d440dfa00cf1b0deac1222'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:46.946430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1437/2855] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:46 2022] DELETE /identity/v3/users/e09597e356d440dfa00cf1b0deac1222 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:28:47.240393 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:47.241877 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:47.323045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eb1a4-66f5-4c4b-906e-b5d53d6441e0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:47.339576 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:47.383174 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b599de8-a95a-4d44-899f-cb2b72170a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:47.383833 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b599de8-a95a-4d44-899f-cb2b72170a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:47.384118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b599de8-a95a-4d44-899f-cb2b72170a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:47.384392 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b599de8-a95a-4d44-899f-cb2b72170a69 admin admin] PATH_INFO: `/v3/projects/8f77c7ee6e1b49e7988612ed8c27058f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:47.385682 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b599de8-a95a-4d44-899f-cb2b72170a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f77c7ee6e1b49e7988612ed8c27058f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:47.387615 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b599de8-a95a-4d44-899f-cb2b72170a69 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:47.440457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5b599de8-a95a-4d44-899f-cb2b72170a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f77c7ee6e1b49e7988612ed8c27058f', 'request_id': 'req-5b599de8-a95a-4d44-899f-cb2b72170a69'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:47.448965 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5b599de8-a95a-4d44-899f-cb2b72170a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f77c7ee6e1b49e7988612ed8c27058f', 'request_id': 'req-5b599de8-a95a-4d44-899f-cb2b72170a69'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:47.455071 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5b599de8-a95a-4d44-899f-cb2b72170a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f77c7ee6e1b49e7988612ed8c27058f', 'request_id': 'req-5b599de8-a95a-4d44-899f-cb2b72170a69'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:47.466912 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5b599de8-a95a-4d44-899f-cb2b72170a69 admin admin] The token cache is being invalidate because project 8f77c7ee6e1b49e7988612ed8c27058f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:47.467227 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5b599de8-a95a-4d44-899f-cb2b72170a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:47.467895 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5b599de8-a95a-4d44-899f-cb2b72170a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:47.469366 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1419/2856] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:47 2022] DELETE /identity/v3/projects/8f77c7ee6e1b49e7988612ed8c27058f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:47.474377 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292f832-56fa-40d6-970b-a53778bd0ec1 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:47.474713 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292f832-56fa-40d6-970b-a53778bd0ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:47.474990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292f832-56fa-40d6-970b-a53778bd0ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:47.541275 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-1292f832-56fa-40d6-970b-a53778bd0ec1 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:47.542393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-1292f832-56fa-40d6-970b-a53778bd0ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:47.610744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1438/2857] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:47.622250 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c45a1-fbac-49e0-912d-c050f7e96b2d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:47.622643 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c45a1-fbac-49e0-912d-c050f7e96b2d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:47.622927 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c45a1-fbac-49e0-912d-c050f7e96b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:47.644187 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4a4c45a1-fbac-49e0-912d-c050f7e96b2d None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:47.645488 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4a4c45a1-fbac-49e0-912d-c050f7e96b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:47.654060 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1420/2858] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:47.658730 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292f832-56fa-40d6-970b-a53778bd0ec1 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:47.669375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292f832-56fa-40d6-970b-a53778bd0ec1 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:47.674119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d6487-9aaf-4579-b70a-8bf422849533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:47.674717 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6487-9aaf-4579-b70a-8bf422849533 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:47.674990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6487-9aaf-4579-b70a-8bf422849533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:47.675260 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6487-9aaf-4579-b70a-8bf422849533 admin admin] PATH_INFO: `/v3/domains` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:47.675913 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d6487-9aaf-4579-b70a-8bf422849533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:47.676211 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d6487-9aaf-4579-b70a-8bf422849533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:47.677801 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d6487-9aaf-4579-b70a-8bf422849533 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:47.693261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1439/2859] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:28:47.694384 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c45a1-fbac-49e0-912d-c050f7e96b2d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:47.704278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c45a1-fbac-49e0-912d-c050f7e96b2d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:47.710266 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02113e1-8b5c-45be-a29c-d3421debffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:47.710875 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02113e1-8b5c-45be-a29c-d3421debffa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:47.711154 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02113e1-8b5c-45be-a29c-d3421debffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:47.711422 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02113e1-8b5c-45be-a29c-d3421debffa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:47.712089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02113e1-8b5c-45be-a29c-d3421debffa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:47.714037 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02113e1-8b5c-45be-a29c-d3421debffa5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:47.743560 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1421/2860] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:47 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:47.748095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d6487-9aaf-4579-b70a-8bf422849533 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:47.758156 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d6487-9aaf-4579-b70a-8bf422849533 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:47.782369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:47.819246 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce23b1-3ca2-493a-8918-5561051b739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:47.819804 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce23b1-3ca2-493a-8918-5561051b739a admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:47.820086 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce23b1-3ca2-493a-8918-5561051b739a admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:47.820359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce23b1-3ca2-493a-8918-5561051b739a admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:47.820987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce23b1-3ca2-493a-8918-5561051b739a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:47.822905 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce23b1-3ca2-493a-8918-5561051b739a admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:47.845432 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1440/2861] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:47 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:47.849693 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02113e1-8b5c-45be-a29c-d3421debffa5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:47.860184 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02113e1-8b5c-45be-a29c-d3421debffa5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:47.865918 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218da198-adc8-4abf-b985-9a50a1e09fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:47.866521 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218da198-adc8-4abf-b985-9a50a1e09fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:47.866790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218da198-adc8-4abf-b985-9a50a1e09fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:47.867061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218da198-adc8-4abf-b985-9a50a1e09fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:47.867738 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218da198-adc8-4abf-b985-9a50a1e09fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:47.869361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218da198-adc8-4abf-b985-9a50a1e09fa6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:47.879868 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1422/2862] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:28:47.885381 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce23b1-3ca2-493a-8918-5561051b739a admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:47.896036 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce23b1-3ca2-493a-8918-5561051b739a admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:47.901738 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7554e1-9d9f-45e8-a0f5-dc6d93e37eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:47.902334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7554e1-9d9f-45e8-a0f5-dc6d93e37eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:47.902640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7554e1-9d9f-45e8-a0f5-dc6d93e37eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:47.902909 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7554e1-9d9f-45e8-a0f5-dc6d93e37eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:47.903545 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7554e1-9d9f-45e8-a0f5-dc6d93e37eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:47.905186 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7554e1-9d9f-45e8-a0f5-dc6d93e37eb0 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:47.916041 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1441/2863] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:47.920280 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218da198-adc8-4abf-b985-9a50a1e09fa6 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:47.930359 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218da198-adc8-4abf-b985-9a50a1e09fa6 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:47.935554 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c348-07b0-4886-8ba0-1678fb7aedb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:47.936212 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c348-07b0-4886-8ba0-1678fb7aedb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:47.936509 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c348-07b0-4886-8ba0-1678fb7aedb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:47.936774 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c348-07b0-4886-8ba0-1678fb7aedb2 admin admin] PATH_INFO: `/v3/projects/c8db41197ddc4ee0beb1d043e1cf6d53/users/342c6808e65c49ae94f8ca94ee51df5a/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:47.952367 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437c348-07b0-4886-8ba0-1678fb7aedb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8db41197ddc4ee0beb1d043e1cf6d53, user_id=342c6808e65c49ae94f8ca94ee51df5a, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:47.954982 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437c348-07b0-4886-8ba0-1678fb7aedb2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:47.969148 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1423/2864] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:47 2022] PUT /identity/v3/projects/c8db41197ddc4ee0beb1d043e1cf6d53/users/342c6808e65c49ae94f8ca94ee51df5a/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:47.981500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63371706-1b01-4b27-9ec1-c6fc07934980 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:47.981985 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63371706-1b01-4b27-9ec1-c6fc07934980 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:47.982256 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63371706-1b01-4b27-9ec1-c6fc07934980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:48.010379 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-63371706-1b01-4b27-9ec1-c6fc07934980 None None] MFA Rules not processed for user `342c6808e65c49ae94f8ca94ee51df5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:48.011560 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-63371706-1b01-4b27-9ec1-c6fc07934980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:48.088762 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1442/2865] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:48.093466 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c348-07b0-4886-8ba0-1678fb7aedb2 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:48.144669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:48.161652 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c348-07b0-4886-8ba0-1678fb7aedb2 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:48.166899 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c2fb5-2047-4379-a83e-f83e030043d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:48.168017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c2fb5-2047-4379-a83e-f83e030043d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:48.168017 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c2fb5-2047-4379-a83e-f83e030043d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:48.168196 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c2fb5-2047-4379-a83e-f83e030043d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:48.168700 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c2fb5-2047-4379-a83e-f83e030043d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:48.170669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c2fb5-2047-4379-a83e-f83e030043d8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:48.199871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1424/2866] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:48 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:48.204310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63371706-1b01-4b27-9ec1-c6fc07934980 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:48.217711 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63371706-1b01-4b27-9ec1-c6fc07934980 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:48.281462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86416967-b3db-4b93-af84-0511f2ff79d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:48.282070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86416967-b3db-4b93-af84-0511f2ff79d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:48.282352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86416967-b3db-4b93-af84-0511f2ff79d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:48.282622 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86416967-b3db-4b93-af84-0511f2ff79d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:48.283251 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86416967-b3db-4b93-af84-0511f2ff79d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:48.285200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86416967-b3db-4b93-af84-0511f2ff79d4 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:48.307396 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1443/2867] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:48 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:48.311459 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c2fb5-2047-4379-a83e-f83e030043d8 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:48.322020 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c2fb5-2047-4379-a83e-f83e030043d8 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:48.327574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c732a-7c97-4f1d-a4e6-881ad34ad536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:48.328137 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c732a-7c97-4f1d-a4e6-881ad34ad536 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:48.328414 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c732a-7c97-4f1d-a4e6-881ad34ad536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:48.328683 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c732a-7c97-4f1d-a4e6-881ad34ad536 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:48.329326 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c732a-7c97-4f1d-a4e6-881ad34ad536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:48.330930 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c732a-7c97-4f1d-a4e6-881ad34ad536 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:48.341943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1425/2868] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:48.346709 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86416967-b3db-4b93-af84-0511f2ff79d4 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:48.362276 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86416967-b3db-4b93-af84-0511f2ff79d4 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:48.369900 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954e141-ca78-413b-8828-f8f489e7e07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:48.370582 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954e141-ca78-413b-8828-f8f489e7e07e admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:48.370853 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954e141-ca78-413b-8828-f8f489e7e07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:48.371151 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954e141-ca78-413b-8828-f8f489e7e07e admin admin] PATH_INFO: `/v3/projects/fde68953e0854f0ea93ee9db364023e0/users/9250d1bf311b430486a67a191df836bb/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:48.386448 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954e141-ca78-413b-8828-f8f489e7e07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde68953e0854f0ea93ee9db364023e0, user_id=9250d1bf311b430486a67a191df836bb, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:48.389129 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954e141-ca78-413b-8828-f8f489e7e07e admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:48.399315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:48.405382 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1444/2869] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:48 2022] PUT /identity/v3/projects/fde68953e0854f0ea93ee9db364023e0/users/9250d1bf311b430486a67a191df836bb/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:48.409365 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c732a-7c97-4f1d-a4e6-881ad34ad536 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:48.419846 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c732a-7c97-4f1d-a4e6-881ad34ad536 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:48.476407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94f6f0-14c2-4f1f-b831-7f764bcd6c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:48.477049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94f6f0-14c2-4f1f-b831-7f764bcd6c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:48.477327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94f6f0-14c2-4f1f-b831-7f764bcd6c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:48.477595 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94f6f0-14c2-4f1f-b831-7f764bcd6c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:48.478255 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94f6f0-14c2-4f1f-b831-7f764bcd6c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:48.479881 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94f6f0-14c2-4f1f-b831-7f764bcd6c7d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:48.490943 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1426/2870] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:48.496987 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954e141-ca78-413b-8828-f8f489e7e07e admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:48.507936 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954e141-ca78-413b-8828-f8f489e7e07e admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:48.513554 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5890540-e609-456e-973e-6b3b4b06bb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:48.514210 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5890540-e609-456e-973e-6b3b4b06bb06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:48.514484 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5890540-e609-456e-973e-6b3b4b06bb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:48.514747 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5890540-e609-456e-973e-6b3b4b06bb06 admin admin] PATH_INFO: `/v3/projects/fde68953e0854f0ea93ee9db364023e0/users/9250d1bf311b430486a67a191df836bb/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:48.516920 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5890540-e609-456e-973e-6b3b4b06bb06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde68953e0854f0ea93ee9db364023e0, user_id=9250d1bf311b430486a67a191df836bb, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:48.519570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5890540-e609-456e-973e-6b3b4b06bb06 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:48.531932 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1445/2871] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:48 2022] PUT /identity/v3/projects/fde68953e0854f0ea93ee9db364023e0/users/9250d1bf311b430486a67a191df836bb/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:28:48.605941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded17195-9e50-4ecc-aa3d-7a9a4728f879 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:48.606158 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded17195-9e50-4ecc-aa3d-7a9a4728f879 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:48.606396 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded17195-9e50-4ecc-aa3d-7a9a4728f879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:48.637254 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ded17195-9e50-4ecc-aa3d-7a9a4728f879 None None] MFA Rules not processed for user `9250d1bf311b430486a67a191df836bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:48.638539 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ded17195-9e50-4ecc-aa3d-7a9a4728f879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:48.717586 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1427/2872] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:48.733149 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5890540-e609-456e-973e-6b3b4b06bb06 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:48.735021 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-c5890540-e609-456e-973e-6b3b4b06bb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:48.816138 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5890540-e609-456e-973e-6b3b4b06bb06 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:48.820862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b195bfe-3499-425e-80af-7798f1497e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:48.821465 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b195bfe-3499-425e-80af-7798f1497e96 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:48.821738 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b195bfe-3499-425e-80af-7798f1497e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:48.822005 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b195bfe-3499-425e-80af-7798f1497e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:48.889274 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b195bfe-3499-425e-80af-7798f1497e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:48.890724 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b195bfe-3499-425e-80af-7798f1497e96 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:48.899417 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1446/2873] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:50.562907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded17195-9e50-4ecc-aa3d-7a9a4728f879 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:50.564534 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ded17195-9e50-4ecc-aa3d-7a9a4728f879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:50.617141 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:50.630798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded17195-9e50-4ecc-aa3d-7a9a4728f879 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:50.634668 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2e673-2db6-491f-9b90-9b4a6dc333bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:50.635376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2e673-2db6-491f-9b90-9b4a6dc333bf service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:50.635619 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2e673-2db6-491f-9b90-9b4a6dc333bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:50.635920 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2e673-2db6-491f-9b90-9b4a6dc333bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:50.637921 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-33a2e673-2db6-491f-9b90-9b4a6dc333bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:50.648468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2e673-2db6-491f-9b90-9b4a6dc333bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:50.649902 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2e673-2db6-491f-9b90-9b4a6dc333bf service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:50.659990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1428/2874] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:28:53.182882 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b195bfe-3499-425e-80af-7798f1497e96 service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:53.192838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b195bfe-3499-425e-80af-7798f1497e96 service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:53.198057 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80a6df-1d91-4271-89cd-2ceceab265c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:53.198662 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a6df-1d91-4271-89cd-2ceceab265c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:53.198947 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a6df-1d91-4271-89cd-2ceceab265c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:53.199239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a6df-1d91-4271-89cd-2ceceab265c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:53.209352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80a6df-1d91-4271-89cd-2ceceab265c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:53.210841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80a6df-1d91-4271-89cd-2ceceab265c9 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:53.221333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1447/2875] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:58.237093 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2e673-2db6-491f-9b90-9b4a6dc333bf service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:58.302886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2e673-2db6-491f-9b90-9b4a6dc333bf service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:58.307578 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62188805-d270-4330-91c3-0b2004cd0232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:58.308226 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188805-d270-4330-91c3-0b2004cd0232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:58.308503 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188805-d270-4330-91c3-0b2004cd0232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:58.308771 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188805-d270-4330-91c3-0b2004cd0232 admin admin] PATH_INFO: `/v3/users/342c6808e65c49ae94f8ca94ee51df5a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:58.309976 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62188805-d270-4330-91c3-0b2004cd0232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=342c6808e65c49ae94f8ca94ee51df5a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:58.311932 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62188805-d270-4330-91c3-0b2004cd0232 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:58.362115 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-62188805-d270-4330-91c3-0b2004cd0232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '342c6808e65c49ae94f8ca94ee51df5a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.375349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-62188805-d270-4330-91c3-0b2004cd0232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '342c6808e65c49ae94f8ca94ee51df5a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.382340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-62188805-d270-4330-91c3-0b2004cd0232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '342c6808e65c49ae94f8ca94ee51df5a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.391287 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-62188805-d270-4330-91c3-0b2004cd0232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '342c6808e65c49ae94f8ca94ee51df5a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.391923 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-62188805-d270-4330-91c3-0b2004cd0232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '342c6808e65c49ae94f8ca94ee51df5a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.397852 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1429/2876] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:58 2022] DELETE /identity/v3/users/342c6808e65c49ae94f8ca94ee51df5a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:58.402396 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819461a5-578f-4b10-8211-cffc54ff3896 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:58.402913 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819461a5-578f-4b10-8211-cffc54ff3896 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:58.403039 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819461a5-578f-4b10-8211-cffc54ff3896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:58.423824 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-819461a5-578f-4b10-8211-cffc54ff3896 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:58.425020 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-819461a5-578f-4b10-8211-cffc54ff3896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:58.488263 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1448/2877] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:58.498452 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62188805-d270-4330-91c3-0b2004cd0232 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:58.499974 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-62188805-d270-4330-91c3-0b2004cd0232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:58.560681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62188805-d270-4330-91c3-0b2004cd0232 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:58.564690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa8f91-f3bd-4a89-a87c-3f3e78af315f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:58.565295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa8f91-f3bd-4a89-a87c-3f3e78af315f service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:58.565580 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa8f91-f3bd-4a89-a87c-3f3e78af315f service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:58.565850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa8f91-f3bd-4a89-a87c-3f3e78af315f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:58.575441 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa8f91-f3bd-4a89-a87c-3f3e78af315f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:58.576985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa8f91-f3bd-4a89-a87c-3f3e78af315f service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:58.586659 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1430/2878] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:58.865867 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819461a5-578f-4b10-8211-cffc54ff3896 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:58.867584 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-819461a5-578f-4b10-8211-cffc54ff3896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:58.880605 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819461a5-578f-4b10-8211-cffc54ff3896 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:58.886758 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:58.887399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:58.887677 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:58.887984 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] PATH_INFO: `/v3/projects/c8db41197ddc4ee0beb1d043e1cf6d53` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:58.889112 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8db41197ddc4ee0beb1d043e1cf6d53)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:58.891153 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:58.902862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:58.947034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8db41197ddc4ee0beb1d043e1cf6d53', 'request_id': 'req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.956557 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8db41197ddc4ee0beb1d043e1cf6d53', 'request_id': 'req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.962992 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8db41197ddc4ee0beb1d043e1cf6d53', 'request_id': 'req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.976178 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] The token cache is being invalidate because project c8db41197ddc4ee0beb1d043e1cf6d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:58.976467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.977121 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.978861 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1449/2879] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:58 2022] DELETE /identity/v3/projects/c8db41197ddc4ee0beb1d043e1cf6d53 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:58.983045 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa8f91-f3bd-4a89-a87c-3f3e78af315f service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:58.993278 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa8f91-f3bd-4a89-a87c-3f3e78af315f service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:58.997455 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:59.061202 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c266-58ea-413a-9ddd-887a44853e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:59.061832 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c266-58ea-413a-9ddd-887a44853e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:59.062093 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c266-58ea-413a-9ddd-887a44853e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:59.062360 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c266-58ea-413a-9ddd-887a44853e18 admin admin] PATH_INFO: `/v3/users/9250d1bf311b430486a67a191df836bb` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:59.063470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0c266-58ea-413a-9ddd-887a44853e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9250d1bf311b430486a67a191df836bb)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:59.065424 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0c266-58ea-413a-9ddd-887a44853e18 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:59.113150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5cf0c266-58ea-413a-9ddd-887a44853e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9250d1bf311b430486a67a191df836bb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.125284 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5cf0c266-58ea-413a-9ddd-887a44853e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9250d1bf311b430486a67a191df836bb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.132871 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5cf0c266-58ea-413a-9ddd-887a44853e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9250d1bf311b430486a67a191df836bb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.141484 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5cf0c266-58ea-413a-9ddd-887a44853e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9250d1bf311b430486a67a191df836bb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.142349 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5cf0c266-58ea-413a-9ddd-887a44853e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9250d1bf311b430486a67a191df836bb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.149650 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1431/2880] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:58 2022] DELETE /identity/v3/users/9250d1bf311b430486a67a191df836bb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:59.432928 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:59.434567 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:59.449359 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b1fc6-d851-4fa3-966b-cfc12bcdb863 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:59.506744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265801ac-9338-4803-a599-86fee2869c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:59.507375 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265801ac-9338-4803-a599-86fee2869c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:59.507653 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265801ac-9338-4803-a599-86fee2869c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:59.507950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265801ac-9338-4803-a599-86fee2869c28 admin admin] PATH_INFO: `/v3/projects/fde68953e0854f0ea93ee9db364023e0` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:59.509058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265801ac-9338-4803-a599-86fee2869c28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde68953e0854f0ea93ee9db364023e0)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:59.510962 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265801ac-9338-4803-a599-86fee2869c28 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:59.564416 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-265801ac-9338-4803-a599-86fee2869c28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde68953e0854f0ea93ee9db364023e0', 'request_id': 'req-265801ac-9338-4803-a599-86fee2869c28'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.572732 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-265801ac-9338-4803-a599-86fee2869c28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde68953e0854f0ea93ee9db364023e0', 'request_id': 'req-265801ac-9338-4803-a599-86fee2869c28'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.578350 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-265801ac-9338-4803-a599-86fee2869c28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde68953e0854f0ea93ee9db364023e0', 'request_id': 'req-265801ac-9338-4803-a599-86fee2869c28'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.589070 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-265801ac-9338-4803-a599-86fee2869c28 admin admin] The token cache is being invalidate because project fde68953e0854f0ea93ee9db364023e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:59.589354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-265801ac-9338-4803-a599-86fee2869c28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.589981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-265801ac-9338-4803-a599-86fee2869c28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.591516 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1450/2881] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:59 2022] DELETE /identity/v3/projects/fde68953e0854f0ea93ee9db364023e0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:59.597474 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0730f-13a4-44af-92aa-3430ce2462fe None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:59.597993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0730f-13a4-44af-92aa-3430ce2462fe None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:59.598120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0730f-13a4-44af-92aa-3430ce2462fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:59.619971 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-96c0730f-13a4-44af-92aa-3430ce2462fe None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:59.621228 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-96c0730f-13a4-44af-92aa-3430ce2462fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:59.682847 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1432/2882] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:59.691663 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26e84b-f156-4065-a2f4-34de4263307e None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:59.691983 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26e84b-f156-4065-a2f4-34de4263307e None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:59.692256 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26e84b-f156-4065-a2f4-34de4263307e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:59.712617 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-7c26e84b-f156-4065-a2f4-34de4263307e None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:59.713819 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-7c26e84b-f156-4065-a2f4-34de4263307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:59.722310 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1451/2883] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:59.727139 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0730f-13a4-44af-92aa-3430ce2462fe None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:59.743673 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0730f-13a4-44af-92aa-3430ce2462fe None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:59.750753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130be14e-f6ba-4dc6-ad90-86e61f3a8590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:59.751376 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130be14e-f6ba-4dc6-ad90-86e61f3a8590 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:59.751623 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130be14e-f6ba-4dc6-ad90-86e61f3a8590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:59.751951 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130be14e-f6ba-4dc6-ad90-86e61f3a8590 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:59.752601 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130be14e-f6ba-4dc6-ad90-86e61f3a8590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:59.752907 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130be14e-f6ba-4dc6-ad90-86e61f3a8590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:59.754523 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130be14e-f6ba-4dc6-ad90-86e61f3a8590 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:59.766757 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1433/2884] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:28:59.772995 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26e84b-f156-4065-a2f4-34de4263307e None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:59.784223 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26e84b-f156-4065-a2f4-34de4263307e None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:59.790531 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ada60-61e4-46e4-941f-738ddc78484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:59.791128 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ada60-61e4-46e4-941f-738ddc78484d admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:59.791379 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ada60-61e4-46e4-941f-738ddc78484d admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:59.791666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ada60-61e4-46e4-941f-738ddc78484d admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:59.792317 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ada60-61e4-46e4-941f-738ddc78484d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:59.794326 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ada60-61e4-46e4-941f-738ddc78484d admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:59.819185 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:59.830594 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1452/2885] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:59 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:59.831861 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130be14e-f6ba-4dc6-ad90-86e61f3a8590 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:59.843029 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130be14e-f6ba-4dc6-ad90-86e61f3a8590 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:59.853816 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:59.908598 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b0479-6b7e-4caa-a8bf-d992e4f5ae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:59.909241 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0479-6b7e-4caa-a8bf-d992e4f5ae0f admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:59.909562 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0479-6b7e-4caa-a8bf-d992e4f5ae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:59.909834 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0479-6b7e-4caa-a8bf-d992e4f5ae0f admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:59.910469 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b0479-6b7e-4caa-a8bf-d992e4f5ae0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:59.912426 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b0479-6b7e-4caa-a8bf-d992e4f5ae0f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:59.935025 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1434/2886] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:59 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:59.939471 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ada60-61e4-46e4-941f-738ddc78484d admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:59.950181 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ada60-61e4-46e4-941f-738ddc78484d admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:59.960168 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc7497-f886-45c7-ade7-4b693fc806b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:59.961052 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc7497-f886-45c7-ade7-4b693fc806b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:59.961451 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc7497-f886-45c7-ade7-4b693fc806b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:59.961748 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc7497-f886-45c7-ade7-4b693fc806b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:59.962549 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc7497-f886-45c7-ade7-4b693fc806b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:59.965593 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc7497-f886-45c7-ade7-4b693fc806b5 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:59.980798 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1453/2887] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:59.985477 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b0479-6b7e-4caa-a8bf-d992e4f5ae0f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:59.999110 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b0479-6b7e-4caa-a8bf-d992e4f5ae0f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:00.004277 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d1e40-e099-474b-a90a-d9f2ad3ab130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:00.004886 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d1e40-e099-474b-a90a-d9f2ad3ab130 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.005168 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d1e40-e099-474b-a90a-d9f2ad3ab130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.005470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d1e40-e099-474b-a90a-d9f2ad3ab130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.006147 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d1e40-e099-474b-a90a-d9f2ad3ab130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:00.007851 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d1e40-e099-474b-a90a-d9f2ad3ab130 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:00.019325 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1435/2888] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:00.023975 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc7497-f886-45c7-ade7-4b693fc806b5 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:00.034640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc7497-f886-45c7-ade7-4b693fc806b5 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:00.040981 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bc015-fcb7-4585-8f27-d424ae659c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:00.041641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bc015-fcb7-4585-8f27-d424ae659c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.041917 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bc015-fcb7-4585-8f27-d424ae659c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.042188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bc015-fcb7-4585-8f27-d424ae659c2b admin admin] PATH_INFO: `/v3/projects/d5b5999182f940dda228a41d1eccc02b/users/0c5903b3556d4e6f92091248d905daa6/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.057823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17bc015-fcb7-4585-8f27-d424ae659c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b5999182f940dda228a41d1eccc02b, user_id=0c5903b3556d4e6f92091248d905daa6, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:00.060542 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17bc015-fcb7-4585-8f27-d424ae659c2b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:00.075304 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1454/2889] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:00 2022] PUT /identity/v3/projects/d5b5999182f940dda228a41d1eccc02b/users/0c5903b3556d4e6f92091248d905daa6/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:00.088068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7a6d-58a4-48c0-9e11-6e65498cc03a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.088353 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7a6d-58a4-48c0-9e11-6e65498cc03a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.088646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7a6d-58a4-48c0-9e11-6e65498cc03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.117222 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-5c9c7a6d-58a4-48c0-9e11-6e65498cc03a None None] MFA Rules not processed for user `0c5903b3556d4e6f92091248d905daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:00.118394 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5c9c7a6d-58a4-48c0-9e11-6e65498cc03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:00.193160 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1436/2890] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:29:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:00.205387 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bc015-fcb7-4585-8f27-d424ae659c2b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:00.207433 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-f17bc015-fcb7-4585-8f27-d424ae659c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:00.273474 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bc015-fcb7-4585-8f27-d424ae659c2b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:00.277591 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c5efe-3742-4e10-bcf0-557a50536f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc36c937503477e8542cbef7c5f5db8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:00.278204 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c5efe-3742-4e10-bcf0-557a50536f39 service cinder] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.278614 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c5efe-3742-4e10-bcf0-557a50536f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.278768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c5efe-3742-4e10-bcf0-557a50536f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.289106 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c5efe-3742-4e10-bcf0-557a50536f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:00.290903 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c5efe-3742-4e10-bcf0-557a50536f39 service cinder] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:00.301011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1455/2891] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:00.899369 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c7a6d-58a4-48c0-9e11-6e65498cc03a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:00.902019 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5c9c7a6d-58a4-48c0-9e11-6e65498cc03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:00.964807 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c7a6d-58a4-48c0-9e11-6e65498cc03a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:00.968981 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199aef7-adb0-4706-8f6a-aae3ee279b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:00.969594 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199aef7-adb0-4706-8f6a-aae3ee279b85 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.969875 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199aef7-adb0-4706-8f6a-aae3ee279b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.970150 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199aef7-adb0-4706-8f6a-aae3ee279b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.972128 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2199aef7-adb0-4706-8f6a-aae3ee279b85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:01.015669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:01.048073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199aef7-adb0-4706-8f6a-aae3ee279b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:01.050216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199aef7-adb0-4706-8f6a-aae3ee279b85 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:01.062405 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1437/2892] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:02.919666 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c5efe-3742-4e10-bcf0-557a50536f39 service cinder] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:02.921803 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-078c5efe-3742-4e10-bcf0-557a50536f39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:03.032159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c5efe-3742-4e10-bcf0-557a50536f39 service cinder] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:03.037782 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74d001-b9cf-40c6-845f-6ca7ad902dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:03.038384 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74d001-b9cf-40c6-845f-6ca7ad902dc8 service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:03.038659 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74d001-b9cf-40c6-845f-6ca7ad902dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:03.038929 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74d001-b9cf-40c6-845f-6ca7ad902dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:03.041209 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ab74d001-b9cf-40c6-845f-6ca7ad902dc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:03.054558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74d001-b9cf-40c6-845f-6ca7ad902dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:03.056190 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74d001-b9cf-40c6-845f-6ca7ad902dc8 service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:03.067163 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1456/2893] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:11.056669 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=13 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:13.062665 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:30.355904 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199aef7-adb0-4706-8f6a-aae3ee279b85 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:30.420655 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199aef7-adb0-4706-8f6a-aae3ee279b85 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:30.426011 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ee373-7c9e-4646-a1e3-12020a70fc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:30.426571 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ee373-7c9e-4646-a1e3-12020a70fc16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:30.426856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ee373-7c9e-4646-a1e3-12020a70fc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:30.427125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ee373-7c9e-4646-a1e3-12020a70fc16 admin admin] PATH_INFO: `/v3/users/0c5903b3556d4e6f92091248d905daa6` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:30.428394 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ee373-7c9e-4646-a1e3-12020a70fc16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5903b3556d4e6f92091248d905daa6)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:30.430308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ee373-7c9e-4646-a1e3-12020a70fc16 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:30.482895 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9b6ee373-7c9e-4646-a1e3-12020a70fc16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5903b3556d4e6f92091248d905daa6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:30.496548 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9b6ee373-7c9e-4646-a1e3-12020a70fc16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5903b3556d4e6f92091248d905daa6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:30.504061 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9b6ee373-7c9e-4646-a1e3-12020a70fc16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5903b3556d4e6f92091248d905daa6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:30.512850 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9b6ee373-7c9e-4646-a1e3-12020a70fc16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5903b3556d4e6f92091248d905daa6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:30.513479 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9b6ee373-7c9e-4646-a1e3-12020a70fc16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5903b3556d4e6f92091248d905daa6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:30.519357 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1438/2894] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:30 2022] DELETE /identity/v3/users/0c5903b3556d4e6f92091248d905daa6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:30.525146 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7595313-8c3c-43df-8f4c-30e2169d0380 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:30.525649 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7595313-8c3c-43df-8f4c-30e2169d0380 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:30.525768 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7595313-8c3c-43df-8f4c-30e2169d0380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:30.546247 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-a7595313-8c3c-43df-8f4c-30e2169d0380 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:30.547467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a7595313-8c3c-43df-8f4c-30e2169d0380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:30.610744 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1457/2895] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:30.621816 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ee373-7c9e-4646-a1e3-12020a70fc16 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:30.624564 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9b6ee373-7c9e-4646-a1e3-12020a70fc16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:30.721249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ee373-7c9e-4646-a1e3-12020a70fc16 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:30.725342 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087a894-68e7-48e7-a6f0-85b6bb6eeae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:30.725941 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087a894-68e7-48e7-a6f0-85b6bb6eeae1 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:30.726216 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087a894-68e7-48e7-a6f0-85b6bb6eeae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:30.726485 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087a894-68e7-48e7-a6f0-85b6bb6eeae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:30.735620 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087a894-68e7-48e7-a6f0-85b6bb6eeae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:30.737073 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087a894-68e7-48e7-a6f0-85b6bb6eeae1 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:30.746583 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1439/2896] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:31.038565 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7595313-8c3c-43df-8f4c-30e2169d0380 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:31.040605 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-a7595313-8c3c-43df-8f4c-30e2169d0380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:31.054112 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7595313-8c3c-43df-8f4c-30e2169d0380 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:31.059558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:31.060280 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:31.060498 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:31.060764 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1 admin admin] PATH_INFO: `/v3/projects/d5b5999182f940dda228a41d1eccc02b` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:31.061974 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b5999182f940dda228a41d1eccc02b)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:31.063973 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:31.114102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b5999182f940dda228a41d1eccc02b', 'request_id': 'req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:31.122500 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b5999182f940dda228a41d1eccc02b', 'request_id': 'req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:31.128119 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b5999182f940dda228a41d1eccc02b', 'request_id': 'req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:31.138969 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1 admin admin] The token cache is being invalidate because project d5b5999182f940dda228a41d1eccc02b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:31.139255 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:31.139949 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-fb2f9c3b-6f4c-41c1-b4cf-8ddde68f1ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:31.141467 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1458/2897] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:31 2022] DELETE /identity/v3/projects/d5b5999182f940dda228a41d1eccc02b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:31.146820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb40080-ee3e-47f5-bc45-dc1588c2d612 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:31.147107 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb40080-ee3e-47f5-bc45-dc1588c2d612 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:31.147354 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb40080-ee3e-47f5-bc45-dc1588c2d612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:31.156089 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:31.172565 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-adb40080-ee3e-47f5-bc45-dc1588c2d612 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:31.173785 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-adb40080-ee3e-47f5-bc45-dc1588c2d612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:31.238295 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1440/2898] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:31.246423 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d6bea-8e3c-4327-9422-83da80ee4a93 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:31.246701 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d6bea-8e3c-4327-9422-83da80ee4a93 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:31.246971 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d6bea-8e3c-4327-9422-83da80ee4a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:31.269082 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-bf9d6bea-8e3c-4327-9422-83da80ee4a93 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:31.270296 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-bf9d6bea-8e3c-4327-9422-83da80ee4a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:31.280469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1459/2899] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:31.284920 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb40080-ee3e-47f5-bc45-dc1588c2d612 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:31.295289 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb40080-ee3e-47f5-bc45-dc1588c2d612 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:31.300103 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e1459-96b1-4db4-ada4-850244c8e07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:31.300708 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e1459-96b1-4db4-ada4-850244c8e07e admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:31.300986 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e1459-96b1-4db4-ada4-850244c8e07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:31.301361 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e1459-96b1-4db4-ada4-850244c8e07e admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:31.301937 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e1459-96b1-4db4-ada4-850244c8e07e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:31.302240 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e1459-96b1-4db4-ada4-850244c8e07e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:31.303915 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e1459-96b1-4db4-ada4-850244c8e07e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:31.315773 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1441/2900] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:29:31.320338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d6bea-8e3c-4327-9422-83da80ee4a93 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:31.330011 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d6bea-8e3c-4327-9422-83da80ee4a93 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:31.337911 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279149c-2662-4212-aa39-0449afb09658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:31.338797 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279149c-2662-4212-aa39-0449afb09658 admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:31.339095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279149c-2662-4212-aa39-0449afb09658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:31.339401 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279149c-2662-4212-aa39-0449afb09658 admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:31.340082 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279149c-2662-4212-aa39-0449afb09658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:31.341990 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279149c-2662-4212-aa39-0449afb09658 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:31.372908 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1460/2901] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:31 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:31.377105 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e1459-96b1-4db4-ada4-850244c8e07e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:31.387792 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e1459-96b1-4db4-ada4-850244c8e07e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:31.446990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471ffcd-66c2-46d7-bdb6-61c8986f2237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:31.447590 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471ffcd-66c2-46d7-bdb6-61c8986f2237 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:31.447903 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471ffcd-66c2-46d7-bdb6-61c8986f2237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:31.448181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471ffcd-66c2-46d7-bdb6-61c8986f2237 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:31.448832 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471ffcd-66c2-46d7-bdb6-61c8986f2237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:31.450755 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471ffcd-66c2-46d7-bdb6-61c8986f2237 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:31.472716 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1442/2902] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:31 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:31.476851 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279149c-2662-4212-aa39-0449afb09658 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:31.487388 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279149c-2662-4212-aa39-0449afb09658 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:31.492273 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23663cfd-fcbd-4052-889c-cd535be9df8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:31.492815 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23663cfd-fcbd-4052-889c-cd535be9df8b admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:31.493095 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23663cfd-fcbd-4052-889c-cd535be9df8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:31.493372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23663cfd-fcbd-4052-889c-cd535be9df8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:31.494046 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23663cfd-fcbd-4052-889c-cd535be9df8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:31.495647 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23663cfd-fcbd-4052-889c-cd535be9df8b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:31.505690 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1461/2903] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:31.509753 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471ffcd-66c2-46d7-bdb6-61c8986f2237 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:31.519995 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471ffcd-66c2-46d7-bdb6-61c8986f2237 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:31.525527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938f3bd-9524-4b7e-acea-a0e81fc51e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:31.526162 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938f3bd-9524-4b7e-acea-a0e81fc51e5e admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:31.526457 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938f3bd-9524-4b7e-acea-a0e81fc51e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:31.526729 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938f3bd-9524-4b7e-acea-a0e81fc51e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:31.527375 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938f3bd-9524-4b7e-acea-a0e81fc51e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:31.529019 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938f3bd-9524-4b7e-acea-a0e81fc51e5e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:31.540591 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1443/2904] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:29:31.544866 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23663cfd-fcbd-4052-889c-cd535be9df8b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:31.555303 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23663cfd-fcbd-4052-889c-cd535be9df8b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:31.560902 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33e2eb-2919-4aaa-85ff-ff7313649101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:31.561590 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33e2eb-2919-4aaa-85ff-ff7313649101 admin admin] REQUEST_METHOD: `PUT` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:31.561870 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33e2eb-2919-4aaa-85ff-ff7313649101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:31.562144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33e2eb-2919-4aaa-85ff-ff7313649101 admin admin] PATH_INFO: `/v3/projects/c17778f379bb4416ba9e51e682b33273/users/7da184455a8b441286eda724141a4b58/roles/8615852d81aa46c39661d01a0372d8e8` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:31.578239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33e2eb-2919-4aaa-85ff-ff7313649101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c17778f379bb4416ba9e51e682b33273, user_id=7da184455a8b441286eda724141a4b58, role_id=8615852d81aa46c39661d01a0372d8e8)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:31.581025 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33e2eb-2919-4aaa-85ff-ff7313649101 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:31.595513 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1462/2905] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:31 2022] PUT /identity/v3/projects/c17778f379bb4416ba9e51e682b33273/users/7da184455a8b441286eda724141a4b58/roles/8615852d81aa46c39661d01a0372d8e8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:31.600701 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c575e93-247f-4513-a955-c0e14ecf7146 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:31.600984 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c575e93-247f-4513-a955-c0e14ecf7146 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:31.601245 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c575e93-247f-4513-a955-c0e14ecf7146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:31.620450 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1c575e93-247f-4513-a955-c0e14ecf7146 None None] MFA Rules not processed for user `e54946c04b664d3c9e1fcc1a14c448bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:31.621645 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1c575e93-247f-4513-a955-c0e14ecf7146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:31.697055 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1444/2906] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:31.710844 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33e2eb-2919-4aaa-85ff-ff7313649101 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:31.713029 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-de33e2eb-2919-4aaa-85ff-ff7313649101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:31.736906 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:31.774650 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33e2eb-2919-4aaa-85ff-ff7313649101 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:31.778763 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fceef36-b50e-420a-bc2b-edd87395820b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:31.779368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fceef36-b50e-420a-bc2b-edd87395820b service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:31.779645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fceef36-b50e-420a-bc2b-edd87395820b service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:31.779951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fceef36-b50e-420a-bc2b-edd87395820b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:31.790188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fceef36-b50e-420a-bc2b-edd87395820b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:31.791631 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fceef36-b50e-420a-bc2b-edd87395820b service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:31.801622 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1463/2907] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:35.539746 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc5eb7-baef-4127-b298-b783eb3e0e17 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:35.541249 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc5eb7-baef-4127-b298-b783eb3e0e17 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:35.541541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc5eb7-baef-4127-b298-b783eb3e0e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:35.571185 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:35.583069 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3cbc5eb7-baef-4127-b298-b783eb3e0e17 None None] MFA Rules not processed for user `7da184455a8b441286eda724141a4b58`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:35.584341 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3cbc5eb7-baef-4127-b298-b783eb3e0e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:35.661790 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1445/2908] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:29:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:35.665869 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fceef36-b50e-420a-bc2b-edd87395820b service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:35.676548 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fceef36-b50e-420a-bc2b-edd87395820b service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:35.682160 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a934f1-91b1-448a-a886-1c36e41e104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:35.682674 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a934f1-91b1-448a-a886-1c36e41e104c admin admin] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:35.683113 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a934f1-91b1-448a-a886-1c36e41e104c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:35.683399 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a934f1-91b1-448a-a886-1c36e41e104c admin admin] PATH_INFO: `/v3/projects` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:35.684161 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a934f1-91b1-448a-a886-1c36e41e104c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:35.686176 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a934f1-91b1-448a-a886-1c36e41e104c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:35.719174 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1464/2909] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:35 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:35.723372 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc5eb7-baef-4127-b298-b783eb3e0e17 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:35.735198 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc5eb7-baef-4127-b298-b783eb3e0e17 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:35.803152 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7182176-801f-49fa-b08d-3188c6b14328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:35.803955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7182176-801f-49fa-b08d-3188c6b14328 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:35.804337 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7182176-801f-49fa-b08d-3188c6b14328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:35.804709 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7182176-801f-49fa-b08d-3188c6b14328 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:35.805465 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7182176-801f-49fa-b08d-3188c6b14328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:35.807527 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7182176-801f-49fa-b08d-3188c6b14328 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:35.834233 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1446/2910] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:35 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:35.838250 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a934f1-91b1-448a-a886-1c36e41e104c admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:35.849352 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a934f1-91b1-448a-a886-1c36e41e104c admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:35.854430 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18b8df-fe74-48d8-83b4-cbf8fe2c6850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:35.855068 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18b8df-fe74-48d8-83b4-cbf8fe2c6850 admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:35.855354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18b8df-fe74-48d8-83b4-cbf8fe2c6850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:35.855630 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18b8df-fe74-48d8-83b4-cbf8fe2c6850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:35.856316 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18b8df-fe74-48d8-83b4-cbf8fe2c6850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:35.857977 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18b8df-fe74-48d8-83b4-cbf8fe2c6850 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:35.869656 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1465/2911] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:35.873911 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7182176-801f-49fa-b08d-3188c6b14328 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:35.885480 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7182176-801f-49fa-b08d-3188c6b14328 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:35.890426 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6bbc4-0bd5-4a70-88fe-2e00f6727011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:35.891118 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6bbc4-0bd5-4a70-88fe-2e00f6727011 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:35.891368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6bbc4-0bd5-4a70-88fe-2e00f6727011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:35.891641 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6bbc4-0bd5-4a70-88fe-2e00f6727011 admin admin] PATH_INFO: `/v3/projects/7f25eaa8b25748ddb974af84226c2aec/users/e984ceb4621e48538be9fb8eaa41d895/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:35.913096 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6bbc4-0bd5-4a70-88fe-2e00f6727011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f25eaa8b25748ddb974af84226c2aec, user_id=e984ceb4621e48538be9fb8eaa41d895, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:35.916272 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6bbc4-0bd5-4a70-88fe-2e00f6727011 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:35.933134 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1447/2912] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:35 2022] PUT /identity/v3/projects/7f25eaa8b25748ddb974af84226c2aec/users/e984ceb4621e48538be9fb8eaa41d895/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:35.937357 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18b8df-fe74-48d8-83b4-cbf8fe2c6850 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:35.949154 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18b8df-fe74-48d8-83b4-cbf8fe2c6850 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:36.007609 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cd8ae-b3a2-4117-9af8-4675570f030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:36.008174 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cd8ae-b3a2-4117-9af8-4675570f030c admin admin] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:36.008454 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cd8ae-b3a2-4117-9af8-4675570f030c admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:36.008722 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cd8ae-b3a2-4117-9af8-4675570f030c admin admin] PATH_INFO: `/v3/roles` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:36.009354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cd8ae-b3a2-4117-9af8-4675570f030c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:36.011030 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cd8ae-b3a2-4117-9af8-4675570f030c admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:36.021253 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1466/2913] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:36.026214 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6bbc4-0bd5-4a70-88fe-2e00f6727011 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:36.042975 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6bbc4-0bd5-4a70-88fe-2e00f6727011 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:36.048956 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142de987-09b4-4fe2-8471-91ec988ad36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:36.049499 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de987-09b4-4fe2-8471-91ec988ad36c admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:36.049779 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de987-09b4-4fe2-8471-91ec988ad36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:36.050049 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de987-09b4-4fe2-8471-91ec988ad36c admin admin] PATH_INFO: `/v3/projects/7f25eaa8b25748ddb974af84226c2aec/users/e984ceb4621e48538be9fb8eaa41d895/roles/1d8dcb6cdf6d435c8f82f63f95d79093` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:36.052532 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142de987-09b4-4fe2-8471-91ec988ad36c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f25eaa8b25748ddb974af84226c2aec, user_id=e984ceb4621e48538be9fb8eaa41d895, role_id=1d8dcb6cdf6d435c8f82f63f95d79093)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:36.055165 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142de987-09b4-4fe2-8471-91ec988ad36c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:36.066665 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1448/2914] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:36 2022] PUT /identity/v3/projects/7f25eaa8b25748ddb974af84226c2aec/users/e984ceb4621e48538be9fb8eaa41d895/roles/1d8dcb6cdf6d435c8f82f63f95d79093 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:40.527410 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661024f9-80dc-42d8-9427-0e96a87268f9 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:40.527983 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661024f9-80dc-42d8-9427-0e96a87268f9 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:40.528102 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661024f9-80dc-42d8-9427-0e96a87268f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:40.558318 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-661024f9-80dc-42d8-9427-0e96a87268f9 None None] MFA Rules not processed for user `e984ceb4621e48538be9fb8eaa41d895`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:40.559540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-661024f9-80dc-42d8-9427-0e96a87268f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:40.632290 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1467/2915] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:29:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:40.644797 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142de987-09b4-4fe2-8471-91ec988ad36c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:40.646742 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-142de987-09b4-4fe2-8471-91ec988ad36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:40.711964 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142de987-09b4-4fe2-8471-91ec988ad36c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:40.716737 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4034-09f6-41c1-81f7-81152b2c7496 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f886be277ef84ec28a290380980c6f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:40.717486 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4034-09f6-41c1-81f7-81152b2c7496 service glance] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:40.717766 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4034-09f6-41c1-81f7-81152b2c7496 service glance] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:40.718041 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4034-09f6-41c1-81f7-81152b2c7496 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:40.723847 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:40.782836 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4034-09f6-41c1-81f7-81152b2c7496 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:40.784335 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4034-09f6-41c1-81f7-81152b2c7496 service glance] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:40.795748 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1449/2916] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:40.920312 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86338b18-7882-45e9-83ff-e88cd75f89cd None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:40.920595 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86338b18-7882-45e9-83ff-e88cd75f89cd None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:40.920862 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86338b18-7882-45e9-83ff-e88cd75f89cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:40.939338 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:40.954354 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-86338b18-7882-45e9-83ff-e88cd75f89cd None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:40.955578 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-86338b18-7882-45e9-83ff-e88cd75f89cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:41.014094 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1468/2917] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:29:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:41.064298 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4034-09f6-41c1-81f7-81152b2c7496 service glance] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:41.065763 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-08eb4034-09f6-41c1-81f7-81152b2c7496 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:41.139419 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4034-09f6-41c1-81f7-81152b2c7496 service glance] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:41.145076 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4b195-b03f-44ff-9b7b-7343decd9eb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:41.145703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4b195-b03f-44ff-9b7b-7343decd9eb1 service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:41.145977 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4b195-b03f-44ff-9b7b-7343decd9eb1 service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:41.146251 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4b195-b03f-44ff-9b7b-7343decd9eb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:41.155436 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4b195-b03f-44ff-9b7b-7343decd9eb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:41.157047 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4b195-b03f-44ff-9b7b-7343decd9eb1 service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:41.165625 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1450/2918] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:29:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:29:49.616200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c5f21-a83a-4a01-b1be-8d57027c2bd7 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:49.616715 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c5f21-a83a-4a01-b1be-8d57027c2bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:49.616715 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c5f21-a83a-4a01-b1be-8d57027c2bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:49.637087 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-772c5f21-a83a-4a01-b1be-8d57027c2bd7 None None] MFA Rules not processed for user `7da184455a8b441286eda724141a4b58`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:49.638225 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-772c5f21-a83a-4a01-b1be-8d57027c2bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:49.646176 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1469/2919] 10.222.0.50 () {58 vars in 958 bytes} [Wed Aug 31 00:29:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:50.757120 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4b195-b03f-44ff-9b7b-7343decd9eb1 service swift] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:50.759468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e8d4b195-b03f-44ff-9b7b-7343decd9eb1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:50.862551 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4b195-b03f-44ff-9b7b-7343decd9eb1 service swift] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:50.868398 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e12ef-ba18-4a17-b54b-b67f4e15d1e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01dd2631a81402d8a5bba7007c7fd61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:50.869032 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e12ef-ba18-4a17-b54b-b67f4e15d1e9 service placement] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:50.869310 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e12ef-ba18-4a17-b54b-b67f4e15d1e9 service placement] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:50.869631 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e12ef-ba18-4a17-b54b-b67f4e15d1e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:50.871731 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-605e12ef-ba18-4a17-b54b-b67f4e15d1e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:50.883735 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e12ef-ba18-4a17-b54b-b67f4e15d1e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:50.885327 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e12ef-ba18-4a17-b54b-b67f4e15d1e9 service placement] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:50.895371 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1451/2920] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:51.913441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52ac14-ea71-43f6-8d1c-b0211fb9c9b9 None None] REQUEST_METHOD: `POST` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:51.913957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52ac14-ea71-43f6-8d1c-b0211fb9c9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:51.913957 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52ac14-ea71-43f6-8d1c-b0211fb9c9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:51.933640 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.auth.core [None req-2e52ac14-ea71-43f6-8d1c-b0211fb9c9b9 None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:51.934872 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-2e52ac14-ea71-43f6-8d1c-b0211fb9c9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:51.942670 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1470/2921] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Aug 31 00:29:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:51.955410 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e12ef-ba18-4a17-b54b-b67f4e15d1e9 service placement] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:51.962243 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:51.967997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e12ef-ba18-4a17-b54b-b67f4e15d1e9 service placement] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:51.974577 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b073d-8eea-4223-9acb-c323f38d11ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:51.975121 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b073d-8eea-4223-9acb-c323f38d11ab service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:51.975390 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b073d-8eea-4223-9acb-c323f38d11ab service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:51.975659 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b073d-8eea-4223-9acb-c323f38d11ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:51.984482 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b073d-8eea-4223-9acb-c323f38d11ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:51.986308 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b073d-8eea-4223-9acb-c323f38d11ab service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:51.994990 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1452/2922] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:29:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:01.928809 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=30 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:01.992235 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:12.470950 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52ac14-ea71-43f6-8d1c-b0211fb9c9b9 None None] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:12.530604 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52ac14-ea71-43f6-8d1c-b0211fb9c9b9 None None] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:12.534529 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c2327-fb2c-432c-be4c-f6463d86913f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:12.535132 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c2327-fb2c-432c-be4c-f6463d86913f service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:12.535409 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c2327-fb2c-432c-be4c-f6463d86913f service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:12.535685 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c2327-fb2c-432c-be4c-f6463d86913f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:12.545736 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c2327-fb2c-432c-be4c-f6463d86913f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:12.547169 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c2327-fb2c-432c-be4c-f6463d86913f service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:12.556958 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1471/2923] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:22.552881 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=26 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:49.901697 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b073d-8eea-4223-9acb-c323f38d11ab service swift] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:49.903469 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3a7b073d-8eea-4223-9acb-c323f38d11ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:49.918646 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b073d-8eea-4223-9acb-c323f38d11ab service swift] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:49.924374 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de472b-f69d-4d4c-bb51-98d8518f1d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:49.925001 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de472b-f69d-4d4c-bb51-98d8518f1d9d service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:49.925304 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de472b-f69d-4d4c-bb51-98d8518f1d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:49.925574 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de472b-f69d-4d4c-bb51-98d8518f1d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:49.927514 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-50de472b-f69d-4d4c-bb51-98d8518f1d9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:50.004386 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de472b-f69d-4d4c-bb51-98d8518f1d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:50.005820 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de472b-f69d-4d4c-bb51-98d8518f1d9d service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:50.017176 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1453/2924] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:51.220505 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c2327-fb2c-432c-be4c-f6463d86913f service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:51.229519 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c2327-fb2c-432c-be4c-f6463d86913f service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:51.233571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005453-ae8f-461e-97d8-6144fd934adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:51.234162 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005453-ae8f-461e-97d8-6144fd934adf service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:51.234435 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005453-ae8f-461e-97d8-6144fd934adf service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:51.234708 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005453-ae8f-461e-97d8-6144fd934adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:51.236904 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-84005453-ae8f-461e-97d8-6144fd934adf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:51.251242 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84005453-ae8f-461e-97d8-6144fd934adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:51.252746 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84005453-ae8f-461e-97d8-6144fd934adf service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:51.263610 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1472/2925] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:31:00.013291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=34 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:01.259013 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=6 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:13.878541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de472b-f69d-4d4c-bb51-98d8518f1d9d service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:13.887755 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de472b-f69d-4d4c-bb51-98d8518f1d9d service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:13.891727 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95c12a-8d89-45d3-b601-d7927c9f5bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:13.892357 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95c12a-8d89-45d3-b601-d7927c9f5bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:13.892634 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95c12a-8d89-45d3-b601-d7927c9f5bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:13.892905 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95c12a-8d89-45d3-b601-d7927c9f5bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:13.894627 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8c95c12a-8d89-45d3-b601-d7927c9f5bf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:13.905666 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95c12a-8d89-45d3-b601-d7927c9f5bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:13.907224 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95c12a-8d89-45d3-b601-d7927c9f5bf0 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:13.916919 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1454/2926] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:13.993044 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005453-ae8f-461e-97d8-6144fd934adf service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:14.002462 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005453-ae8f-461e-97d8-6144fd934adf service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:14.006333 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00c8bf-1265-4638-ad9b-0847773ab3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:14.006826 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c8bf-1265-4638-ad9b-0847773ab3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:14.007033 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c8bf-1265-4638-ad9b-0847773ab3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:14.007305 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c8bf-1265-4638-ad9b-0847773ab3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:14.009153 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-eb00c8bf-1265-4638-ad9b-0847773ab3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:14.022925 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00c8bf-1265-4638-ad9b-0847773ab3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:14.024383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00c8bf-1265-4638-ad9b-0847773ab3c4 service neutron] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:14.035252 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1473/2927] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:23.912484 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=6 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:24.030599 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=6 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:34.217764 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0c10d-d3e2-4a80-8986-19be4b056fdc None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:34.218256 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0c10d-d3e2-4a80-8986-19be4b056fdc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:34.218382 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0c10d-d3e2-4a80-8986-19be4b056fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:34.269164 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-6bf0c10d-d3e2-4a80-8986-19be4b056fdc None None] MFA Rules not processed for user `bc55768a6d2940f8b9c406bad2c278b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:34.270370 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6bf0c10d-d3e2-4a80-8986-19be4b056fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:34.288003 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1455/2928] 10.222.0.50 () {58 vars in 967 bytes} [Wed Aug 31 00:31:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:34.330226 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00c8bf-1265-4638-ad9b-0847773ab3c4 service neutron] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:34.352327 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00c8bf-1265-4638-ad9b-0847773ab3c4 service neutron] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:34.357699 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2635e-f63a-4920-a843-a1a95fa846b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac02a26fe2a44b7db623003d1a96ed36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:34.358298 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2635e-f63a-4920-a843-a1a95fa846b5 service swift] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:34.358571 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2635e-f63a-4920-a843-a1a95fa846b5 service swift] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:34.358838 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2635e-f63a-4920-a843-a1a95fa846b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:34.366865 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2635e-f63a-4920-a843-a1a95fa846b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:34.368562 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2635e-f63a-4920-a843-a1a95fa846b5 service swift] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:34.376540 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1474/2929] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Aug 31 00:31:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:31:40.895086 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0c10d-d3e2-4a80-8986-19be4b056fdc None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:40.962359 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0c10d-d3e2-4a80-8986-19be4b056fdc None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:40.967113 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a27e7-42f8-413d-bd44-afb00bb741de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:40.967760 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a27e7-42f8-413d-bd44-afb00bb741de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:40.968044 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a27e7-42f8-413d-bd44-afb00bb741de admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:40.968319 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a27e7-42f8-413d-bd44-afb00bb741de admin admin] PATH_INFO: `/v3/users/7da184455a8b441286eda724141a4b58` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:40.969482 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a27e7-42f8-413d-bd44-afb00bb741de admin admin] RBAC: Authorizing `identity:delete_user(user_id=7da184455a8b441286eda724141a4b58)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:40.971400 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a27e7-42f8-413d-bd44-afb00bb741de admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:41.020194 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1c3a27e7-42f8-413d-bd44-afb00bb741de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7da184455a8b441286eda724141a4b58'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.032468 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1c3a27e7-42f8-413d-bd44-afb00bb741de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7da184455a8b441286eda724141a4b58'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.039519 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1c3a27e7-42f8-413d-bd44-afb00bb741de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7da184455a8b441286eda724141a4b58'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.049819 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1c3a27e7-42f8-413d-bd44-afb00bb741de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7da184455a8b441286eda724141a4b58'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.050614 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1c3a27e7-42f8-413d-bd44-afb00bb741de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7da184455a8b441286eda724141a4b58'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.056841 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1456/2930] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:31:40 2022] DELETE /identity/v3/users/7da184455a8b441286eda724141a4b58 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:41.238239 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2635e-f63a-4920-a843-a1a95fa846b5 service swift] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:41.249090 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2635e-f63a-4920-a843-a1a95fa846b5 service swift] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:41.305870 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:41.306495 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:41.306769 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:41.307034 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] PATH_INFO: `/v3/projects/c17778f379bb4416ba9e51e682b33273` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:41.308148 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c17778f379bb4416ba9e51e682b33273)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:41.310087 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:41.358306 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c17778f379bb4416ba9e51e682b33273', 'request_id': 'req-5e6c20be-5ba3-488f-806c-60660b698b5b'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.366558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c17778f379bb4416ba9e51e682b33273', 'request_id': 'req-5e6c20be-5ba3-488f-806c-60660b698b5b'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.372208 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c17778f379bb4416ba9e51e682b33273', 'request_id': 'req-5e6c20be-5ba3-488f-806c-60660b698b5b'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.385613 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] The token cache is being invalidate because project c17778f379bb4416ba9e51e682b33273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:31:41.386166 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.387234 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.389145 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1475/2931] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:31:41 2022] DELETE /identity/v3/projects/c17778f379bb4416ba9e51e682b33273 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:41.393340 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a27e7-42f8-413d-bd44-afb00bb741de admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:41.394800 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1c3a27e7-42f8-413d-bd44-afb00bb741de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:41.411432 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a27e7-42f8-413d-bd44-afb00bb741de admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:41.453470 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:41.475328 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aca77-a9b6-4578-b529-0d6102b41995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:41.475993 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aca77-a9b6-4578-b529-0d6102b41995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:41.476271 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aca77-a9b6-4578-b529-0d6102b41995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:41.476538 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aca77-a9b6-4578-b529-0d6102b41995 admin admin] PATH_INFO: `/v3/users/e984ceb4621e48538be9fb8eaa41d895` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:41.477673 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aca77-a9b6-4578-b529-0d6102b41995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e984ceb4621e48538be9fb8eaa41d895)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:41.481721 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aca77-a9b6-4578-b529-0d6102b41995 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:41.532490 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-593aca77-a9b6-4578-b529-0d6102b41995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e984ceb4621e48538be9fb8eaa41d895'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.545125 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-593aca77-a9b6-4578-b529-0d6102b41995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e984ceb4621e48538be9fb8eaa41d895'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.552460 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-593aca77-a9b6-4578-b529-0d6102b41995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e984ceb4621e48538be9fb8eaa41d895'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.561106 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-593aca77-a9b6-4578-b529-0d6102b41995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e984ceb4621e48538be9fb8eaa41d895'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.561810 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-593aca77-a9b6-4578-b529-0d6102b41995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e984ceb4621e48538be9fb8eaa41d895'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.568161 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1457/2932] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:31:41 2022] DELETE /identity/v3/users/e984ceb4621e48538be9fb8eaa41d895 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:41.751877 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:41.753469 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:41.767795 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c20be-5ba3-488f-806c-60660b698b5b admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:41.826570 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:41.827262 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:41.827530 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:41.827833 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] PATH_INFO: `/v3/projects/7f25eaa8b25748ddb974af84226c2aec` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:41.829022 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f25eaa8b25748ddb974af84226c2aec)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:41.830915 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:41.842751 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:41.882436 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f25eaa8b25748ddb974af84226c2aec', 'request_id': 'req-b3a97137-6723-4877-a88d-59b5d76b20b0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.890816 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f25eaa8b25748ddb974af84226c2aec', 'request_id': 'req-b3a97137-6723-4877-a88d-59b5d76b20b0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.896369 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f25eaa8b25748ddb974af84226c2aec', 'request_id': 'req-b3a97137-6723-4877-a88d-59b5d76b20b0'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.908372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] The token cache is being invalidate because project 7f25eaa8b25748ddb974af84226c2aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:31:41.908664 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.909383 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:41.911311 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1476/2933] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:31:41 2022] DELETE /identity/v3/projects/7f25eaa8b25748ddb974af84226c2aec => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:51.564997 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:51.905189 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:32.484291 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aca77-a9b6-4578-b529-0d6102b41995 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:32.486747 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-593aca77-a9b6-4578-b529-0d6102b41995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:32.566862 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aca77-a9b6-4578-b529-0d6102b41995 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:32.624084 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed6d2f-0dd4-4405-a5b8-7c4094c9d5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bde943833bb43e78879748c49ce3332', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:32.624703 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed6d2f-0dd4-4405-a5b8-7c4094c9d5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:32.624981 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed6d2f-0dd4-4405-a5b8-7c4094c9d5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:32.625258 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed6d2f-0dd4-4405-a5b8-7c4094c9d5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:32.627050 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-33ed6d2f-0dd4-4405-a5b8-7c4094c9d5f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:32.637690 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed6d2f-0dd4-4405-a5b8-7c4094c9d5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:32.639156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed6d2f-0dd4-4405-a5b8-7c4094c9d5f9 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:32.649365 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1458/2934] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:32:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:32:34.688989 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:34.690715 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:34.768653 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a97137-6723-4877-a88d-59b5d76b20b0 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:34.774372 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f53286-e6df-4da5-8c9d-087b7905142b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb9ef38ec3b448828826de5f76a552d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:34.774982 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f53286-e6df-4da5-8c9d-087b7905142b service nova] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:34.775261 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f53286-e6df-4da5-8c9d-087b7905142b service nova] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:34.775535 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f53286-e6df-4da5-8c9d-087b7905142b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:34.777424 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-45f53286-e6df-4da5-8c9d-087b7905142b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:34.790058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f53286-e6df-4da5-8c9d-087b7905142b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:34.791641 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f53286-e6df-4da5-8c9d-087b7905142b service nova] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:34.802551 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1477/2935] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:32:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:32:39.363348 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed6d2f-0dd4-4405-a5b8-7c4094c9d5f9 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:39.364967 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-33ed6d2f-0dd4-4405-a5b8-7c4094c9d5f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:39.446609 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed6d2f-0dd4-4405-a5b8-7c4094c9d5f9 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:39.451856 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7b489-7590-4a6a-9830-54d416e5b74a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01dd2631a81402d8a5bba7007c7fd61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:39.452478 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7b489-7590-4a6a-9830-54d416e5b74a service placement] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:39.452758 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7b489-7590-4a6a-9830-54d416e5b74a service placement] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:39.453030 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7b489-7590-4a6a-9830-54d416e5b74a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:39.454776 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8be7b489-7590-4a6a-9830-54d416e5b74a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:39.466771 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7b489-7590-4a6a-9830-54d416e5b74a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:39.468402 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7b489-7590-4a6a-9830-54d416e5b74a service placement] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:39.480541 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1459/2936] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:32:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:32:42.380502 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f53286-e6df-4da5-8c9d-087b7905142b service nova] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:42.382563 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-45f53286-e6df-4da5-8c9d-087b7905142b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:42.452645 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f53286-e6df-4da5-8c9d-087b7905142b service nova] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:42.457144 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd84e4-cc9f-410e-80d3-21b1e1733ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:42.457777 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd84e4-cc9f-410e-80d3-21b1e1733ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:42.458058 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd84e4-cc9f-410e-80d3-21b1e1733ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:42.458334 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd84e4-cc9f-410e-80d3-21b1e1733ca8 admin admin] PATH_INFO: `/v3/users/6b1c626bcfc8445eab2006fb4b69c4ff` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:42.459457 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd84e4-cc9f-410e-80d3-21b1e1733ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b1c626bcfc8445eab2006fb4b69c4ff)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:42.461418 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd84e4-cc9f-410e-80d3-21b1e1733ca8 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:42.510518 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-89fd84e4-cc9f-410e-80d3-21b1e1733ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b1c626bcfc8445eab2006fb4b69c4ff'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:42.522622 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-89fd84e4-cc9f-410e-80d3-21b1e1733ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b1c626bcfc8445eab2006fb4b69c4ff'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:42.530444 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-89fd84e4-cc9f-410e-80d3-21b1e1733ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b1c626bcfc8445eab2006fb4b69c4ff'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:42.541628 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-89fd84e4-cc9f-410e-80d3-21b1e1733ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b1c626bcfc8445eab2006fb4b69c4ff'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:42.542210 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-89fd84e4-cc9f-410e-80d3-21b1e1733ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b1c626bcfc8445eab2006fb4b69c4ff'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:42.548389 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1478/2937] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:32:42 2022] DELETE /identity/v3/users/6b1c626bcfc8445eab2006fb4b69c4ff => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:32:42.734269 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7b489-7590-4a6a-9830-54d416e5b74a service placement] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:42.745788 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7b489-7590-4a6a-9830-54d416e5b74a service placement] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:42.793007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:42.805972 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:42.806634 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:42.806889 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:42.807183 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] PATH_INFO: `/v3/projects/1c95ccd777c74d1d87aceb07b13c3947` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:42.808368 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c95ccd777c74d1d87aceb07b13c3947)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:42.810364 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:42.856757 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c95ccd777c74d1d87aceb07b13c3947', 'request_id': 'req-17900a91-aa87-470a-82c5-4c97a72b5ec3'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:42.866345 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c95ccd777c74d1d87aceb07b13c3947', 'request_id': 'req-17900a91-aa87-470a-82c5-4c97a72b5ec3'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:42.873743 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c95ccd777c74d1d87aceb07b13c3947', 'request_id': 'req-17900a91-aa87-470a-82c5-4c97a72b5ec3'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:42.884865 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] The token cache is being invalidate because project 1c95ccd777c74d1d87aceb07b13c3947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:32:42.885156 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:42.885869 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:42.887545 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1460/2938] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:32:42 2022] DELETE /identity/v3/projects/1c95ccd777c74d1d87aceb07b13c3947 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:32:42.891823 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd84e4-cc9f-410e-80d3-21b1e1733ca8 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:42.893315 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-89fd84e4-cc9f-410e-80d3-21b1e1733ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:42.902841 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:42.907558 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd84e4-cc9f-410e-80d3-21b1e1733ca8 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:42.968765 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e66a8-ed3a-4f46-bd1d-bf5260103c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:42.969393 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e66a8-ed3a-4f46-bd1d-bf5260103c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:42.969676 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e66a8-ed3a-4f46-bd1d-bf5260103c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:42.969951 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e66a8-ed3a-4f46-bd1d-bf5260103c32 admin admin] PATH_INFO: `/v3/users/dc00c318cb874621ab3c18d039d0d0eb` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:42.971188 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e66a8-ed3a-4f46-bd1d-bf5260103c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc00c318cb874621ab3c18d039d0d0eb)` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:42.973131 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e66a8-ed3a-4f46-bd1d-bf5260103c32 admin admin] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:43.023053 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ca7e66a8-ed3a-4f46-bd1d-bf5260103c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc00c318cb874621ab3c18d039d0d0eb'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:43.034743 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ca7e66a8-ed3a-4f46-bd1d-bf5260103c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc00c318cb874621ab3c18d039d0d0eb'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:43.044368 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ca7e66a8-ed3a-4f46-bd1d-bf5260103c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc00c318cb874621ab3c18d039d0d0eb'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:43.053441 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ca7e66a8-ed3a-4f46-bd1d-bf5260103c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc00c318cb874621ab3c18d039d0d0eb'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:43.054200 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.notifications [None req-ca7e66a8-ed3a-4f46-bd1d-bf5260103c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc00c318cb874621ab3c18d039d0d0eb'} {{(pid=81492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:43.061085 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1479/2939] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 00:32:42 2022] DELETE /identity/v3/users/dc00c318cb874621ab3c18d039d0d0eb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:32:43.245130 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:43.246754 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:43.260630 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17900a91-aa87-470a-82c5-4c97a72b5ec3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:43.320857 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e54946c04b664d3c9e1fcc1a14c448bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ead22b3b4a34507bccadbdf3ec17342', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:43.321407 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:43.321681 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:43.321955 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72 admin admin] PATH_INFO: `/v3/projects/def669225b2d4cb3b12c155051d5a56f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:43.323094 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def669225b2d4cb3b12c155051d5a56f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:43.325068 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:43.371985 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def669225b2d4cb3b12c155051d5a56f', 'request_id': 'req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:43.379812 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def669225b2d4cb3b12c155051d5a56f', 'request_id': 'req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:43.385181 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def669225b2d4cb3b12c155051d5a56f', 'request_id': 'req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:43.399395 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72 admin admin] The token cache is being invalidate because project def669225b2d4cb3b12c155051d5a56f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:32:43.399798 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:43.400745 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-deac730f-e3e7-4edc-b5d7-e4fc0b7a0b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:43.403007 dv-cinder-852210-5-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1461/2940] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 00:32:43 2022] DELETE /identity/v3/projects/def669225b2d4cb3b12c155051d5a56f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:32:53.057433 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:53.394506 dv-cinder-852210-5-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:01.584551 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e66a8-ed3a-4f46-bd1d-bf5260103c32 admin admin] Authenticating user token {{(pid=81492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:35:01.586195 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-ca7e66a8-ed3a-4f46-bd1d-bf5260103c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:35:01.661159 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e66a8-ed3a-4f46-bd1d-bf5260103c32 admin admin] Validating token access rules against request {{(pid=81492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:35:01.723050 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf9f79-28d0-4135-8a0c-ac9f703dcb39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01dd2631a81402d8a5bba7007c7fd61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0864c2a6b50f403db79930d0869f8e23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:35:01.723662 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf9f79-28d0-4135-8a0c-ac9f703dcb39 service placement] REQUEST_METHOD: `GET` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:35:01.724022 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf9f79-28d0-4135-8a0c-ac9f703dcb39 service placement] SCRIPT_NAME: `/identity` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:35:01.724295 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf9f79-28d0-4135-8a0c-ac9f703dcb39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:35:01.726032 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.fernet_utils [None req-5bbf9f79-28d0-4135-8a0c-ac9f703dcb39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:35:01.737460 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf9f79-28d0-4135-8a0c-ac9f703dcb39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:35:01.739043 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf9f79-28d0-4135-8a0c-ac9f703dcb39 service placement] RBAC: Authorization granted {{(pid=81492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:35:01.749114 dv-cinder-852210-5-smb devstack@keystone.service[81492]: [pid: 81492|app: 0|req: 1480/2941] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Aug 31 00:35:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:35:11.744883 dv-cinder-852210-5-smb devstack@keystone.service[81492]: DEBUG dbcounter [-] [81492] Writing DB stats keystone:SELECT=58 {{(pid=81492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}